orcaLog in

Runs · run 182

load_day 2026-09-18, attempt 1 succeeded

Host
4e84322b8c45:31437
Started
2026-11-07T03:57:29Z
Ended
2026-11-07T03:58:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/182/load_day/2026-09-18/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:57:29Z [load_day 2026-09-18] attempt 1 started
2026-11-07T03:57:37Z [load_day 2026-09-18] 2026-09-18 hour 0: 75349 events in 2 files, snapshot 3255889462070609682 (task 5644 ms: download 2100 ms overlapping gunzip 376 ms, parse 1138 ms, sort 238 ms, write 2587 ms, index 236 ms: 8 candidates, 37203 repo-hours, 801 releases; waiting 713 ms; commit 710 ms)
2026-11-07T03:57:38Z [load_day 2026-09-18] 2026-09-18 hour 1: 77349 events in 2 files, snapshot 348580406730806717 (task 4784 ms: download 2244 ms overlapping gunzip 296 ms, parse 934 ms, sort 102 ms, write 2293 ms, index 273 ms: 5 candidates, 38750 repo-hours, 694 releases; waiting 556 ms; commit 787 ms)
2026-11-07T03:57:42Z [load_day 2026-09-18] 2026-09-18 hour 2: 90815 events in 2 files, snapshot 8916632889538637095 (task 4717 ms: download 1637 ms overlapping gunzip 298 ms, parse 882 ms, sort 88 ms, write 2259 ms, index 309 ms: 4 candidates, 45329 repo-hours, 609 releases; waiting 577 ms; commit 775 ms)
2026-11-07T03:57:43Z [load_day 2026-09-18] 2026-09-18 hour 3: 96199 events in 2 files, snapshot 6556155784853287118 (task 4263 ms: download 1416 ms overlapping gunzip 303 ms, parse 972 ms, sort 97 ms, write 1976 ms, index 271 ms: 4 candidates, 45806 repo-hours, 481 releases; waiting 332 ms; commit 788 ms)
2026-11-07T03:57:47Z [load_day 2026-09-18] 2026-09-18 hour 4: 101144 events in 3 files, snapshot 6066092374620292528 (task 4355 ms: download 1371 ms overlapping gunzip 283 ms, parse 871 ms, sort 110 ms, write 1957 ms, index 307 ms: 2 candidates, 46828 repo-hours, 540 releases; waiting 554 ms; commit 789 ms)
2026-11-07T03:57:48Z [load_day 2026-09-18] 2026-09-18 hour 5: 107390 events in 3 files, snapshot 7355278218509499304 (task 4471 ms: download 1579 ms overlapping gunzip 267 ms, parse 810 ms, sort 120 ms, write 2152 ms, index 287 ms: 2 candidates, 44827 repo-hours, 431 releases; waiting 576 ms; commit 626 ms)
2026-11-07T03:57:51Z [load_day 2026-09-18] 2026-09-18 hour 6: 110609 events in 3 files, snapshot 7117545159652752898 (task 3832 ms: download 1650 ms overlapping gunzip 210 ms, parse 652 ms, sort 85 ms, write 1655 ms, index 296 ms: 4 candidates, 46369 repo-hours, 210 releases; waiting 638 ms; commit 683 ms)
2026-11-07T03:57:53Z [load_day 2026-09-18] 2026-09-18 hour 7: 108049 events in 3 files, snapshot 4621109313309888379 (task 4062 ms: download 1617 ms overlapping gunzip 222 ms, parse 680 ms, sort 86 ms, write 1873 ms, index 325 ms: 10 candidates, 50865 repo-hours, 319 releases; waiting 556 ms; commit 754 ms)
2026-11-07T03:57:56Z [load_day 2026-09-18] 2026-09-18 hour 8: 105989 events in 3 files, snapshot 7587661807184263367 (task 3770 ms: download 1227 ms overlapping gunzip 213 ms, parse 667 ms, sort 82 ms, write 1674 ms, index 351 ms: 5 candidates, 48449 repo-hours, 233 releases; waiting 557 ms; commit 619 ms)
2026-11-07T03:57:57Z [load_day 2026-09-18] 2026-09-18 hour 9: 95188 events in 2 files, snapshot 7227268230071237622 (task 3537 ms: download 1245 ms overlapping gunzip 191 ms, parse 597 ms, sort 67 ms, write 1347 ms, index 524 ms: 10 candidates, 49033 repo-hours, 197 releases; waiting 549 ms; commit 620 ms)
2026-11-07T03:58:00Z [load_day 2026-09-18] 2026-09-18 hour 10: 90037 events in 2 files, snapshot 6459081426212950241 (task 3156 ms: download 1134 ms overlapping gunzip 154 ms, parse 490 ms, sort 61 ms, write 1213 ms, index 326 ms: 10 candidates, 51387 repo-hours, 108 releases; waiting 551 ms; commit 568 ms)
2026-11-07T03:58:01Z [load_day 2026-09-18] 2026-09-18 hour 11: 92810 events in 2 files, snapshot 4406110552746734543 (task 3211 ms: download 1465 ms overlapping gunzip 169 ms, parse 529 ms, sort 67 ms, write 1210 ms, index 330 ms: 7 candidates, 51940 repo-hours, 120 releases; waiting 572 ms; commit 607 ms)
2026-11-07T03:58:03Z [load_day 2026-09-18] 2026-09-18 hour 12: 93389 events in 2 files, snapshot 5874431485928459564 (task 3014 ms: download 1224 ms overlapping gunzip 153 ms, parse 508 ms, sort 70 ms, write 1065 ms, index 335 ms: 6 candidates, 52477 repo-hours, 85 releases; waiting 534 ms; commit 650 ms)
2026-11-07T03:58:04Z [load_day 2026-09-18] 2026-09-18 hour 13: 90217 events in 2 files, snapshot 5546100555769181837 (task 3069 ms: download 1156 ms overlapping gunzip 152 ms, parse 503 ms, sort 59 ms, write 1141 ms, index 328 ms: 9 candidates, 51668 repo-hours, 127 releases; waiting 543 ms; commit 635 ms)
2026-11-07T03:58:07Z [load_day 2026-09-18] 2026-09-18 hour 14: 87567 events in 2 files, snapshot 833563100442327509 (task 2954 ms: download 1227 ms overlapping gunzip 170 ms, parse 508 ms, sort 60 ms, write 1049 ms, index 313 ms: 10 candidates, 50827 repo-hours, 125 releases; waiting 538 ms; commit 758 ms)
2026-11-07T03:58:08Z [load_day 2026-09-18] 2026-09-18 hour 15: 83530 events in 2 files, snapshot 2095980708455543478 (task 2844 ms: download 1066 ms overlapping gunzip 158 ms, parse 453 ms, sort 63 ms, write 1103 ms, index 314 ms: 4 candidates, 51051 repo-hours, 107 releases; waiting 548 ms; commit 645 ms)
2026-11-07T03:58:10Z [load_day 2026-09-18] 2026-09-18 hour 16: 76386 events in 2 files, snapshot 7862108826637639920 (task 2795 ms: download 968 ms overlapping gunzip 144 ms, parse 468 ms, sort 60 ms, write 946 ms, index 306 ms: 4 candidates, 46176 repo-hours, 101 releases; waiting 541 ms; commit 712 ms)
2026-11-07T03:58:11Z [load_day 2026-09-18] 2026-09-18 hour 17: 86714 events in 2 files, snapshot 4568014509708669318 (task 2884 ms: download 1028 ms overlapping gunzip 138 ms, parse 457 ms, sort 62 ms, write 1056 ms, index 314 ms: 7 candidates, 51469 repo-hours, 97 releases; waiting 567 ms; commit 682 ms)
2026-11-07T03:58:14Z [load_day 2026-09-18] 2026-09-18 hour 18: 90457 events in 2 files, snapshot 4552429037478767532 (task 3260 ms: download 874 ms overlapping gunzip 186 ms, parse 519 ms, sort 68 ms, write 1067 ms, index 392 ms: 5 candidates, 52360 repo-hours, 104 releases; waiting 252 ms; commit 637 ms)
2026-11-07T03:58:15Z [load_day 2026-09-18] 2026-09-18 hour 19: 92483 events in 2 files, snapshot 5353272622850664836 (task 2923 ms: download 1320 ms overlapping gunzip 152 ms, parse 508 ms, sort 66 ms, write 1046 ms, index 311 ms: 5 candidates, 49396 repo-hours, 114 releases; waiting 537 ms; commit 841 ms)
2026-11-07T03:58:18Z [load_day 2026-09-18] 2026-09-18 hour 20: 92932 events in 2 files, snapshot 3659438326645491689 (task 2702 ms: download 830 ms overlapping gunzip 155 ms, parse 498 ms, sort 63 ms, write 1124 ms, index 315 ms: 11 candidates, 48841 repo-hours, 96 releases; waiting 182 ms; commit 749 ms)
2026-11-07T03:58:19Z [load_day 2026-09-18] 2026-09-18 hour 21: 97608 events in 2 files, snapshot 7968909830970344843 (task 3011 ms: download 1225 ms overlapping gunzip 148 ms, parse 502 ms, sort 68 ms, write 1119 ms, index 293 ms: 7 candidates, 48286 repo-hours, 61 releases; waiting 548 ms; commit 831 ms)
2026-11-07T03:58:22Z [load_day 2026-09-18] 2026-09-18 hour 22: 107774 events in 3 files, snapshot 4648285572411686900 (task 3211 ms: download 1210 ms overlapping gunzip 167 ms, parse 577 ms, sort 84 ms, write 1163 ms, index 309 ms: 8 candidates, 50753 repo-hours, 64 releases; waiting 530 ms; commit 1532 ms)
2026-11-07T03:58:23Z [load_day 2026-09-18] 2026-09-18 hour 23: 106210 events in 3 files, snapshot 4442407508319003239 (task 3117 ms: download 1808 ms overlapping gunzip 160 ms, parse 577 ms, sort 70 ms, write 991 ms, index 298 ms: 6 candidates, 49308 repo-hours, 67 releases; waiting 690 ms; commit 719 ms)
2026-11-07T03:58:28Z [load_day 2026-09-18] 2026-09-18: repo_hour merged from 24 files to 1 (1159398 rows, 4953 ms)
2026-11-07T03:58:30Z [load_day 2026-09-18] 2026-09-18: index committed in 6616 ms (24 + 1 + 24 files)
2026-11-07T03:58:30Z [load_day 2026-09-18] 2026-09-18: 2256195 events in 24 hours
2026-11-07T03:58:30Z [load_day 2026-09-18] attempt 1 succeeded