orcaLog in

Runs · run 518

load_day 2026-05-29, attempt 1 succeeded

Host
4e84322b8c45:113365
Started
2026-11-07T06:10:15Z
Ended
2026-11-07T06:11:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/518/load_day/2026-05-29/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:10:15Z [load_day 2026-05-29] attempt 1 started
2026-11-07T06:10:24Z [load_day 2026-05-29] 2026-05-29 hour 0: 145553 events in 3 files, snapshot 572394220485301251 (task 5744 ms: download 1919 ms overlapping gunzip 372 ms, parse 1222 ms, sort 191 ms, write 2727 ms, index 484 ms: 10 candidates, 72155 repo-hours, 684 releases; waiting 499 ms; commit 995 ms)
2026-11-07T06:10:25Z [load_day 2026-05-29] 2026-05-29 hour 1: 148958 events in 3 files, snapshot 4725264944516394381 (task 5554 ms: download 1932 ms overlapping gunzip 301 ms, parse 1045 ms, sort 127 ms, write 2710 ms, index 485 ms: 10 candidates, 75580 repo-hours, 503 releases; waiting 559 ms; commit 1290 ms)
2026-11-07T06:10:29Z [load_day 2026-05-29] 2026-05-29 hour 2: 157702 events in 4 files, snapshot 8512896945013641124 (task 4365 ms: download 1374 ms overlapping gunzip 227 ms, parse 823 ms, sort 108 ms, write 1881 ms, index 556 ms: 7 candidates, 83107 repo-hours, 146 releases; waiting 539 ms; commit 1131 ms)
2026-11-07T06:10:30Z [load_day 2026-05-29] 2026-05-29 hour 3: 157620 events in 4 files, snapshot 946349767644400487 (task 4376 ms: download 1667 ms overlapping gunzip 238 ms, parse 825 ms, sort 119 ms, write 1815 ms, index 523 ms: 11 candidates, 81877 repo-hours, 217 releases; waiting 575 ms; commit 1037 ms)
2026-11-07T06:10:34Z [load_day 2026-05-29] 2026-05-29 hour 4: 151133 events in 4 files, snapshot 6741821700315802049 (task 4280 ms: download 1356 ms overlapping gunzip 244 ms, parse 863 ms, sort 106 ms, write 1831 ms, index 499 ms: 6 candidates, 77748 repo-hours, 258 releases; waiting 515 ms; commit 1070 ms)
2026-11-07T06:10:36Z [load_day 2026-05-29] 2026-05-29 hour 5: 153033 events in 4 files, snapshot 5867661259547839326 (task 4409 ms: download 1439 ms overlapping gunzip 277 ms, parse 937 ms, sort 118 ms, write 1841 ms, index 468 ms: 8 candidates, 73494 repo-hours, 350 releases; waiting 534 ms; commit 1135 ms)
2026-11-07T06:10:39Z [load_day 2026-05-29] 2026-05-29 hour 6: 159872 events in 4 files, snapshot 7812483801050913314 (task 4140 ms: download 1521 ms overlapping gunzip 225 ms, parse 788 ms, sort 109 ms, write 1606 ms, index 553 ms: 10 candidates, 80827 repo-hours, 121 releases; waiting 523 ms; commit 1296 ms)
2026-11-07T06:10:42Z [load_day 2026-05-29] 2026-05-29 hour 7: 157723 events in 4 files, snapshot 7731722882550496429 (task 3993 ms: download 1344 ms overlapping gunzip 209 ms, parse 762 ms, sort 97 ms, write 1575 ms, index 535 ms: 6 candidates, 82877 repo-hours, 95 releases; waiting 538 ms; commit 2835 ms)
2026-11-07T06:10:44Z [load_day 2026-05-29] 2026-05-29 hour 8: 155786 events in 4 files, snapshot 513730440535824728 (task 4077 ms: download 1219 ms overlapping gunzip 235 ms, parse 875 ms, sort 125 ms, write 1548 ms, index 547 ms: 7 candidates, 81621 repo-hours, 99 releases; waiting 529 ms; commit 885 ms)
2026-11-07T06:10:45Z [load_day 2026-05-29] 2026-05-29 hour 9: 156673 events in 4 files, snapshot 1473189069905226975 (task 3976 ms: download 1281 ms overlapping gunzip 205 ms, parse 760 ms, sort 111 ms, write 1526 ms, index 538 ms: 6 candidates, 85624 repo-hours, 76 releases; waiting 555 ms; commit 1065 ms)
2026-11-07T06:10:48Z [load_day 2026-05-29] 2026-05-29 hour 10: 156798 events in 4 files, snapshot 2334176558610038920 (task 3836 ms: download 696 ms overlapping gunzip 208 ms, parse 784 ms, sort 116 ms, write 1656 ms, index 530 ms: 11 candidates, 82797 repo-hours, 78 releases; waiting 200 ms; commit 1069 ms)
2026-11-07T06:10:50Z [load_day 2026-05-29] 2026-05-29 hour 11: 155741 events in 4 files, snapshot 8409212944429170261 (task 3960 ms: download 1263 ms overlapping gunzip 222 ms, parse 798 ms, sort 99 ms, write 1604 ms, index 603 ms: 6 candidates, 81194 repo-hours, 114 releases; waiting 374 ms; commit 1083 ms)
2026-11-07T06:10:53Z [load_day 2026-05-29] 2026-05-29 hour 12: 153781 events in 4 files, snapshot 1506947071399022813 (task 4069 ms: download 1281 ms overlapping gunzip 217 ms, parse 787 ms, sort 114 ms, write 1551 ms, index 535 ms: 6 candidates, 82074 repo-hours, 79 releases; waiting 556 ms; commit 1140 ms)
2026-11-07T06:10:55Z [load_day 2026-05-29] 2026-05-29 hour 13: 153455 events in 4 files, snapshot 5295288738474174073 (task 4147 ms: download 1234 ms overlapping gunzip 204 ms, parse 732 ms, sort 101 ms, write 1816 ms, index 525 ms: 4 candidates, 80362 repo-hours, 64 releases; waiting 539 ms; commit 1115 ms)
2026-11-07T06:10:58Z [load_day 2026-05-29] 2026-05-29 hour 14: 155169 events in 4 files, snapshot 8251218830386213722 (task 4118 ms: download 1151 ms overlapping gunzip 198 ms, parse 752 ms, sort 105 ms, write 1515 ms, index 699 ms: 6 candidates, 87468 repo-hours, 57 releases; waiting 520 ms; commit 1056 ms)
2026-11-07T06:11:00Z [load_day 2026-05-29] 2026-05-29 hour 15: 155601 events in 4 files, snapshot 3679379583531087446 (task 4320 ms: download 1281 ms overlapping gunzip 201 ms, parse 740 ms, sort 103 ms, write 1388 ms, index 591 ms: 6 candidates, 88108 repo-hours, 55 releases; waiting 530 ms; commit 1201 ms)
2026-11-07T06:11:03Z [load_day 2026-05-29] 2026-05-29 hour 16: 153049 events in 4 files, snapshot 1167154071983551350 (task 3848 ms: download 1389 ms overlapping gunzip 197 ms, parse 746 ms, sort 118 ms, write 1408 ms, index 572 ms: 8 candidates, 82503 repo-hours, 52 releases; waiting 538 ms; commit 1215 ms)
2026-11-07T06:11:05Z [load_day 2026-05-29] 2026-05-29 hour 17: 152095 events in 4 files, snapshot 280987156520864113 (task 3757 ms: download 1383 ms overlapping gunzip 201 ms, parse 753 ms, sort 110 ms, write 1396 ms, index 540 ms: 4 candidates, 76594 repo-hours, 92 releases; waiting 551 ms; commit 1216 ms)
2026-11-07T06:11:08Z [load_day 2026-05-29] 2026-05-29 hour 18: 153061 events in 4 files, snapshot 5994582991162654253 (task 4209 ms: download 1454 ms overlapping gunzip 220 ms, parse 808 ms, sort 113 ms, write 1643 ms, index 524 ms: 7 candidates, 78120 repo-hours, 105 releases; waiting 536 ms; commit 1190 ms)
2026-11-07T06:11:09Z [load_day 2026-05-29] 2026-05-29 hour 19: 156757 events in 4 files, snapshot 6900130002825470396 (task 3940 ms: download 1232 ms overlapping gunzip 232 ms, parse 834 ms, sort 114 ms, write 1524 ms, index 509 ms: 10 candidates, 78445 repo-hours, 148 releases; waiting 470 ms; commit 1147 ms)
2026-11-07T06:11:13Z [load_day 2026-05-29] 2026-05-29 hour 20: 157008 events in 4 files, snapshot 2322343616063201057 (task 4127 ms: download 1658 ms overlapping gunzip 221 ms, parse 799 ms, sort 110 ms, write 1620 ms, index 534 ms: 5 candidates, 78004 repo-hours, 121 releases; waiting 522 ms; commit 1042 ms)
2026-11-07T06:11:15Z [load_day 2026-05-29] 2026-05-29 hour 21: 154344 events in 4 files, snapshot 4623201817171307660 (task 4310 ms: download 1514 ms overlapping gunzip 254 ms, parse 888 ms, sort 118 ms, write 1649 ms, index 502 ms: 12 candidates, 76377 repo-hours, 275 releases; waiting 550 ms; commit 1170 ms)
2026-11-07T06:11:18Z [load_day 2026-05-29] 2026-05-29 hour 22: 151241 events in 4 files, snapshot 738798313352635917 (task 4831 ms: download 1838 ms overlapping gunzip 310 ms, parse 1132 ms, sort 153 ms, write 1932 ms, index 486 ms: 3 candidates, 70253 repo-hours, 355 releases; waiting 528 ms; commit 960 ms)
2026-11-07T06:11:20Z [load_day 2026-05-29] 2026-05-29 hour 23: 149254 events in 3 files, snapshot 349074036963976956 (task 4951 ms: download 1659 ms overlapping gunzip 315 ms, parse 1106 ms, sort 127 ms, write 2097 ms, index 430 ms: 6 candidates, 67699 repo-hours, 650 releases; waiting 552 ms; commit 1024 ms)
2026-11-07T06:11:28Z [load_day 2026-05-29] 2026-05-29: repo_hour merged from 24 files to 1 (1904908 rows, 7571 ms)
2026-11-07T06:11:30Z [load_day 2026-05-29] 2026-05-29: index committed in 9408 ms (24 + 1 + 24 files)
2026-11-07T06:11:30Z [load_day 2026-05-29] 2026-05-29: 3701407 events in 24 hours
2026-11-07T06:11:30Z [load_day 2026-05-29] attempt 1 succeeded