orcaLog in

Runs · run 660

load_day 2026-04-12, attempt 1 succeeded

Host
4e84322b8c45:161763
Started
2026-11-07T12:56:51Z
Ended
2026-11-07T12:58:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/660/load_day/2026-04-12/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T12:56:51Z [load_day 2026-04-12] attempt 1 started
2026-11-07T12:57:00Z [load_day 2026-04-12] 2026-04-12 hour 0: 141232 events in 3 files, snapshot 7335733739166720926 (task 6264 ms: download 2453 ms overlapping gunzip 345 ms, parse 1213 ms, sort 171 ms, write 3141 ms, index 440 ms: 10 candidates, 65043 repo-hours, 992 releases; waiting 564 ms; commit 1226 ms)
2026-11-07T12:57:01Z [load_day 2026-04-12] 2026-04-12 hour 1: 145263 events in 3 files, snapshot 4707641630215382989 (task 6493 ms: download 2094 ms overlapping gunzip 359 ms, parse 1324 ms, sort 178 ms, write 3225 ms, index 500 ms: 10 candidates, 77010 repo-hours, 810 releases; waiting 536 ms; commit 1023 ms)
2026-11-07T12:57:10Z [load_day 2026-04-12] 2026-04-12 hour 2: 148453 events in 3 files, snapshot 473855451683281603 (task 9001 ms: download 2974 ms overlapping gunzip 700 ms, parse 2520 ms, sort 264 ms, write 3903 ms, index 558 ms: 10 candidates, 77984 repo-hours, 719 releases; waiting 686 ms; commit 1213 ms)
2026-11-07T12:57:11Z [load_day 2026-04-12] 2026-04-12 hour 3: 146856 events in 3 files, snapshot 4203429314681827080 (task 8121 ms: download 2324 ms overlapping gunzip 703 ms, parse 2456 ms, sort 235 ms, write 3679 ms, index 456 ms: 3 candidates, 71373 repo-hours, 777 releases; waiting 290 ms; commit 1245 ms)
2026-11-07T12:57:19Z [load_day 2026-04-12] 2026-04-12 hour 4: 144731 events in 3 files, snapshot 3847236318757255134 (task 7835 ms: download 2249 ms overlapping gunzip 556 ms, parse 1933 ms, sort 247 ms, write 3622 ms, index 578 ms: 6 candidates, 62265 repo-hours, 866 releases; waiting 533 ms; commit 1059 ms)
2026-11-07T12:57:20Z [load_day 2026-04-12] 2026-04-12 hour 5: 152111 events in 4 files, snapshot 388858183752574002 (task 7256 ms: download 2201 ms overlapping gunzip 592 ms, parse 2131 ms, sort 203 ms, write 2938 ms, index 466 ms: 8 candidates, 67820 repo-hours, 1022 releases; waiting 602 ms; commit 1126 ms)
2026-11-07T12:57:27Z [load_day 2026-04-12] 2026-04-12 hour 6: 149466 events in 3 files, snapshot 8923442674716591321 (task 7695 ms: download 2530 ms overlapping gunzip 556 ms, parse 2008 ms, sort 251 ms, write 3412 ms, index 519 ms: 12 candidates, 68465 repo-hours, 795 releases; waiting 622 ms; commit 1178 ms)
2026-11-07T12:57:28Z [load_day 2026-04-12] 2026-04-12 hour 7: 150621 events in 4 files, snapshot 9216089385349995649 (task 6324 ms: download 2335 ms overlapping gunzip 485 ms, parse 1599 ms, sort 188 ms, write 2735 ms, index 509 ms: 6 candidates, 74522 repo-hours, 1115 releases; waiting 539 ms; commit 1027 ms)
2026-11-07T12:57:36Z [load_day 2026-04-12] 2026-04-12 hour 8: 155786 events in 4 files, snapshot 5773629475914861244 (task 7788 ms: download 3164 ms overlapping gunzip 493 ms, parse 1768 ms, sort 195 ms, write 3849 ms, index 555 ms: 8 candidates, 73923 repo-hours, 783 releases; waiting 630 ms; commit 1101 ms)
2026-11-07T12:57:37Z [load_day 2026-04-12] 2026-04-12 hour 9: 151680 events in 4 files, snapshot 5984214755752215679 (task 8166 ms: download 2914 ms overlapping gunzip 572 ms, parse 2044 ms, sort 222 ms, write 4011 ms, index 474 ms: 6 candidates, 72295 repo-hours, 1041 releases; waiting 544 ms; commit 992 ms)
2026-11-07T12:57:43Z [load_day 2026-04-12] 2026-04-12 hour 10: 154639 events in 4 files, snapshot 8034220942126312857 (task 6339 ms: download 1902 ms overlapping gunzip 419 ms, parse 1462 ms, sort 169 ms, write 2928 ms, index 534 ms: 6 candidates, 74992 repo-hours, 978 releases; waiting 561 ms; commit 1217 ms)
2026-11-07T12:57:44Z [load_day 2026-04-12] 2026-04-12 hour 11: 154851 events in 4 files, snapshot 1189709370057285653 (task 6603 ms: download 2825 ms overlapping gunzip 427 ms, parse 1468 ms, sort 183 ms, write 2937 ms, index 547 ms: 4 candidates, 77455 repo-hours, 805 releases; waiting 712 ms; commit 1285 ms)
2026-11-07T12:57:49Z [load_day 2026-04-12] 2026-04-12 hour 12: 153166 events in 4 files, snapshot 1397250238854376706 (task 6092 ms: download 1493 ms overlapping gunzip 413 ms, parse 1433 ms, sort 182 ms, write 2983 ms, index 607 ms: 9 candidates, 83324 repo-hours, 839 releases; waiting 182 ms; commit 1166 ms)
2026-11-07T12:57:52Z [load_day 2026-04-12] 2026-04-12 hour 13: 161665 events in 4 files, snapshot 7459937565981491880 (task 6851 ms: download 2343 ms overlapping gunzip 476 ms, parse 1636 ms, sort 178 ms, write 2980 ms, index 592 ms: 12 candidates, 90790 repo-hours, 841 releases; waiting 681 ms; commit 1453 ms)
2026-11-07T12:57:57Z [load_day 2026-04-12] 2026-04-12 hour 14: 159078 events in 4 files, snapshot 3355160849763568923 (task 6780 ms: download 1918 ms overlapping gunzip 469 ms, parse 1669 ms, sort 166 ms, write 3088 ms, index 611 ms: 10 candidates, 82701 repo-hours, 862 releases; waiting 542 ms; commit 1184 ms)
2026-11-07T12:58:00Z [load_day 2026-04-12] 2026-04-12 hour 15: 158395 events in 4 files, snapshot 8977664843737722108 (task 7540 ms: download 2071 ms overlapping gunzip 576 ms, parse 1999 ms, sort 206 ms, write 3248 ms, index 675 ms: 9 candidates, 79589 repo-hours, 918 releases; waiting 510 ms; commit 1343 ms)
2026-11-07T12:58:05Z [load_day 2026-04-12] 2026-04-12 hour 16: 153222 events in 4 files, snapshot 833858840685557627 (task 6938 ms: download 2215 ms overlapping gunzip 492 ms, parse 1740 ms, sort 246 ms, write 3079 ms, index 554 ms: 11 candidates, 77566 repo-hours, 849 releases; waiting 542 ms; commit 1178 ms)
2026-11-07T12:58:09Z [load_day 2026-04-12] 2026-04-12 hour 17: 156807 events in 4 files, snapshot 2914866930685779101 (task 7621 ms: download 2278 ms overlapping gunzip 528 ms, parse 1768 ms, sort 205 ms, write 3698 ms, index 583 ms: 5 candidates, 80035 repo-hours, 713 releases; waiting 557 ms; commit 1286 ms)
2026-11-07T12:58:12Z [load_day 2026-04-12] 2026-04-12 hour 18: 159608 events in 4 files, snapshot 8545836759204650548 (task 6674 ms: download 2148 ms overlapping gunzip 487 ms, parse 1616 ms, sort 160 ms, write 2950 ms, index 555 ms: 8 candidates, 81469 repo-hours, 915 releases; waiting 535 ms; commit 1406 ms)
2026-11-07T12:58:16Z [load_day 2026-04-12] 2026-04-12 hour 19: 152987 events in 4 files, snapshot 6332871409541110706 (task 6531 ms: download 1856 ms overlapping gunzip 480 ms, parse 1587 ms, sort 157 ms, write 3026 ms, index 555 ms: 10 candidates, 73043 repo-hours, 828 releases; waiting 355 ms; commit 1077 ms)
2026-11-07T12:58:20Z [load_day 2026-04-12] 2026-04-12 hour 20: 154120 events in 4 files, snapshot 993222369283082699 (task 6633 ms: download 2210 ms overlapping gunzip 464 ms, parse 1591 ms, sort 189 ms, write 2999 ms, index 500 ms: 7 candidates, 74047 repo-hours, 839 releases; waiting 561 ms; commit 1368 ms)
2026-11-07T12:58:23Z [load_day 2026-04-12] 2026-04-12 hour 21: 152484 events in 4 files, snapshot 1002939436261306440 (task 6506 ms: download 2092 ms overlapping gunzip 452 ms, parse 1482 ms, sort 162 ms, write 3029 ms, index 565 ms: 8 candidates, 68461 repo-hours, 888 releases; waiting 537 ms; commit 1258 ms)
2026-11-07T12:58:26Z [load_day 2026-04-12] 2026-04-12 hour 22: 148895 events in 3 files, snapshot 1475549408396250666 (task 5838 ms: download 1897 ms overlapping gunzip 434 ms, parse 1442 ms, sort 150 ms, write 2562 ms, index 489 ms: 10 candidates, 67219 repo-hours, 831 releases; waiting 526 ms; commit 1282 ms)
2026-11-07T12:58:30Z [load_day 2026-04-12] 2026-04-12 hour 23: 150025 events in 4 files, snapshot 1912801930508745667 (task 5949 ms: download 2289 ms overlapping gunzip 427 ms, parse 1429 ms, sort 235 ms, write 2543 ms, index 461 ms: 7 candidates, 68061 repo-hours, 798 releases; waiting 543 ms; commit 1200 ms)
2026-11-07T12:58:37Z [load_day 2026-04-12] 2026-04-12: repo_hour merged from 24 files to 1 (1789452 rows, 7508 ms)
2026-11-07T12:58:39Z [load_day 2026-04-12] 2026-04-12: index committed in 9560 ms (24 + 1 + 24 files)
2026-11-07T12:58:39Z [load_day 2026-04-12] 2026-04-12: 3656141 events in 24 hours
2026-11-07T12:58:39Z [load_day 2026-04-12] attempt 1 succeeded