orcaLog in

Runs · run 5013

load_day 2026-03-07, attempt 1 succeeded

Host
73ccef5e07c2:452569
Started
2026-11-08T15:30:54Z
Ended
2026-11-08T15:31:59Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
702 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
77.1 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/5013/load_day/2026-03-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:30:54Z [load_day 2026-03-07] attempt 1 started
2026-11-08T15:30:55Z [load_day 2026-03-07] 2026-03-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:30:59Z [load_day 2026-03-07] 2026-03-07 hour 0: 149788 events in 0 files, snapshot none (task 3882 ms: download 1798 ms overlapping gunzip 678 ms, parse 2076 ms, sort 0 ms, write 0 ms, index 646 ms: 6 candidates, 73467 repo-hours, 1044 releases; waiting 169 ms; commit 0 ms)
2026-11-08T15:30:59Z [load_day 2026-03-07] 2026-03-07 hour 1: 156431 events in 0 files, snapshot none (task 3860 ms: download 2392 ms overlapping gunzip 624 ms, parse 1853 ms, sort 0 ms, write 0 ms, index 720 ms: 10 candidates, 88551 repo-hours, 821 releases; waiting 356 ms; commit 0 ms)
2026-11-08T15:31:03Z [load_day 2026-03-07] 2026-03-07 hour 2: 152284 events in 0 files, snapshot none (task 3627 ms: download 2582 ms overlapping gunzip 409 ms, parse 1229 ms, sort 0 ms, write 0 ms, index 598 ms: 4 candidates, 82826 repo-hours, 811 releases; waiting 1110 ms; commit 0 ms)
2026-11-08T15:31:03Z [load_day 2026-03-07] 2026-03-07 hour 3: 152272 events in 0 files, snapshot none (task 3313 ms: download 1868 ms overlapping gunzip 426 ms, parse 1282 ms, sort 0 ms, write 0 ms, index 617 ms: 11 candidates, 72173 repo-hours, 1041 releases; waiting 630 ms; commit 0 ms)
2026-11-08T15:31:08Z [load_day 2026-03-07] 2026-03-07 hour 4: 149064 events in 0 files, snapshot none (task 4038 ms: download 2629 ms overlapping gunzip 414 ms, parse 1251 ms, sort 0 ms, write 0 ms, index 551 ms: 2 candidates, 73819 repo-hours, 1079 releases; waiting 1593 ms; commit 0 ms)
2026-11-08T15:31:08Z [load_day 2026-03-07] 2026-03-07 hour 5: 150502 events in 0 files, snapshot none (task 4288 ms: download 3272 ms overlapping gunzip 437 ms, parse 1305 ms, sort 0 ms, write 0 ms, index 570 ms: 4 candidates, 74032 repo-hours, 894 releases; waiting 1623 ms; commit 0 ms)
2026-11-08T15:31:12Z [load_day 2026-03-07] 2026-03-07 hour 6: 150639 events in 0 files, snapshot none (task 3172 ms: download 1984 ms overlapping gunzip 369 ms, parse 1141 ms, sort 0 ms, write 0 ms, index 544 ms: 7 candidates, 75950 repo-hours, 1000 releases; waiting 740 ms; commit 0 ms)
2026-11-08T15:31:12Z [load_day 2026-03-07] 2026-03-07 hour 7: 151830 events in 0 files, snapshot none (task 3612 ms: download 2478 ms overlapping gunzip 386 ms, parse 1153 ms, sort 0 ms, write 0 ms, index 605 ms: 4 candidates, 75664 repo-hours, 932 releases; waiting 1142 ms; commit 0 ms)
2026-11-08T15:31:16Z [load_day 2026-03-07] 2026-03-07 hour 8: 155550 events in 0 files, snapshot none (task 4017 ms: download 2564 ms overlapping gunzip 439 ms, parse 1272 ms, sort 0 ms, write 0 ms, index 793 ms: 11 candidates, 78013 repo-hours, 947 releases; waiting 1179 ms; commit 0 ms)
2026-11-08T15:31:16Z [load_day 2026-03-07] 2026-03-07 hour 9: 152435 events in 0 files, snapshot none (task 3689 ms: download 2189 ms overlapping gunzip 433 ms, parse 1298 ms, sort 0 ms, write 0 ms, index 707 ms: 9 candidates, 78278 repo-hours, 976 releases; waiting 882 ms; commit 0 ms)
2026-11-08T15:31:20Z [load_day 2026-03-07] 2026-03-07 hour 10: 153336 events in 0 files, snapshot none (task 3272 ms: download 1675 ms overlapping gunzip 535 ms, parse 1595 ms, sort 0 ms, write 0 ms, index 596 ms: 6 candidates, 76903 repo-hours, 874 releases; waiting 240 ms; commit 0 ms)
2026-11-08T15:31:21Z [load_day 2026-03-07] 2026-03-07 hour 11: 156096 events in 0 files, snapshot none (task 4295 ms: download 3022 ms overlapping gunzip 459 ms, parse 1394 ms, sort 0 ms, write 0 ms, index 694 ms: 11 candidates, 76551 repo-hours, 863 releases; waiting 1440 ms; commit 0 ms)
2026-11-08T15:31:24Z [load_day 2026-03-07] 2026-03-07 hour 12: 160161 events in 0 files, snapshot none (task 3348 ms: download 1947 ms overlapping gunzip 362 ms, parse 1172 ms, sort 0 ms, write 0 ms, index 749 ms: 5 candidates, 96079 repo-hours, 606 releases; waiting 740 ms; commit 0 ms)
2026-11-08T15:31:25Z [load_day 2026-03-07] 2026-03-07 hour 13: 163946 events in 0 files, snapshot none (task 3161 ms: download 1867 ms overlapping gunzip 342 ms, parse 1093 ms, sort 0 ms, write 0 ms, index 745 ms: 8 candidates, 94006 repo-hours, 658 releases; waiting 680 ms; commit 0 ms)
2026-11-08T15:31:29Z [load_day 2026-03-07] 2026-03-07 hour 14: 159130 events in 0 files, snapshot none (task 4610 ms: download 2430 ms overlapping gunzip 400 ms, parse 1206 ms, sort 0 ms, write 0 ms, index 966 ms: 10 candidates, 83732 repo-hours, 722 releases; waiting 1376 ms; commit 0 ms)
2026-11-08T15:31:30Z [load_day 2026-03-07] 2026-03-07 hour 15: 162035 events in 0 files, snapshot none (task 4286 ms: download 2602 ms overlapping gunzip 449 ms, parse 1340 ms, sort 0 ms, write 0 ms, index 744 ms: 10 candidates, 82361 repo-hours, 777 releases; waiting 1506 ms; commit 0 ms)
2026-11-08T15:31:33Z [load_day 2026-03-07] 2026-03-07 hour 16: 158760 events in 0 files, snapshot none (task 2931 ms: download 1758 ms overlapping gunzip 360 ms, parse 1169 ms, sort 0 ms, write 0 ms, index 650 ms: 10 candidates, 83351 repo-hours, 693 releases; waiting 457 ms; commit 0 ms)
2026-11-08T15:31:34Z [load_day 2026-03-07] 2026-03-07 hour 17: 161484 events in 0 files, snapshot none (task 3110 ms: download 2138 ms overlapping gunzip 390 ms, parse 1196 ms, sort 0 ms, write 0 ms, index 613 ms: 10 candidates, 83483 repo-hours, 637 releases; waiting 627 ms; commit 0 ms)
2026-11-08T15:31:37Z [load_day 2026-03-07] 2026-03-07 hour 18: 162370 events in 0 files, snapshot none (task 3493 ms: download 2353 ms overlapping gunzip 483 ms, parse 1467 ms, sort 0 ms, write 0 ms, index 667 ms: 11 candidates, 86283 repo-hours, 725 releases; waiting 595 ms; commit 0 ms)
2026-11-08T15:31:39Z [load_day 2026-03-07] 2026-03-07 hour 19: 153734 events in 0 files, snapshot none (task 5074 ms: download 2851 ms overlapping gunzip 468 ms, parse 1266 ms, sort 0 ms, write 0 ms, index 980 ms: 7 candidates, 77122 repo-hours, 789 releases; waiting 1823 ms; commit 0 ms)
2026-11-08T15:31:41Z [load_day 2026-03-07] 2026-03-07 hour 20: 154902 events in 0 files, snapshot none (task 3709 ms: download 2399 ms overlapping gunzip 528 ms, parse 1667 ms, sort 0 ms, write 0 ms, index 588 ms: 8 candidates, 74823 repo-hours, 909 releases; waiting 608 ms; commit 0 ms)
2026-11-08T15:31:44Z [load_day 2026-03-07] 2026-03-07 hour 21: 154289 events in 0 files, snapshot none (task 3609 ms: download 2054 ms overlapping gunzip 460 ms, parse 1393 ms, sort 0 ms, write 0 ms, index 909 ms: 12 candidates, 72105 repo-hours, 1026 releases; waiting 523 ms; commit 0 ms)
2026-11-08T15:31:45Z [load_day 2026-03-07] 2026-03-07 hour 22: 146320 events in 0 files, snapshot none (task 3559 ms: download 2268 ms overlapping gunzip 545 ms, parse 1648 ms, sort 0 ms, write 0 ms, index 529 ms: 8 candidates, 68274 repo-hours, 1087 releases; waiting 547 ms; commit 0 ms)
2026-11-08T15:31:48Z [load_day 2026-03-07] 2026-03-07 hour 23: 149474 events in 0 files, snapshot none (task 3657 ms: download 2521 ms overlapping gunzip 439 ms, parse 1506 ms, sort 0 ms, write 0 ms, index 572 ms: 20 candidates, 68121 repo-hours, 1088 releases; waiting 864 ms; commit 0 ms)
2026-11-08T15:31:56Z [load_day 2026-03-07] 2026-03-07: repo_hour merged from 24 files to 1 (1895967 rows, 8010 ms)
2026-11-08T15:31:59Z [load_day 2026-03-07] 2026-03-07: index committed in 10799 ms (24 + 1 + 24 files)
2026-11-08T15:31:59Z [load_day 2026-03-07] 2026-03-07: 3716832 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:31:59Z [load_day 2026-03-07] attempt 1 succeeded