orcaLog in

Runs · run 3855

load_day 2025-05-03, attempt 1 succeeded

Host
73ccef5e07c2:297890
Started
2026-11-08T11:44:31Z
Ended
2026-11-08T11:46:11Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
701 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
137.6 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3855/load_day/2025-05-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:44:31Z [load_day 2025-05-03] attempt 1 started
2026-11-08T11:44:32Z [load_day 2025-05-03] 2025-05-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:44:39Z [load_day 2025-05-03] 2025-05-03 hour 0: 158714 events in 0 files, snapshot none (task 5938 ms: download 3182 ms overlapping gunzip 879 ms, parse 3559 ms, sort 0 ms, write 0 ms, index 623 ms: 7 candidates, 75653 repo-hours, 1103 releases; waiting 517 ms; commit 0 ms)
2026-11-08T11:44:39Z [load_day 2025-05-03] 2025-05-03 hour 1: 174126 events in 0 files, snapshot none (task 6126 ms: download 3326 ms overlapping gunzip 874 ms, parse 3890 ms, sort 0 ms, write 0 ms, index 734 ms: 7 candidates, 96398 repo-hours, 792 releases; waiting 233 ms; commit 0 ms)
2026-11-08T11:44:46Z [load_day 2025-05-03] 2025-05-03 hour 2: 143843 events in 0 files, snapshot none (task 6570 ms: download 3799 ms overlapping gunzip 1012 ms, parse 4063 ms, sort 0 ms, write 0 ms, index 511 ms: 7 candidates, 61108 repo-hours, 711 releases; waiting 612 ms; commit 0 ms)
2026-11-08T11:44:46Z [load_day 2025-05-03] 2025-05-03 hour 3: 152114 events in 0 files, snapshot none (task 5655 ms: download 3032 ms overlapping gunzip 811 ms, parse 3813 ms, sort 0 ms, write 0 ms, index 505 ms: 3 candidates, 61690 repo-hours, 2507 releases; waiting 182 ms; commit 0 ms)
2026-11-08T11:44:52Z [load_day 2025-05-03] 2025-05-03 hour 4: 146096 events in 0 files, snapshot none (task 5458 ms: download 2434 ms overlapping gunzip 824 ms, parse 3389 ms, sort 0 ms, write 0 ms, index 577 ms: 7 candidates, 55497 repo-hours, 593 releases; waiting 319 ms; commit 0 ms)
2026-11-08T11:44:53Z [load_day 2025-05-03] 2025-05-03 hour 5: 163397 events in 0 files, snapshot none (task 6255 ms: download 3282 ms overlapping gunzip 968 ms, parse 3939 ms, sort 0 ms, write 0 ms, index 613 ms: 7 candidates, 61523 repo-hours, 692 releases; waiting 488 ms; commit 0 ms)
2026-11-08T11:44:59Z [load_day 2025-05-03] 2025-05-03 hour 6: 190461 events in 0 files, snapshot none (task 6436 ms: download 3311 ms overlapping gunzip 804 ms, parse 3568 ms, sort 0 ms, write 0 ms, index 1230 ms: 6 candidates, 78240 repo-hours, 1064 releases; waiting 545 ms; commit 0 ms)
2026-11-08T11:45:00Z [load_day 2025-05-03] 2025-05-03 hour 7: 185732 events in 0 files, snapshot none (task 6492 ms: download 3255 ms overlapping gunzip 943 ms, parse 3698 ms, sort 0 ms, write 0 ms, index 1011 ms: 6 candidates, 68125 repo-hours, 638 releases; waiting 494 ms; commit 0 ms)
2026-11-08T11:45:06Z [load_day 2025-05-03] 2025-05-03 hour 8: 187245 events in 0 files, snapshot none (task 6328 ms: download 3593 ms overlapping gunzip 890 ms, parse 4029 ms, sort 0 ms, write 0 ms, index 580 ms: 4 candidates, 74201 repo-hours, 747 releases; waiting 499 ms; commit 0 ms)
2026-11-08T11:45:07Z [load_day 2025-05-03] 2025-05-03 hour 9: 194426 events in 0 files, snapshot none (task 6309 ms: download 3637 ms overlapping gunzip 860 ms, parse 3796 ms, sort 0 ms, write 0 ms, index 641 ms: 6 candidates, 76602 repo-hours, 916 releases; waiting 667 ms; commit 0 ms)
2026-11-08T11:45:13Z [load_day 2025-05-03] 2025-05-03 hour 10: 192426 events in 0 files, snapshot none (task 6615 ms: download 3582 ms overlapping gunzip 930 ms, parse 3961 ms, sort 0 ms, write 0 ms, index 619 ms: 9 candidates, 75294 repo-hours, 747 releases; waiting 561 ms; commit 0 ms)
2026-11-08T11:45:14Z [load_day 2025-05-03] 2025-05-03 hour 11: 197543 events in 0 files, snapshot none (task 6570 ms: download 4049 ms overlapping gunzip 996 ms, parse 4174 ms, sort 0 ms, write 0 ms, index 571 ms: 11 candidates, 74915 repo-hours, 753 releases; waiting 504 ms; commit 0 ms)
2026-11-08T11:45:19Z [load_day 2025-05-03] 2025-05-03 hour 12: 248536 events in 0 files, snapshot none (task 5782 ms: download 2993 ms overlapping gunzip 779 ms, parse 3459 ms, sort 0 ms, write 0 ms, index 931 ms: 10 candidates, 123946 repo-hours, 1297 releases; waiting 330 ms; commit 0 ms)
2026-11-08T11:45:21Z [load_day 2025-05-03] 2025-05-03 hour 13: 226157 events in 0 files, snapshot none (task 6991 ms: download 4317 ms overlapping gunzip 792 ms, parse 3534 ms, sort 0 ms, write 0 ms, index 794 ms: 9 candidates, 105642 repo-hours, 817 releases; waiting 1591 ms; commit 0 ms)
2026-11-08T11:45:25Z [load_day 2025-05-03] 2025-05-03 hour 14: 211611 events in 0 files, snapshot none (task 5631 ms: download 3116 ms overlapping gunzip 770 ms, parse 3320 ms, sort 0 ms, write 0 ms, index 665 ms: 5 candidates, 84314 repo-hours, 908 releases; waiting 562 ms; commit 0 ms)
2026-11-08T11:45:27Z [load_day 2025-05-03] 2025-05-03 hour 15: 221407 events in 0 files, snapshot none (task 5756 ms: download 3475 ms overlapping gunzip 791 ms, parse 3479 ms, sort 0 ms, write 0 ms, index 687 ms: 3 candidates, 91437 repo-hours, 1101 releases; waiting 537 ms; commit 0 ms)
2026-11-08T11:45:34Z [load_day 2025-05-03] 2025-05-03 hour 16: 210802 events in 0 files, snapshot none (task 8727 ms: download 3104 ms overlapping gunzip 1031 ms, parse 4470 ms, sort 0 ms, write 0 ms, index 2517 ms: 4 candidates, 84594 repo-hours, 958 releases; waiting 392 ms; commit 0 ms)
2026-11-08T11:45:38Z [load_day 2025-05-03] 2025-05-03 hour 17: 209581 events in 0 files, snapshot none (task 9625 ms: download 4477 ms overlapping gunzip 1036 ms, parse 4471 ms, sort 0 ms, write 0 ms, index 3167 ms: 3 candidates, 79836 repo-hours, 926 releases; waiting 669 ms; commit 0 ms)
2026-11-08T11:45:46Z [load_day 2025-05-03] 2025-05-03 hour 18: 219002 events in 0 files, snapshot none (task 7847 ms: download 5044 ms overlapping gunzip 1208 ms, parse 5076 ms, sort 0 ms, write 0 ms, index 673 ms: 7 candidates, 95783 repo-hours, 1010 releases; waiting 553 ms; commit 0 ms)
2026-11-08T11:45:46Z [load_day 2025-05-03] 2025-05-03 hour 19: 196726 events in 0 files, snapshot none (task 7033 ms: download 4378 ms overlapping gunzip 1103 ms, parse 4630 ms, sort 0 ms, write 0 ms, index 525 ms: 3 candidates, 71645 repo-hours, 868 releases; waiting 548 ms; commit 0 ms)
2026-11-08T11:45:53Z [load_day 2025-05-03] 2025-05-03 hour 20: 189905 events in 0 files, snapshot none (task 6604 ms: download 3878 ms overlapping gunzip 948 ms, parse 4197 ms, sort 0 ms, write 0 ms, index 622 ms: 8 candidates, 70661 repo-hours, 879 releases; waiting 515 ms; commit 0 ms)
2026-11-08T11:45:53Z [load_day 2025-05-03] 2025-05-03 hour 21: 182211 events in 0 files, snapshot none (task 6138 ms: download 3658 ms overlapping gunzip 904 ms, parse 3899 ms, sort 0 ms, write 0 ms, index 509 ms: 5 candidates, 67315 repo-hours, 939 releases; waiting 511 ms; commit 0 ms)
2026-11-08T11:46:00Z [load_day 2025-05-03] 2025-05-03 hour 22: 169632 events in 0 files, snapshot none (task 5797 ms: download 3157 ms overlapping gunzip 897 ms, parse 3706 ms, sort 0 ms, write 0 ms, index 478 ms: 7 candidates, 62160 repo-hours, 855 releases; waiting 475 ms; commit 0 ms)
2026-11-08T11:46:00Z [load_day 2025-05-03] 2025-05-03 hour 23: 158290 events in 0 files, snapshot none (task 5832 ms: download 3279 ms overlapping gunzip 851 ms, parse 3704 ms, sort 0 ms, write 0 ms, index 468 ms: 10 candidates, 57542 repo-hours, 944 releases; waiting 492 ms; commit 0 ms)
2026-11-08T11:46:09Z [load_day 2025-05-03] 2025-05-03: repo_hour merged from 24 files to 1 (1854121 rows, 8755 ms)
2026-11-08T11:46:11Z [load_day 2025-05-03] 2025-05-03: index committed in 11584 ms (24 + 1 + 24 files)
2026-11-08T11:46:11Z [load_day 2025-05-03] 2025-05-03: 4529983 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:46:11Z [load_day 2025-05-03] attempt 1 succeeded