orcaLog in

Runs · run 5059

load_day 2026-03-21, attempt 1 succeeded

Host
73ccef5e07c2:458298
Started
2026-11-08T15:38:17Z
Ended
2026-11-08T15:39:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
746 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
79.5 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/5059/load_day/2026-03-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:38:17Z [load_day 2026-03-21] attempt 1 started
2026-11-08T15:38:18Z [load_day 2026-03-21] 2026-03-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:38:24Z [load_day 2026-03-21] 2026-03-21 hour 0: 150007 events in 0 files, snapshot none (task 5288 ms: download 3052 ms overlapping gunzip 993 ms, parse 2860 ms, sort 0 ms, write 0 ms, index 643 ms: 6 candidates, 70806 repo-hours, 1156 releases; waiting 557 ms; commit 0 ms)
2026-11-08T15:38:24Z [load_day 2026-03-21] 2026-03-21 hour 1: 161118 events in 0 files, snapshot none (task 4775 ms: download 2702 ms overlapping gunzip 685 ms, parse 2193 ms, sort 0 ms, write 0 ms, index 1094 ms: 8 candidates, 90307 repo-hours, 840 releases; waiting 485 ms; commit 0 ms)
2026-11-08T15:38:29Z [load_day 2026-03-21] 2026-03-21 hour 2: 154343 events in 0 files, snapshot none (task 4121 ms: download 1701 ms overlapping gunzip 655 ms, parse 1945 ms, sort 0 ms, write 0 ms, index 626 ms: 5 candidates, 79207 repo-hours, 842 releases; waiting 319 ms; commit 0 ms)
2026-11-08T15:38:29Z [load_day 2026-03-21] 2026-03-21 hour 3: 150598 events in 0 files, snapshot none (task 4312 ms: download 3128 ms overlapping gunzip 777 ms, parse 2123 ms, sort 0 ms, write 0 ms, index 508 ms: 8 candidates, 67736 repo-hours, 1108 releases; waiting 573 ms; commit 0 ms)
2026-11-08T15:38:34Z [load_day 2026-03-21] 2026-03-21 hour 4: 158316 events in 0 files, snapshot none (task 4719 ms: download 2841 ms overlapping gunzip 905 ms, parse 2482 ms, sort 0 ms, write 0 ms, index 538 ms: 7 candidates, 70682 repo-hours, 1111 releases; waiting 510 ms; commit 0 ms)
2026-11-08T15:38:34Z [load_day 2026-03-21] 2026-03-21 hour 5: 157706 events in 0 files, snapshot none (task 3967 ms: download 2377 ms overlapping gunzip 678 ms, parse 2046 ms, sort 0 ms, write 0 ms, index 707 ms: 6 candidates, 72328 repo-hours, 1050 releases; waiting 301 ms; commit 0 ms)
2026-11-08T15:38:39Z [load_day 2026-03-21] 2026-03-21 hour 6: 156576 events in 0 files, snapshot none (task 4082 ms: download 2540 ms overlapping gunzip 522 ms, parse 1494 ms, sort 0 ms, write 0 ms, index 589 ms: 9 candidates, 76916 repo-hours, 1079 releases; waiting 1011 ms; commit 0 ms)
2026-11-08T15:38:39Z [load_day 2026-03-21] 2026-03-21 hour 7: 154752 events in 0 files, snapshot none (task 3833 ms: download 2652 ms overlapping gunzip 575 ms, parse 1559 ms, sort 0 ms, write 0 ms, index 622 ms: 7 candidates, 72500 repo-hours, 1075 releases; waiting 796 ms; commit 0 ms)
2026-11-08T15:38:43Z [load_day 2026-03-21] 2026-03-21 hour 8: 159651 events in 0 files, snapshot none (task 3567 ms: download 2494 ms overlapping gunzip 495 ms, parse 1369 ms, sort 0 ms, write 0 ms, index 592 ms: 9 candidates, 76461 repo-hours, 1168 releases; waiting 761 ms; commit 0 ms)
2026-11-08T15:38:43Z [load_day 2026-03-21] 2026-03-21 hour 9: 158303 events in 0 files, snapshot none (task 3515 ms: download 2195 ms overlapping gunzip 458 ms, parse 1371 ms, sort 0 ms, write 0 ms, index 611 ms: 4 candidates, 78500 repo-hours, 896 releases; waiting 765 ms; commit 0 ms)
2026-11-08T15:38:47Z [load_day 2026-03-21] 2026-03-21 hour 10: 161877 events in 0 files, snapshot none (task 3314 ms: download 2065 ms overlapping gunzip 394 ms, parse 1172 ms, sort 0 ms, write 0 ms, index 662 ms: 7 candidates, 81548 repo-hours, 788 releases; waiting 715 ms; commit 0 ms)
2026-11-08T15:38:47Z [load_day 2026-03-21] 2026-03-21 hour 11: 158534 events in 0 files, snapshot none (task 3608 ms: download 2506 ms overlapping gunzip 497 ms, parse 1494 ms, sort 0 ms, write 0 ms, index 595 ms: 6 candidates, 75694 repo-hours, 635 releases; waiting 768 ms; commit 0 ms)
2026-11-08T15:38:51Z [load_day 2026-03-21] 2026-03-21 hour 12: 166058 events in 0 files, snapshot none (task 3549 ms: download 2148 ms overlapping gunzip 454 ms, parse 1306 ms, sort 0 ms, write 0 ms, index 793 ms: 11 candidates, 92300 repo-hours, 374 releases; waiting 784 ms; commit 0 ms)
2026-11-08T15:38:51Z [load_day 2026-03-21] 2026-03-21 hour 13: 168458 events in 0 files, snapshot none (task 3973 ms: download 2515 ms overlapping gunzip 553 ms, parse 1548 ms, sort 0 ms, write 0 ms, index 761 ms: 4 candidates, 91799 repo-hours, 307 releases; waiting 830 ms; commit 0 ms)
2026-11-08T15:38:56Z [load_day 2026-03-21] 2026-03-21 hour 14: 164201 events in 0 files, snapshot none (task 4478 ms: download 3009 ms overlapping gunzip 506 ms, parse 1506 ms, sort 0 ms, write 0 ms, index 774 ms: 14 candidates, 83064 repo-hours, 481 releases; waiting 1369 ms; commit 0 ms)
2026-11-08T15:38:56Z [load_day 2026-03-21] 2026-03-21 hour 15: 167082 events in 0 files, snapshot none (task 3489 ms: download 2088 ms overlapping gunzip 374 ms, parse 1180 ms, sort 0 ms, write 0 ms, index 863 ms: 11 candidates, 84850 repo-hours, 503 releases; waiting 807 ms; commit 0 ms)
2026-11-08T15:39:01Z [load_day 2026-03-21] 2026-03-21 hour 16: 168533 events in 0 files, snapshot none (task 4137 ms: download 2151 ms overlapping gunzip 530 ms, parse 1755 ms, sort 0 ms, write 0 ms, index 902 ms: 18 candidates, 86193 repo-hours, 494 releases; waiting 637 ms; commit 0 ms)
2026-11-08T15:39:01Z [load_day 2026-03-21] 2026-03-21 hour 17: 169200 events in 0 files, snapshot none (task 3805 ms: download 2343 ms overlapping gunzip 500 ms, parse 1539 ms, sort 0 ms, write 0 ms, index 712 ms: 9 candidates, 84536 repo-hours, 452 releases; waiting 694 ms; commit 0 ms)
2026-11-08T15:39:05Z [load_day 2026-03-21] 2026-03-21 hour 18: 166710 events in 0 files, snapshot none (task 3502 ms: download 2106 ms overlapping gunzip 463 ms, parse 1362 ms, sort 0 ms, write 0 ms, index 766 ms: 8 candidates, 83253 repo-hours, 457 releases; waiting 545 ms; commit 0 ms)
2026-11-08T15:39:05Z [load_day 2026-03-21] 2026-03-21 hour 19: 164713 events in 0 files, snapshot none (task 3894 ms: download 2505 ms overlapping gunzip 598 ms, parse 1743 ms, sort 0 ms, write 0 ms, index 652 ms: 8 candidates, 75950 repo-hours, 489 releases; waiting 578 ms; commit 0 ms)
2026-11-08T15:39:09Z [load_day 2026-03-21] 2026-03-21 hour 20: 158739 events in 0 files, snapshot none (task 3824 ms: download 2651 ms overlapping gunzip 449 ms, parse 1446 ms, sort 0 ms, write 0 ms, index 687 ms: 16 candidates, 78529 repo-hours, 728 releases; waiting 893 ms; commit 0 ms)
2026-11-08T15:39:09Z [load_day 2026-03-21] 2026-03-21 hour 21: 159251 events in 0 files, snapshot none (task 3309 ms: download 1903 ms overlapping gunzip 471 ms, parse 1410 ms, sort 0 ms, write 0 ms, index 692 ms: 7 candidates, 72613 repo-hours, 1027 releases; waiting 435 ms; commit 0 ms)
2026-11-08T15:39:14Z [load_day 2026-03-21] 2026-03-21 hour 22: 153215 events in 0 files, snapshot none (task 3943 ms: download 2368 ms overlapping gunzip 491 ms, parse 1572 ms, sort 0 ms, write 0 ms, index 791 ms: 6 candidates, 70567 repo-hours, 959 releases; waiting 771 ms; commit 0 ms)
2026-11-08T15:39:14Z [load_day 2026-03-21] 2026-03-21 hour 23: 153175 events in 0 files, snapshot none (task 3835 ms: download 2366 ms overlapping gunzip 558 ms, parse 1838 ms, sort 0 ms, write 0 ms, index 590 ms: 7 candidates, 68454 repo-hours, 1242 releases; waiting 535 ms; commit 0 ms)
2026-11-08T15:39:22Z [load_day 2026-03-21] 2026-03-21: repo_hour merged from 24 files to 1 (1884793 rows, 8310 ms)
2026-11-08T15:39:25Z [load_day 2026-03-21] 2026-03-21: index committed in 11307 ms (24 + 1 + 24 files)
2026-11-08T15:39:25Z [load_day 2026-03-21] 2026-03-21: 3841116 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:39:25Z [load_day 2026-03-21] attempt 1 succeeded