orcaLog in

Runs · run 3010

load_day 2024-09-26, attempt 1 succeeded

Host
73ccef5e07c2:183608
Started
2026-11-08T08:05:47Z
Ended
2026-11-08T08:07:32Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
785 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
152.6 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3010/load_day/2024-09-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:05:47Z [load_day 2024-09-26] attempt 1 started
2026-11-08T08:05:48Z [load_day 2024-09-26] 2024-09-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:05:55Z [load_day 2024-09-26] 2024-09-26 hour 0: 183701 events in 0 files, snapshot none (task 6585 ms: download 3407 ms overlapping gunzip 1042 ms, parse 4214 ms, sort 0 ms, write 0 ms, index 693 ms: 9 candidates, 90804 repo-hours, 1057 releases; waiting 297 ms; commit 0 ms)
2026-11-08T08:05:55Z [load_day 2024-09-26] 2024-09-26 hour 1: 200543 events in 0 files, snapshot none (task 6620 ms: download 3563 ms overlapping gunzip 943 ms, parse 3842 ms, sort 0 ms, write 0 ms, index 1039 ms: 4 candidates, 107143 repo-hours, 851 releases; waiting 459 ms; commit 0 ms)
2026-11-08T08:06:01Z [load_day 2024-09-26] 2024-09-26 hour 2: 179935 events in 0 files, snapshot none (task 5709 ms: download 2660 ms overlapping gunzip 879 ms, parse 3164 ms, sort 0 ms, write 0 ms, index 833 ms: 11 candidates, 81105 repo-hours, 771 releases; waiting 542 ms; commit 0 ms)
2026-11-08T08:06:02Z [load_day 2024-09-26] 2024-09-26 hour 3: 192000 events in 0 files, snapshot none (task 5886 ms: download 2905 ms overlapping gunzip 805 ms, parse 3165 ms, sort 0 ms, write 0 ms, index 1017 ms: 8 candidates, 78833 repo-hours, 4100 releases; waiting 562 ms; commit 0 ms)
2026-11-08T08:06:07Z [load_day 2024-09-26] 2024-09-26 hour 4: 168060 events in 0 files, snapshot none (task 5205 ms: download 2795 ms overlapping gunzip 760 ms, parse 3031 ms, sort 0 ms, write 0 ms, index 526 ms: 4 candidates, 65409 repo-hours, 741 releases; waiting 503 ms; commit 0 ms)
2026-11-08T08:06:07Z [load_day 2024-09-26] 2024-09-26 hour 5: 180832 events in 0 files, snapshot none (task 5208 ms: download 2936 ms overlapping gunzip 830 ms, parse 3106 ms, sort 0 ms, write 0 ms, index 533 ms: 7 candidates, 72485 repo-hours, 881 releases; waiting 481 ms; commit 0 ms)
2026-11-08T08:06:15Z [load_day 2024-09-26] 2024-09-26 hour 6: 219860 events in 0 files, snapshot none (task 7636 ms: download 5045 ms overlapping gunzip 1267 ms, parse 4832 ms, sort 0 ms, write 0 ms, index 728 ms: 7 candidates, 99550 repo-hours, 1121 releases; waiting 521 ms; commit 0 ms)
2026-11-08T08:06:15Z [load_day 2024-09-26] 2024-09-26 hour 7: 222893 events in 0 files, snapshot none (task 7654 ms: download 4792 ms overlapping gunzip 1291 ms, parse 4874 ms, sort 0 ms, write 0 ms, index 647 ms: 12 candidates, 91041 repo-hours, 1181 releases; waiting 513 ms; commit 0 ms)
2026-11-08T08:06:24Z [load_day 2024-09-26] 2024-09-26 hour 8: 235604 events in 0 files, snapshot none (task 8088 ms: download 5552 ms overlapping gunzip 1330 ms, parse 5113 ms, sort 0 ms, write 0 ms, index 768 ms: 8 candidates, 98441 repo-hours, 1269 releases; waiting 536 ms; commit 0 ms)
2026-11-08T08:06:24Z [load_day 2024-09-26] 2024-09-26 hour 9: 237748 events in 0 files, snapshot none (task 8093 ms: download 5518 ms overlapping gunzip 1396 ms, parse 4961 ms, sort 0 ms, write 0 ms, index 731 ms: 12 candidates, 102309 repo-hours, 1312 releases; waiting 651 ms; commit 0 ms)
2026-11-08T08:06:32Z [load_day 2024-09-26] 2024-09-26 hour 10: 222552 events in 0 files, snapshot none (task 7577 ms: download 5099 ms overlapping gunzip 1235 ms, parse 4792 ms, sort 0 ms, write 0 ms, index 693 ms: 14 candidates, 92578 repo-hours, 1092 releases; waiting 527 ms; commit 0 ms)
2026-11-08T08:06:32Z [load_day 2024-09-26] 2024-09-26 hour 11: 225560 events in 0 files, snapshot none (task 7243 ms: download 4550 ms overlapping gunzip 1163 ms, parse 4389 ms, sort 0 ms, write 0 ms, index 875 ms: 12 candidates, 90475 repo-hours, 1098 releases; waiting 523 ms; commit 0 ms)
2026-11-08T08:06:41Z [load_day 2024-09-26] 2024-09-26 hour 12: 272774 events in 0 files, snapshot none (task 8787 ms: download 6006 ms overlapping gunzip 1486 ms, parse 5518 ms, sort 0 ms, write 0 ms, index 1004 ms: 11 candidates, 137780 repo-hours, 1302 releases; waiting 494 ms; commit 0 ms)
2026-11-08T08:06:41Z [load_day 2024-09-26] 2024-09-26 hour 13: 264946 events in 0 files, snapshot none (task 8641 ms: download 5972 ms overlapping gunzip 1413 ms, parse 5394 ms, sort 0 ms, write 0 ms, index 922 ms: 10 candidates, 122682 repo-hours, 1259 releases; waiting 549 ms; commit 0 ms)
2026-11-08T08:06:49Z [load_day 2024-09-26] 2024-09-26 hour 14: 253756 events in 0 files, snapshot none (task 7449 ms: download 5015 ms overlapping gunzip 1207 ms, parse 4736 ms, sort 0 ms, write 0 ms, index 727 ms: 10 candidates, 108193 repo-hours, 1320 releases; waiting 514 ms; commit 0 ms)
2026-11-08T08:06:49Z [load_day 2024-09-26] 2024-09-26 hour 15: 255369 events in 0 files, snapshot none (task 6981 ms: download 4541 ms overlapping gunzip 1191 ms, parse 4477 ms, sort 0 ms, write 0 ms, index 751 ms: 7 candidates, 110971 repo-hours, 1419 releases; waiting 263 ms; commit 0 ms)
2026-11-08T08:06:56Z [load_day 2024-09-26] 2024-09-26 hour 16: 235770 events in 0 files, snapshot none (task 6547 ms: download 3937 ms overlapping gunzip 1038 ms, parse 3829 ms, sort 0 ms, write 0 ms, index 916 ms: 11 candidates, 98508 repo-hours, 1181 releases; waiting 528 ms; commit 0 ms)
2026-11-08T08:06:56Z [load_day 2024-09-26] 2024-09-26 hour 17: 225781 events in 0 files, snapshot none (task 6165 ms: download 3894 ms overlapping gunzip 925 ms, parse 3381 ms, sort 0 ms, write 0 ms, index 857 ms: 7 candidates, 92129 repo-hours, 1051 releases; waiting 661 ms; commit 0 ms)
2026-11-08T08:07:05Z [load_day 2024-09-26] 2024-09-26 hour 18: 237900 events in 0 files, snapshot none (task 7853 ms: download 4608 ms overlapping gunzip 1317 ms, parse 4975 ms, sort 0 ms, write 0 ms, index 775 ms: 10 candidates, 106795 repo-hours, 1246 releases; waiting 555 ms; commit 0 ms)
2026-11-08T08:07:05Z [load_day 2024-09-26] 2024-09-26 hour 19: 218783 events in 0 files, snapshot none (task 6891 ms: download 3982 ms overlapping gunzip 1170 ms, parse 4088 ms, sort 0 ms, write 0 ms, index 1138 ms: 4 candidates, 83928 repo-hours, 1110 releases; waiting 195 ms; commit 0 ms)
2026-11-08T08:07:13Z [load_day 2024-09-26] 2024-09-26 hour 20: 203752 events in 0 files, snapshot none (task 8030 ms: download 5549 ms overlapping gunzip 1280 ms, parse 4671 ms, sort 0 ms, write 0 ms, index 608 ms: 6 candidates, 81274 repo-hours, 1082 releases; waiting 1133 ms; commit 0 ms)
2026-11-08T08:07:13Z [load_day 2024-09-26] 2024-09-26 hour 21: 194226 events in 0 files, snapshot none (task 7406 ms: download 4622 ms overlapping gunzip 1299 ms, parse 4708 ms, sort 0 ms, write 0 ms, index 587 ms: 6 candidates, 76886 repo-hours, 1131 releases; waiting 542 ms; commit 0 ms)
2026-11-08T08:07:20Z [load_day 2024-09-26] 2024-09-26 hour 22: 179711 events in 0 files, snapshot none (task 6709 ms: download 3983 ms overlapping gunzip 1119 ms, parse 4258 ms, sort 0 ms, write 0 ms, index 559 ms: 6 candidates, 66105 repo-hours, 1122 releases; waiting 512 ms; commit 0 ms)
2026-11-08T08:07:20Z [load_day 2024-09-26] 2024-09-26 hour 23: 163166 events in 0 files, snapshot none (task 5824 ms: download 3133 ms overlapping gunzip 901 ms, parse 3583 ms, sort 0 ms, write 0 ms, index 585 ms: 8 candidates, 60966 repo-hours, 826 releases; waiting 404 ms; commit 0 ms)
2026-11-08T08:07:30Z [load_day 2024-09-26] 2024-09-26: repo_hour merged from 24 files to 1 (2216390 rows, 9265 ms)
2026-11-08T08:07:32Z [load_day 2024-09-26] 2024-09-26: index committed in 12032 ms (24 + 1 + 24 files)
2026-11-08T08:07:32Z [load_day 2024-09-26] 2024-09-26: 5175222 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:07:32Z [load_day 2024-09-26] attempt 1 succeeded