orcaLog in

Runs · run 2942

load_day 2024-09-10, attempt 1 succeeded

Host
73ccef5e07c2:175486
Started
2026-11-08T07:50:58Z
Ended
2026-11-08T07:52:59Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
733 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
183.4 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2942/load_day/2024-09-10/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:50:58Z [load_day 2024-09-10] attempt 1 started
2026-11-08T07:50:59Z [load_day 2024-09-10] 2024-09-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:51:06Z [load_day 2024-09-10] 2024-09-10 hour 0: 195038 events in 0 files, snapshot none (task 7229 ms: download 4073 ms overlapping gunzip 1048 ms, parse 4433 ms, sort 0 ms, write 0 ms, index 905 ms: 11 candidates, 95426 repo-hours, 1129 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:51:08Z [load_day 2024-09-10] 2024-09-10 hour 1: 210058 events in 0 files, snapshot none (task 8472 ms: download 4994 ms overlapping gunzip 1319 ms, parse 5410 ms, sort 0 ms, write 0 ms, index 910 ms: 3 candidates, 111573 repo-hours, 908 releases; waiting 513 ms; commit 0 ms)
2026-11-08T07:51:14Z [load_day 2024-09-10] 2024-09-10 hour 2: 182208 events in 0 files, snapshot none (task 7100 ms: download 4384 ms overlapping gunzip 1066 ms, parse 4390 ms, sort 0 ms, write 0 ms, index 713 ms: 12 candidates, 79492 repo-hours, 890 releases; waiting 574 ms; commit 0 ms)
2026-11-08T07:51:15Z [load_day 2024-09-10] 2024-09-10 hour 3: 192535 events in 0 files, snapshot none (task 6885 ms: download 4066 ms overlapping gunzip 1071 ms, parse 4504 ms, sort 0 ms, write 0 ms, index 578 ms: 5 candidates, 76927 repo-hours, 3993 releases; waiting 482 ms; commit 0 ms)
2026-11-08T07:51:21Z [load_day 2024-09-10] 2024-09-10 hour 4: 170900 events in 0 files, snapshot none (task 6687 ms: download 3710 ms overlapping gunzip 1009 ms, parse 4273 ms, sort 0 ms, write 0 ms, index 594 ms: 4 candidates, 64974 repo-hours, 715 releases; waiting 511 ms; commit 0 ms)
2026-11-08T07:51:23Z [load_day 2024-09-10] 2024-09-10 hour 5: 184153 events in 0 files, snapshot none (task 6990 ms: download 4559 ms overlapping gunzip 1102 ms, parse 4691 ms, sort 0 ms, write 0 ms, index 550 ms: 6 candidates, 70558 repo-hours, 922 releases; waiting 353 ms; commit 0 ms)
2026-11-08T07:51:31Z [load_day 2024-09-10] 2024-09-10 hour 6: 216497 events in 0 files, snapshot none (task 9178 ms: download 5142 ms overlapping gunzip 1447 ms, parse 6032 ms, sort 0 ms, write 0 ms, index 841 ms: 6 candidates, 95664 repo-hours, 1015 releases; waiting 509 ms; commit 0 ms)
2026-11-08T07:51:32Z [load_day 2024-09-10] 2024-09-10 hour 7: 219161 events in 0 files, snapshot none (task 9024 ms: download 6156 ms overlapping gunzip 1463 ms, parse 6128 ms, sort 0 ms, write 0 ms, index 653 ms: 7 candidates, 87937 repo-hours, 1128 releases; waiting 543 ms; commit 0 ms)
2026-11-08T07:51:41Z [load_day 2024-09-10] 2024-09-10 hour 8: 232647 events in 0 files, snapshot none (task 9898 ms: download 6181 ms overlapping gunzip 1551 ms, parse 6393 ms, sort 0 ms, write 0 ms, index 1116 ms: 14 candidates, 95252 repo-hours, 1253 releases; waiting 513 ms; commit 0 ms)
2026-11-08T07:51:43Z [load_day 2024-09-10] 2024-09-10 hour 9: 245900 events in 0 files, snapshot none (task 10712 ms: download 7443 ms overlapping gunzip 1608 ms, parse 7128 ms, sort 0 ms, write 0 ms, index 943 ms: 11 candidates, 100988 repo-hours, 1441 releases; waiting 521 ms; commit 0 ms)
2026-11-08T07:51:52Z [load_day 2024-09-10] 2024-09-10 hour 10: 226470 events in 0 files, snapshot none (task 9690 ms: download 5719 ms overlapping gunzip 1574 ms, parse 6560 ms, sort 0 ms, write 0 ms, index 800 ms: 10 candidates, 90219 repo-hours, 1236 releases; waiting 515 ms; commit 0 ms)
2026-11-08T07:51:54Z [load_day 2024-09-10] 2024-09-10 hour 11: 229329 events in 0 files, snapshot none (task 9809 ms: download 6493 ms overlapping gunzip 1483 ms, parse 6433 ms, sort 0 ms, write 0 ms, index 950 ms: 14 candidates, 89435 repo-hours, 1316 releases; waiting 582 ms; commit 0 ms)
2026-11-08T07:51:57Z [load_day 2024-09-10] 2024-09-10 hour 12: 165969 events in 0 files, snapshot none (task 4994 ms: download 3181 ms overlapping gunzip 750 ms, parse 3078 ms, sort 0 ms, write 0 ms, index 675 ms: 5 candidates, 93237 repo-hours, 870 releases; waiting 175 ms; commit 0 ms)
2026-11-08T07:52:01Z [load_day 2024-09-10] 2024-09-10 hour 13: 216763 events in 0 files, snapshot none (task 7128 ms: download 4596 ms overlapping gunzip 1110 ms, parse 4466 ms, sort 0 ms, write 0 ms, index 778 ms: 14 candidates, 102758 repo-hours, 1174 releases; waiting 537 ms; commit 0 ms)
2026-11-08T07:52:04Z [load_day 2024-09-10] 2024-09-10 hour 14: 207395 events in 0 files, snapshot none (task 6759 ms: download 4303 ms overlapping gunzip 1059 ms, parse 4274 ms, sort 0 ms, write 0 ms, index 670 ms: 10 candidates, 94484 repo-hours, 1217 releases; waiting 512 ms; commit 0 ms)
2026-11-08T07:52:08Z [load_day 2024-09-10] 2024-09-10 hour 15: 176687 events in 0 files, snapshot none (task 5836 ms: download 3347 ms overlapping gunzip 884 ms, parse 3538 ms, sort 0 ms, write 0 ms, index 631 ms: 14 candidates, 84521 repo-hours, 1065 releases; waiting 531 ms; commit 0 ms)
2026-11-08T07:52:15Z [load_day 2024-09-10] 2024-09-10 hour 16: 235223 events in 0 files, snapshot none (task 10420 ms: download 7474 ms overlapping gunzip 1557 ms, parse 6254 ms, sort 0 ms, write 0 ms, index 874 ms: 16 candidates, 97259 repo-hours, 1161 releases; waiting 1341 ms; commit 0 ms)
2026-11-08T07:52:17Z [load_day 2024-09-10] 2024-09-10 hour 17: 224923 events in 0 files, snapshot none (task 9098 ms: download 6503 ms overlapping gunzip 1427 ms, parse 6417 ms, sort 0 ms, write 0 ms, index 686 ms: 8 candidates, 90963 repo-hours, 1113 releases; waiting 229 ms; commit 0 ms)
2026-11-08T07:52:26Z [load_day 2024-09-10] 2024-09-10 hour 18: 233518 events in 0 files, snapshot none (task 9665 ms: download 6773 ms overlapping gunzip 1490 ms, parse 6214 ms, sort 0 ms, write 0 ms, index 898 ms: 4 candidates, 104986 repo-hours, 1295 releases; waiting 726 ms; commit 0 ms)
2026-11-08T07:52:27Z [load_day 2024-09-10] 2024-09-10 hour 19: 208075 events in 0 files, snapshot none (task 9112 ms: download 5917 ms overlapping gunzip 1349 ms, parse 5693 ms, sort 0 ms, write 0 ms, index 1191 ms: 11 candidates, 81599 repo-hours, 1063 releases; waiting 509 ms; commit 0 ms)
2026-11-08T07:52:39Z [load_day 2024-09-10] 2024-09-10 hour 20: 208491 events in 0 files, snapshot none (task 9549 ms: download 6992 ms overlapping gunzip 1676 ms, parse 6407 ms, sort 0 ms, write 0 ms, index 601 ms: 7 candidates, 82441 repo-hours, 1143 releases; waiting 515 ms; commit 0 ms)
2026-11-08T07:52:39Z [load_day 2024-09-10] 2024-09-10 hour 21: 194240 events in 0 files, snapshot none (task 8825 ms: download 6349 ms overlapping gunzip 1434 ms, parse 6139 ms, sort 0 ms, write 0 ms, index 535 ms: 11 candidates, 76483 repo-hours, 1227 releases; waiting 446 ms; commit 0 ms)
2026-11-08T07:52:47Z [load_day 2024-09-10] 2024-09-10 hour 22: 171608 events in 0 files, snapshot none (task 7666 ms: download 5005 ms overlapping gunzip 1209 ms, parse 5199 ms, sort 0 ms, write 0 ms, index 474 ms: 10 candidates, 62211 repo-hours, 1344 releases; waiting 514 ms; commit 0 ms)
2026-11-08T07:52:47Z [load_day 2024-09-10] 2024-09-10 hour 23: 165915 events in 0 files, snapshot none (task 7380 ms: download 4805 ms overlapping gunzip 1166 ms, parse 4884 ms, sort 0 ms, write 0 ms, index 532 ms: 2 candidates, 60142 repo-hours, 827 releases; waiting 500 ms; commit 0 ms)
2026-11-08T07:52:56Z [load_day 2024-09-10] 2024-09-10: repo_hour merged from 24 files to 1 (2089529 rows, 9080 ms)
2026-11-08T07:52:59Z [load_day 2024-09-10] 2024-09-10: index committed in 11475 ms (24 + 1 + 24 files)
2026-11-08T07:52:59Z [load_day 2024-09-10] 2024-09-10: 4913703 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:52:59Z [load_day 2024-09-10] attempt 1 succeeded