orcaLog in

Runs · run 3667

load_day 2025-03-14, attempt 1 succeeded

Host
73ccef5e07c2:270258
Started
2026-11-08T10:50:18Z
Ended
2026-11-08T10:52:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
813 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
198.3 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3667/load_day/2025-03-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:50:18Z [load_day 2025-03-14] attempt 1 started
2026-11-08T10:50:19Z [load_day 2025-03-14] 2025-03-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:50:29Z [load_day 2025-03-14] 2025-03-14 hour 0: 220800 events in 0 files, snapshot none (task 9267 ms: download 5346 ms overlapping gunzip 1302 ms, parse 5791 ms, sort 0 ms, write 0 ms, index 1353 ms: 10 candidates, 98317 repo-hours, 1313 releases; waiting 549 ms; commit 0 ms)
2026-11-08T10:50:29Z [load_day 2025-03-14] 2025-03-14 hour 1: 241324 events in 0 files, snapshot none (task 9375 ms: download 5571 ms overlapping gunzip 1339 ms, parse 5740 ms, sort 0 ms, write 0 ms, index 1439 ms: 8 candidates, 123473 repo-hours, 940 releases; waiting 465 ms; commit 0 ms)
2026-11-08T10:50:37Z [load_day 2025-03-14] 2025-03-14 hour 2: 211628 events in 0 files, snapshot none (task 7530 ms: download 4565 ms overlapping gunzip 1150 ms, parse 4729 ms, sort 0 ms, write 0 ms, index 841 ms: 8 candidates, 89142 repo-hours, 958 releases; waiting 511 ms; commit 0 ms)
2026-11-08T10:50:38Z [load_day 2025-03-14] 2025-03-14 hour 3: 221788 events in 0 files, snapshot none (task 7918 ms: download 4296 ms overlapping gunzip 1170 ms, parse 5073 ms, sort 0 ms, write 0 ms, index 865 ms: 3 candidates, 87992 repo-hours, 3916 releases; waiting 484 ms; commit 0 ms)
2026-11-08T10:50:45Z [load_day 2025-03-14] 2025-03-14 hour 4: 203585 events in 0 files, snapshot none (task 7598 ms: download 4879 ms overlapping gunzip 1061 ms, parse 4646 ms, sort 0 ms, write 0 ms, index 678 ms: 5 candidates, 70833 repo-hours, 769 releases; waiting 934 ms; commit 0 ms)
2026-11-08T10:50:45Z [load_day 2025-03-14] 2025-03-14 hour 5: 207987 events in 0 files, snapshot none (task 6921 ms: download 4394 ms overlapping gunzip 1038 ms, parse 4431 ms, sort 0 ms, write 0 ms, index 593 ms: 7 candidates, 74194 repo-hours, 833 releases; waiting 505 ms; commit 0 ms)
2026-11-08T10:50:54Z [load_day 2025-03-14] 2025-03-14 hour 6: 235416 events in 0 files, snapshot none (task 8429 ms: download 5591 ms overlapping gunzip 1346 ms, parse 5719 ms, sort 0 ms, write 0 ms, index 805 ms: 2 candidates, 97601 repo-hours, 1052 releases; waiting 271 ms; commit 0 ms)
2026-11-08T10:50:55Z [load_day 2025-03-14] 2025-03-14 hour 7: 230951 events in 0 files, snapshot none (task 9015 ms: download 6184 ms overlapping gunzip 1464 ms, parse 6119 ms, sort 0 ms, write 0 ms, index 674 ms: 4 candidates, 87274 repo-hours, 874 releases; waiting 485 ms; commit 0 ms)
2026-11-08T10:51:05Z [load_day 2025-03-14] 2025-03-14 hour 8: 248574 events in 0 files, snapshot none (task 10298 ms: download 7354 ms overlapping gunzip 1675 ms, parse 7032 ms, sort 0 ms, write 0 ms, index 807 ms: 3 candidates, 97974 repo-hours, 1187 releases; waiting 531 ms; commit 0 ms)
2026-11-08T10:51:06Z [load_day 2025-03-14] 2025-03-14 hour 9: 262212 events in 0 files, snapshot none (task 9964 ms: download 7315 ms overlapping gunzip 1640 ms, parse 6754 ms, sort 0 ms, write 0 ms, index 806 ms: 6 candidates, 105536 repo-hours, 1371 releases; waiting 469 ms; commit 0 ms)
2026-11-08T10:51:15Z [load_day 2025-03-14] 2025-03-14 hour 10: 254887 events in 0 files, snapshot none (task 9989 ms: download 7375 ms overlapping gunzip 1624 ms, parse 6853 ms, sort 0 ms, write 0 ms, index 773 ms: 9 candidates, 100184 repo-hours, 1347 releases; waiting 490 ms; commit 0 ms)
2026-11-08T10:51:15Z [load_day 2025-03-14] 2025-03-14 hour 11: 249409 events in 0 files, snapshot none (task 9001 ms: download 6330 ms overlapping gunzip 1463 ms, parse 5980 ms, sort 0 ms, write 0 ms, index 757 ms: 6 candidates, 94727 repo-hours, 1183 releases; waiting 509 ms; commit 0 ms)
2026-11-08T10:51:25Z [load_day 2025-03-14] 2025-03-14 hour 12: 294422 events in 0 files, snapshot none (task 8647 ms: download 5618 ms overlapping gunzip 1267 ms, parse 5512 ms, sort 0 ms, write 0 ms, index 1037 ms: 7 candidates, 140559 repo-hours, 1275 releases; waiting 503 ms; commit 0 ms)
2026-11-08T10:51:25Z [load_day 2025-03-14] 2025-03-14 hour 13: 283061 events in 0 files, snapshot none (task 8726 ms: download 5940 ms overlapping gunzip 1293 ms, parse 5709 ms, sort 0 ms, write 0 ms, index 892 ms: 9 candidates, 124781 repo-hours, 1326 releases; waiting 611 ms; commit 0 ms)
2026-11-08T10:51:36Z [load_day 2025-03-14] 2025-03-14 hour 14: 279962 events in 0 files, snapshot none (task 10646 ms: download 6925 ms overlapping gunzip 1728 ms, parse 7410 ms, sort 0 ms, write 0 ms, index 963 ms: 12 candidates, 111818 repo-hours, 1474 releases; waiting 330 ms; commit 0 ms)
2026-11-08T10:51:36Z [load_day 2025-03-14] 2025-03-14 hour 15: 281541 events in 0 files, snapshot none (task 10982 ms: download 7727 ms overlapping gunzip 1709 ms, parse 7262 ms, sort 0 ms, write 0 ms, index 1060 ms: 8 candidates, 117537 repo-hours, 1567 releases; waiting 680 ms; commit 0 ms)
2026-11-08T10:51:48Z [load_day 2025-03-14] 2025-03-14 hour 16: 269057 events in 0 files, snapshot none (task 11597 ms: download 8451 ms overlapping gunzip 1819 ms, parse 7413 ms, sort 0 ms, write 0 ms, index 1136 ms: 8 candidates, 107535 repo-hours, 1349 releases; waiting 974 ms; commit 0 ms)
2026-11-08T10:51:48Z [load_day 2025-03-14] 2025-03-14 hour 17: 260557 events in 0 files, snapshot none (task 10004 ms: download 7186 ms overlapping gunzip 1593 ms, parse 6684 ms, sort 0 ms, write 0 ms, index 911 ms: 9 candidates, 97517 repo-hours, 1305 releases; waiting 567 ms; commit 0 ms)
2026-11-08T10:51:58Z [load_day 2025-03-14] 2025-03-14 hour 18: 262466 events in 0 files, snapshot none (task 9233 ms: download 6209 ms overlapping gunzip 1420 ms, parse 6169 ms, sort 0 ms, write 0 ms, index 788 ms: 10 candidates, 108858 repo-hours, 1238 releases; waiting 523 ms; commit 0 ms)
2026-11-08T10:51:58Z [load_day 2025-03-14] 2025-03-14 hour 19: 239712 events in 0 files, snapshot none (task 9248 ms: download 6495 ms overlapping gunzip 1518 ms, parse 6155 ms, sort 0 ms, write 0 ms, index 809 ms: 6 candidates, 85846 repo-hours, 1107 releases; waiting 500 ms; commit 0 ms)
2026-11-08T10:52:08Z [load_day 2025-03-14] 2025-03-14 hour 20: 230179 events in 0 files, snapshot none (task 9318 ms: download 6535 ms overlapping gunzip 1487 ms, parse 6280 ms, sort 0 ms, write 0 ms, index 774 ms: 8 candidates, 84920 repo-hours, 1013 releases; waiting 490 ms; commit 0 ms)
2026-11-08T10:52:08Z [load_day 2025-03-14] 2025-03-14 hour 21: 225894 events in 0 files, snapshot none (task 8724 ms: download 6151 ms overlapping gunzip 1341 ms, parse 5845 ms, sort 0 ms, write 0 ms, index 751 ms: 10 candidates, 82610 repo-hours, 1108 releases; waiting 540 ms; commit 0 ms)
2026-11-08T10:52:17Z [load_day 2025-03-14] 2025-03-14 hour 22: 210392 events in 0 files, snapshot none (task 8402 ms: download 5904 ms overlapping gunzip 1133 ms, parse 4757 ms, sort 0 ms, write 0 ms, index 575 ms: 8 candidates, 72278 repo-hours, 1129 releases; waiting 1709 ms; commit 0 ms)
2026-11-08T10:52:17Z [load_day 2025-03-14] 2025-03-14 hour 23: 199966 events in 0 files, snapshot none (task 6382 ms: download 3112 ms overlapping gunzip 857 ms, parse 3862 ms, sort 0 ms, write 0 ms, index 835 ms: 9 candidates, 68189 repo-hours, 1056 releases; waiting 509 ms; commit 0 ms)
2026-11-08T10:52:27Z [load_day 2025-03-14] 2025-03-14: repo_hour merged from 24 files to 1 (2329695 rows, 10058 ms)
2026-11-08T10:52:30Z [load_day 2025-03-14] 2025-03-14: index committed in 13091 ms (24 + 1 + 24 files)
2026-11-08T10:52:30Z [load_day 2025-03-14] 2025-03-14: 5825770 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:52:30Z [load_day 2025-03-14] attempt 1 succeeded