orcaLog in

Runs · run 2674

load_day 2024-07-04, attempt 1 succeeded

Host
73ccef5e07c2:145170
Started
2026-11-08T06:49:58Z
Ended
2026-11-08T06:51:44Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
703 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
159.1 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2674/load_day/2024-07-04/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:49:58Z [load_day 2024-07-04] attempt 1 started
2026-11-08T06:49:59Z [load_day 2024-07-04] 2024-07-04: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:50:06Z [load_day 2024-07-04] 2024-07-04 hour 0: 173657 events in 0 files, snapshot none (task 6556 ms: download 3718 ms overlapping gunzip 973 ms, parse 4163 ms, sort 0 ms, write 0 ms, index 659 ms: 19 candidates, 94236 repo-hours, 2007 releases; waiting 456 ms; commit 0 ms)
2026-11-08T06:50:06Z [load_day 2024-07-04] 2024-07-04 hour 1: 185032 events in 0 files, snapshot none (task 6571 ms: download 3747 ms overlapping gunzip 969 ms, parse 4197 ms, sort 0 ms, write 0 ms, index 724 ms: 6 candidates, 105255 repo-hours, 2212 releases; waiting 415 ms; commit 0 ms)
2026-11-08T06:50:13Z [load_day 2024-07-04] 2024-07-04 hour 2: 152506 events in 0 files, snapshot none (task 6981 ms: download 5349 ms overlapping gunzip 759 ms, parse 3206 ms, sort 0 ms, write 0 ms, index 507 ms: 7 candidates, 64998 repo-hours, 2376 releases; waiting 1669 ms; commit 0 ms)
2026-11-08T06:50:13Z [load_day 2024-07-04] 2024-07-04 hour 3: 173289 events in 0 files, snapshot none (task 5823 ms: download 2704 ms overlapping gunzip 800 ms, parse 3484 ms, sort 0 ms, write 0 ms, index 687 ms: 11 candidates, 74274 repo-hours, 6609 releases; waiting 519 ms; commit 0 ms)
2026-11-08T06:50:19Z [load_day 2024-07-04] 2024-07-04 hour 4: 153020 events in 0 files, snapshot none (task 5683 ms: download 2823 ms overlapping gunzip 797 ms, parse 3319 ms, sort 0 ms, write 0 ms, index 816 ms: 12 candidates, 60830 repo-hours, 1288 releases; waiting 458 ms; commit 0 ms)
2026-11-08T06:50:19Z [load_day 2024-07-04] 2024-07-04 hour 5: 166866 events in 0 files, snapshot none (task 5901 ms: download 3226 ms overlapping gunzip 821 ms, parse 3594 ms, sort 0 ms, write 0 ms, index 720 ms: 10 candidates, 67368 repo-hours, 1433 releases; waiting 502 ms; commit 0 ms)
2026-11-08T06:50:28Z [load_day 2024-07-04] 2024-07-04 hour 6: 208145 events in 0 files, snapshot none (task 8471 ms: download 5180 ms overlapping gunzip 1197 ms, parse 5465 ms, sort 0 ms, write 0 ms, index 1030 ms: 5 candidates, 95735 repo-hours, 1352 releases; waiting 502 ms; commit 0 ms)
2026-11-08T06:50:28Z [load_day 2024-07-04] 2024-07-04 hour 7: 208072 events in 0 files, snapshot none (task 8489 ms: download 5365 ms overlapping gunzip 1278 ms, parse 5594 ms, sort 0 ms, write 0 ms, index 790 ms: 13 candidates, 86394 repo-hours, 1302 releases; waiting 523 ms; commit 0 ms)
2026-11-08T06:50:39Z [load_day 2024-07-04] 2024-07-04 hour 8: 223160 events in 0 files, snapshot none (task 10481 ms: download 7163 ms overlapping gunzip 1676 ms, parse 6980 ms, sort 0 ms, write 0 ms, index 998 ms: 12 candidates, 95034 repo-hours, 1526 releases; waiting 480 ms; commit 0 ms)
2026-11-08T06:50:39Z [load_day 2024-07-04] 2024-07-04 hour 9: 231630 events in 0 files, snapshot none (task 10390 ms: download 7232 ms overlapping gunzip 1647 ms, parse 7084 ms, sort 0 ms, write 0 ms, index 904 ms: 16 candidates, 101743 repo-hours, 1578 releases; waiting 429 ms; commit 0 ms)
2026-11-08T06:50:48Z [load_day 2024-07-04] 2024-07-04 hour 10: 214851 events in 0 files, snapshot none (task 8847 ms: download 6115 ms overlapping gunzip 1336 ms, parse 6022 ms, sort 0 ms, write 0 ms, index 710 ms: 9 candidates, 89461 repo-hours, 1473 releases; waiting 502 ms; commit 0 ms)
2026-11-08T06:50:48Z [load_day 2024-07-04] 2024-07-04 hour 11: 208763 events in 0 files, snapshot none (task 8410 ms: download 5774 ms overlapping gunzip 1267 ms, parse 5777 ms, sort 0 ms, write 0 ms, index 665 ms: 24 candidates, 85746 repo-hours, 1415 releases; waiting 415 ms; commit 0 ms)
2026-11-08T06:50:59Z [load_day 2024-07-04] 2024-07-04 hour 12: 274632 events in 0 files, snapshot none (task 9800 ms: download 6919 ms overlapping gunzip 1464 ms, parse 6725 ms, sort 0 ms, write 0 ms, index 907 ms: 17 candidates, 133582 repo-hours, 1656 releases; waiting 462 ms; commit 0 ms)
2026-11-08T06:50:59Z [load_day 2024-07-04] 2024-07-04 hour 13: 253067 events in 0 files, snapshot none (task 9611 ms: download 6850 ms overlapping gunzip 1435 ms, parse 6665 ms, sort 0 ms, write 0 ms, index 800 ms: 16 candidates, 121676 repo-hours, 1679 releases; waiting 456 ms; commit 0 ms)
2026-11-08T06:51:08Z [load_day 2024-07-04] 2024-07-04 hour 14: 244936 events in 0 files, snapshot none (task 8514 ms: download 5839 ms overlapping gunzip 1331 ms, parse 5507 ms, sort 0 ms, write 0 ms, index 826 ms: 11 candidates, 120523 repo-hours, 1611 releases; waiting 532 ms; commit 0 ms)
2026-11-08T06:51:08Z [load_day 2024-07-04] 2024-07-04 hour 15: 227420 events in 0 files, snapshot none (task 8414 ms: download 5629 ms overlapping gunzip 1290 ms, parse 5501 ms, sort 0 ms, write 0 ms, index 781 ms: 14 candidates, 101458 repo-hours, 1505 releases; waiting 534 ms; commit 0 ms)
2026-11-08T06:51:16Z [load_day 2024-07-04] 2024-07-04 hour 16: 204306 events in 0 files, snapshot none (task 7378 ms: download 4885 ms overlapping gunzip 1141 ms, parse 4839 ms, sort 0 ms, write 0 ms, index 640 ms: 9 candidates, 84570 repo-hours, 1363 releases; waiting 501 ms; commit 0 ms)
2026-11-08T06:51:16Z [load_day 2024-07-04] 2024-07-04 hour 17: 195573 events in 0 files, snapshot none (task 6877 ms: download 4272 ms overlapping gunzip 976 ms, parse 4408 ms, sort 0 ms, write 0 ms, index 640 ms: 21 candidates, 81907 repo-hours, 1094 releases; waiting 515 ms; commit 0 ms)
2026-11-08T06:51:22Z [load_day 2024-07-04] 2024-07-04 hour 18: 203797 events in 0 files, snapshot none (task 5945 ms: download 3517 ms overlapping gunzip 885 ms, parse 3720 ms, sort 0 ms, write 0 ms, index 617 ms: 10 candidates, 91969 repo-hours, 1419 releases; waiting 504 ms; commit 0 ms)
2026-11-08T06:51:22Z [load_day 2024-07-04] 2024-07-04 hour 19: 174053 events in 0 files, snapshot none (task 5314 ms: download 3006 ms overlapping gunzip 783 ms, parse 3224 ms, sort 0 ms, write 0 ms, index 524 ms: 8 candidates, 66982 repo-hours, 1213 releases; waiting 498 ms; commit 0 ms)
2026-11-08T06:51:28Z [load_day 2024-07-04] 2024-07-04 hour 20: 168742 events in 0 files, snapshot none (task 5631 ms: download 3215 ms overlapping gunzip 670 ms, parse 2790 ms, sort 0 ms, write 0 ms, index 1260 ms: 18 candidates, 69040 repo-hours, 1123 releases; waiting 601 ms; commit 0 ms)
2026-11-08T06:51:29Z [load_day 2024-07-04] 2024-07-04 hour 21: 170793 events in 0 files, snapshot none (task 6177 ms: download 3360 ms overlapping gunzip 628 ms, parse 2671 ms, sort 0 ms, write 0 ms, index 1950 ms: 21 candidates, 76998 repo-hours, 1259 releases; waiting 628 ms; commit 0 ms)
2026-11-08T06:51:33Z [load_day 2024-07-04] 2024-07-04 hour 22: 137341 events in 0 files, snapshot none (task 3827 ms: download 2806 ms overlapping gunzip 512 ms, parse 2158 ms, sort 0 ms, write 0 ms, index 405 ms: 9 candidates, 51323 repo-hours, 1207 releases; waiting 491 ms; commit 0 ms)
2026-11-08T06:51:33Z [load_day 2024-07-04] 2024-07-04 hour 23: 131590 events in 0 files, snapshot none (task 3874 ms: download 2061 ms overlapping gunzip 498 ms, parse 2170 ms, sort 0 ms, write 0 ms, index 405 ms: 3 candidates, 48951 repo-hours, 925 releases; waiting 496 ms; commit 0 ms)
2026-11-08T06:51:42Z [load_day 2024-07-04] 2024-07-04: repo_hour merged from 24 files to 1 (2070053 rows, 8607 ms)
2026-11-08T06:51:44Z [load_day 2024-07-04] 2024-07-04: index committed in 11207 ms (24 + 1 + 24 files)
2026-11-08T06:51:44Z [load_day 2024-07-04] 2024-07-04: 4685241 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:51:44Z [load_day 2024-07-04] attempt 1 succeeded