orcaLog in

Runs · run 5051

load_day 2026-03-19, attempt 1 succeeded

Host
73ccef5e07c2:457518
Started
2026-11-08T15:37:10Z
Ended
2026-11-08T15:38:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
734 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
72.9 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/5051/load_day/2026-03-19/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:37:10Z [load_day 2026-03-19] attempt 1 started
2026-11-08T15:37:11Z [load_day 2026-03-19] 2026-03-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:37:16Z [load_day 2026-03-19] 2026-03-19 hour 0: 150102 events in 0 files, snapshot none (task 4405 ms: download 2436 ms overlapping gunzip 567 ms, parse 1701 ms, sort 0 ms, write 0 ms, index 849 ms: 8 candidates, 70322 repo-hours, 872 releases; waiting 777 ms; commit 0 ms)
2026-11-08T15:37:17Z [load_day 2026-03-19] 2026-03-19 hour 1: 161184 events in 0 files, snapshot none (task 5378 ms: download 2301 ms overlapping gunzip 422 ms, parse 1451 ms, sort 0 ms, write 0 ms, index 2507 ms: 10 candidates, 90561 repo-hours, 337 releases; waiting 644 ms; commit 0 ms)
2026-11-08T15:37:22Z [load_day 2026-03-19] 2026-03-19 hour 2: 162727 events in 0 files, snapshot none (task 4295 ms: download 1681 ms overlapping gunzip 600 ms, parse 2115 ms, sort 0 ms, write 0 ms, index 856 ms: 13 candidates, 92490 repo-hours, 419 releases; waiting 414 ms; commit 0 ms)
2026-11-08T15:37:22Z [load_day 2026-03-19] 2026-03-19 hour 3: 149847 events in 0 files, snapshot none (task 4281 ms: download 2621 ms overlapping gunzip 718 ms, parse 2201 ms, sort 0 ms, write 0 ms, index 609 ms: 11 candidates, 70418 repo-hours, 840 releases; waiting 501 ms; commit 0 ms)
2026-11-08T15:37:27Z [load_day 2026-03-19] 2026-03-19 hour 4: 156122 events in 0 files, snapshot none (task 4600 ms: download 2738 ms overlapping gunzip 733 ms, parse 2125 ms, sort 0 ms, write 0 ms, index 604 ms: 8 candidates, 76595 repo-hours, 967 releases; waiting 620 ms; commit 0 ms)
2026-11-08T15:37:27Z [load_day 2026-03-19] 2026-03-19 hour 5: 147403 events in 0 files, snapshot none (task 4927 ms: download 3190 ms overlapping gunzip 749 ms, parse 2249 ms, sort 0 ms, write 0 ms, index 558 ms: 3 candidates, 75331 repo-hours, 700 releases; waiting 965 ms; commit 0 ms)
2026-11-08T15:37:31Z [load_day 2026-03-19] 2026-03-19 hour 6: 153479 events in 0 files, snapshot none (task 4072 ms: download 2579 ms overlapping gunzip 592 ms, parse 1867 ms, sort 0 ms, write 0 ms, index 708 ms: 7 candidates, 79872 repo-hours, 605 releases; waiting 606 ms; commit 0 ms)
2026-11-08T15:37:31Z [load_day 2026-03-19] 2026-03-19 hour 7: 158519 events in 0 files, snapshot none (task 3504 ms: download 2284 ms overlapping gunzip 488 ms, parse 1385 ms, sort 0 ms, write 0 ms, index 741 ms: 10 candidates, 83777 repo-hours, 579 releases; waiting 575 ms; commit 0 ms)
2026-11-08T15:37:36Z [load_day 2026-03-19] 2026-03-19 hour 8: 154269 events in 0 files, snapshot none (task 3687 ms: download 2179 ms overlapping gunzip 509 ms, parse 1446 ms, sort 0 ms, write 0 ms, index 633 ms: 11 candidates, 80649 repo-hours, 405 releases; waiting 758 ms; commit 0 ms)
2026-11-08T15:37:36Z [load_day 2026-03-19] 2026-03-19 hour 9: 154967 events in 0 files, snapshot none (task 3535 ms: download 2208 ms overlapping gunzip 451 ms, parse 1430 ms, sort 0 ms, write 0 ms, index 693 ms: 8 candidates, 85307 repo-hours, 232 releases; waiting 646 ms; commit 0 ms)
2026-11-08T15:37:39Z [load_day 2026-03-19] 2026-03-19 hour 10: 153077 events in 0 files, snapshot none (task 3469 ms: download 2443 ms overlapping gunzip 369 ms, parse 1092 ms, sort 0 ms, write 0 ms, index 648 ms: 5 candidates, 86291 repo-hours, 337 releases; waiting 1096 ms; commit 0 ms)
2026-11-08T15:37:40Z [load_day 2026-03-19] 2026-03-19 hour 11: 156315 events in 0 files, snapshot none (task 3953 ms: download 2745 ms overlapping gunzip 409 ms, parse 1223 ms, sort 0 ms, write 0 ms, index 677 ms: 7 candidates, 86107 repo-hours, 428 releases; waiting 1217 ms; commit 0 ms)
2026-11-08T15:37:43Z [load_day 2026-03-19] 2026-03-19 hour 12: 156274 events in 0 files, snapshot none (task 2970 ms: download 1840 ms overlapping gunzip 283 ms, parse 866 ms, sort 0 ms, write 0 ms, index 737 ms: 11 candidates, 95248 repo-hours, 220 releases; waiting 781 ms; commit 0 ms)
2026-11-08T15:37:43Z [load_day 2026-03-19] 2026-03-19 hour 13: 154799 events in 0 files, snapshot none (task 2890 ms: download 1763 ms overlapping gunzip 247 ms, parse 810 ms, sort 0 ms, write 0 ms, index 778 ms: 11 candidates, 95473 repo-hours, 129 releases; waiting 768 ms; commit 0 ms)
2026-11-08T15:37:46Z [load_day 2026-03-19] 2026-03-19 hour 14: 157399 events in 0 files, snapshot none (task 2910 ms: download 1690 ms overlapping gunzip 373 ms, parse 1128 ms, sort 0 ms, write 0 ms, index 686 ms: 16 candidates, 91992 repo-hours, 143 releases; waiting 431 ms; commit 0 ms)
2026-11-08T15:37:47Z [load_day 2026-03-19] 2026-03-19 hour 15: 156355 events in 0 files, snapshot none (task 2898 ms: download 1750 ms overlapping gunzip 334 ms, parse 980 ms, sort 0 ms, write 0 ms, index 697 ms: 12 candidates, 91291 repo-hours, 194 releases; waiting 542 ms; commit 0 ms)
2026-11-08T15:37:49Z [load_day 2026-03-19] 2026-03-19 hour 16: 157832 events in 0 files, snapshot none (task 2488 ms: download 1058 ms overlapping gunzip 285 ms, parse 886 ms, sort 0 ms, write 0 ms, index 809 ms: 9 candidates, 89132 repo-hours, 175 releases; waiting 202 ms; commit 0 ms)
2026-11-08T15:37:50Z [load_day 2026-03-19] 2026-03-19 hour 17: 158265 events in 0 files, snapshot none (task 3190 ms: download 1761 ms overlapping gunzip 293 ms, parse 914 ms, sort 0 ms, write 0 ms, index 817 ms: 7 candidates, 90442 repo-hours, 186 releases; waiting 814 ms; commit 0 ms)
2026-11-08T15:37:53Z [load_day 2026-03-19] 2026-03-19 hour 18: 157652 events in 0 files, snapshot none (task 3072 ms: download 1655 ms overlapping gunzip 309 ms, parse 963 ms, sort 0 ms, write 0 ms, index 870 ms: 14 candidates, 86989 repo-hours, 238 releases; waiting 604 ms; commit 0 ms)
2026-11-08T15:37:55Z [load_day 2026-03-19] 2026-03-19 hour 19: 153390 events in 0 files, snapshot none (task 4367 ms: download 3105 ms overlapping gunzip 443 ms, parse 1396 ms, sort 0 ms, write 0 ms, index 634 ms: 14 candidates, 80470 repo-hours, 413 releases; waiting 1437 ms; commit 0 ms)
2026-11-08T15:37:56Z [load_day 2026-03-19] 2026-03-19 hour 20: 156015 events in 0 files, snapshot none (task 2635 ms: download 1512 ms overlapping gunzip 303 ms, parse 948 ms, sort 0 ms, write 0 ms, index 658 ms: 7 candidates, 83179 repo-hours, 459 releases; waiting 414 ms; commit 0 ms)
2026-11-08T15:37:59Z [load_day 2026-03-19] 2026-03-19 hour 21: 154974 events in 0 files, snapshot none (task 3337 ms: download 1961 ms overlapping gunzip 442 ms, parse 1260 ms, sort 0 ms, write 0 ms, index 693 ms: 10 candidates, 81748 repo-hours, 614 releases; waiting 478 ms; commit 0 ms)
2026-11-08T15:38:00Z [load_day 2026-03-19] 2026-03-19 hour 22: 151941 events in 0 files, snapshot none (task 3342 ms: download 1937 ms overlapping gunzip 460 ms, parse 1422 ms, sort 0 ms, write 0 ms, index 635 ms: 10 candidates, 77728 repo-hours, 739 releases; waiting 528 ms; commit 0 ms)
2026-11-08T15:38:03Z [load_day 2026-03-19] 2026-03-19 hour 23: 147727 events in 0 files, snapshot none (task 3699 ms: download 2444 ms overlapping gunzip 510 ms, parse 1479 ms, sort 0 ms, write 0 ms, index 589 ms: 9 candidates, 74542 repo-hours, 916 releases; waiting 835 ms; commit 0 ms)
2026-11-08T15:38:13Z [load_day 2026-03-19] 2026-03-19: repo_hour merged from 24 files to 1 (2015954 rows, 9330 ms)
2026-11-08T15:38:16Z [load_day 2026-03-19] 2026-03-19: index committed in 12581 ms (24 + 1 + 24 files)
2026-11-08T15:38:16Z [load_day 2026-03-19] 2026-03-19: 3720634 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:38:16Z [load_day 2026-03-19] attempt 1 succeeded