orcaLog in

Runs · run 5026

load_day 2026-03-12, attempt 1 succeeded

Host
73ccef5e07c2:454373
Started
2026-11-08T15:33:20Z
Ended
2026-11-08T15:34:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
725 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
70.2 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/5026/load_day/2026-03-12/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:33:20Z [load_day 2026-03-12] attempt 1 started
2026-11-08T15:33:21Z [load_day 2026-03-12] 2026-03-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:33:26Z [load_day 2026-03-12] 2026-03-12 hour 0: 151396 events in 0 files, snapshot none (task 3972 ms: download 2357 ms overlapping gunzip 526 ms, parse 1641 ms, sort 0 ms, write 0 ms, index 624 ms: 9 candidates, 78984 repo-hours, 873 releases; waiting 789 ms; commit 0 ms)
2026-11-08T15:33:26Z [load_day 2026-03-12] 2026-03-12 hour 1: 144208 events in 0 files, snapshot none (task 3525 ms: download 1812 ms overlapping gunzip 352 ms, parse 1174 ms, sort 0 ms, write 0 ms, index 1163 ms: 4 candidates, 86828 repo-hours, 683 releases; waiting 508 ms; commit 0 ms)
2026-11-08T15:33:30Z [load_day 2026-03-12] 2026-03-12 hour 2: 152625 events in 0 files, snapshot none (task 3421 ms: download 2177 ms overlapping gunzip 446 ms, parse 1330 ms, sort 0 ms, write 0 ms, index 741 ms: 5 candidates, 88459 repo-hours, 688 releases; waiting 594 ms; commit 0 ms)
2026-11-08T15:33:31Z [load_day 2026-03-12] 2026-03-12 hour 3: 148636 events in 0 files, snapshot none (task 4317 ms: download 3072 ms overlapping gunzip 562 ms, parse 1677 ms, sort 0 ms, write 0 ms, index 576 ms: 4 candidates, 73610 repo-hours, 1076 releases; waiting 1109 ms; commit 0 ms)
2026-11-08T15:33:34Z [load_day 2026-03-12] 2026-03-12 hour 4: 151304 events in 0 files, snapshot none (task 3920 ms: download 2688 ms overlapping gunzip 476 ms, parse 1517 ms, sort 0 ms, write 0 ms, index 682 ms: 4 candidates, 77846 repo-hours, 874 releases; waiting 883 ms; commit 0 ms)
2026-11-08T15:33:35Z [load_day 2026-03-12] 2026-03-12 hour 5: 147940 events in 0 files, snapshot none (task 3836 ms: download 2761 ms overlapping gunzip 527 ms, parse 1446 ms, sort 0 ms, write 0 ms, index 623 ms: 5 candidates, 79381 repo-hours, 700 releases; waiting 906 ms; commit 0 ms)
2026-11-08T15:33:38Z [load_day 2026-03-12] 2026-03-12 hour 6: 148719 events in 0 files, snapshot none (task 3708 ms: download 2220 ms overlapping gunzip 425 ms, parse 1246 ms, sort 0 ms, write 0 ms, index 743 ms: 5 candidates, 82706 repo-hours, 675 releases; waiting 906 ms; commit 0 ms)
2026-11-08T15:33:40Z [load_day 2026-03-12] 2026-03-12 hour 7: 149400 events in 0 files, snapshot none (task 3987 ms: download 2598 ms overlapping gunzip 376 ms, parse 1083 ms, sort 0 ms, write 0 ms, index 772 ms: 3 candidates, 83194 repo-hours, 679 releases; waiting 1472 ms; commit 0 ms)
2026-11-08T15:33:42Z [load_day 2026-03-12] 2026-03-12 hour 8: 145290 events in 0 files, snapshot none (task 2915 ms: download 1601 ms overlapping gunzip 398 ms, parse 1147 ms, sort 0 ms, write 0 ms, index 637 ms: 12 candidates, 82739 repo-hours, 582 releases; waiting 423 ms; commit 0 ms)
2026-11-08T15:33:44Z [load_day 2026-03-12] 2026-03-12 hour 9: 155154 events in 0 files, snapshot none (task 3206 ms: download 1842 ms overlapping gunzip 301 ms, parse 959 ms, sort 0 ms, write 0 ms, index 806 ms: 5 candidates, 89509 repo-hours, 415 releases; waiting 779 ms; commit 0 ms)
2026-11-08T15:33:45Z [load_day 2026-03-12] 2026-03-12 hour 10: 154908 events in 0 files, snapshot none (task 2575 ms: download 1397 ms overlapping gunzip 328 ms, parse 989 ms, sort 0 ms, write 0 ms, index 697 ms: 5 candidates, 86600 repo-hours, 351 releases; waiting 302 ms; commit 0 ms)
2026-11-08T15:33:48Z [load_day 2026-03-12] 2026-03-12 hour 11: 152700 events in 0 files, snapshot none (task 3430 ms: download 2010 ms overlapping gunzip 387 ms, parse 1117 ms, sort 0 ms, write 0 ms, index 822 ms: 8 candidates, 86824 repo-hours, 356 releases; waiting 774 ms; commit 0 ms)
2026-11-08T15:33:48Z [load_day 2026-03-12] 2026-03-12 hour 12: 160222 events in 0 files, snapshot none (task 2898 ms: download 1338 ms overlapping gunzip 389 ms, parse 1142 ms, sort 0 ms, write 0 ms, index 690 ms: 11 candidates, 98465 repo-hours, 229 releases; waiting 257 ms; commit 0 ms)
2026-11-08T15:33:51Z [load_day 2026-03-12] 2026-03-12 hour 13: 153515 events in 0 files, snapshot none (task 2907 ms: download 1608 ms overlapping gunzip 257 ms, parse 859 ms, sort 0 ms, write 0 ms, index 895 ms: 12 candidates, 94382 repo-hours, 142 releases; waiting 630 ms; commit 0 ms)
2026-11-08T15:33:52Z [load_day 2026-03-12] 2026-03-12 hour 14: 154455 events in 0 files, snapshot none (task 2992 ms: download 1707 ms overlapping gunzip 292 ms, parse 960 ms, sort 0 ms, write 0 ms, index 735 ms: 8 candidates, 92102 repo-hours, 183 releases; waiting 769 ms; commit 0 ms)
2026-11-08T15:33:55Z [load_day 2026-03-12] 2026-03-12 hour 15: 147878 events in 0 files, snapshot none (task 2930 ms: download 1904 ms overlapping gunzip 266 ms, parse 853 ms, sort 0 ms, write 0 ms, index 651 ms: 8 candidates, 86952 repo-hours, 234 releases; waiting 855 ms; commit 0 ms)
2026-11-08T15:33:55Z [load_day 2026-03-12] 2026-03-12 hour 16: 150717 events in 0 files, snapshot none (task 2758 ms: download 1600 ms overlapping gunzip 263 ms, parse 826 ms, sort 0 ms, write 0 ms, index 706 ms: 9 candidates, 88981 repo-hours, 270 releases; waiting 640 ms; commit 0 ms)
2026-11-08T15:33:59Z [load_day 2026-03-12] 2026-03-12 hour 17: 154248 events in 0 files, snapshot none (task 3034 ms: download 1744 ms overlapping gunzip 267 ms, parse 860 ms, sort 0 ms, write 0 ms, index 682 ms: 7 candidates, 89347 repo-hours, 243 releases; waiting 820 ms; commit 0 ms)
2026-11-08T15:33:59Z [load_day 2026-03-12] 2026-03-12 hour 18: 150486 events in 0 files, snapshot none (task 2486 ms: download 1441 ms overlapping gunzip 285 ms, parse 925 ms, sort 0 ms, write 0 ms, index 621 ms: 14 candidates, 85848 repo-hours, 302 releases; waiting 375 ms; commit 0 ms)
2026-11-08T15:34:03Z [load_day 2026-03-12] 2026-03-12 hour 19: 155076 events in 0 files, snapshot none (task 3584 ms: download 2111 ms overlapping gunzip 324 ms, parse 1018 ms, sort 0 ms, write 0 ms, index 726 ms: 9 candidates, 86361 repo-hours, 388 releases; waiting 1189 ms; commit 0 ms)
2026-11-08T15:34:03Z [load_day 2026-03-12] 2026-03-12 hour 20: 157211 events in 0 files, snapshot none (task 3411 ms: download 2006 ms overlapping gunzip 337 ms, parse 1069 ms, sort 0 ms, write 0 ms, index 691 ms: 11 candidates, 85491 repo-hours, 463 releases; waiting 983 ms; commit 0 ms)
2026-11-08T15:34:06Z [load_day 2026-03-12] 2026-03-12 hour 21: 153361 events in 0 files, snapshot none (task 3097 ms: download 1808 ms overlapping gunzip 326 ms, parse 1020 ms, sort 0 ms, write 0 ms, index 680 ms: 6 candidates, 81217 repo-hours, 513 releases; waiting 812 ms; commit 0 ms)
2026-11-08T15:34:06Z [load_day 2026-03-12] 2026-03-12 hour 22: 147734 events in 0 files, snapshot none (task 2752 ms: download 1517 ms overlapping gunzip 379 ms, parse 1142 ms, sort 0 ms, write 0 ms, index 615 ms: 5 candidates, 76178 repo-hours, 718 releases; waiting 317 ms; commit 0 ms)
2026-11-08T15:34:12Z [load_day 2026-03-12] 2026-03-12 hour 23: 146797 events in 0 files, snapshot none (task 5231 ms: download 4146 ms overlapping gunzip 530 ms, parse 1671 ms, sort 0 ms, write 0 ms, index 590 ms: 6 candidates, 71839 repo-hours, 1017 releases; waiting 2059 ms; commit 0 ms)
2026-11-08T15:34:21Z [load_day 2026-03-12] 2026-03-12: repo_hour merged from 24 files to 1 (2033843 rows, 9406 ms)
2026-11-08T15:34:24Z [load_day 2026-03-12] 2026-03-12: index committed in 12453 ms (24 + 1 + 24 files)
2026-11-08T15:34:24Z [load_day 2026-03-12] 2026-03-12: 3633980 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:34:24Z [load_day 2026-03-12] attempt 1 succeeded