orcaLog in

Runs · run 2061

load_day 2024-02-08, attempt 1 succeeded

Host
73ccef5e07c2:84333
Started
2026-11-08T04:32:52Z
Ended
2026-11-08T04:34:51Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
661 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
175.3 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2061/load_day/2024-02-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:32:52Z [load_day 2024-02-08] attempt 1 started
2026-11-08T04:32:54Z [load_day 2024-02-08] 2024-02-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:33:02Z [load_day 2024-02-08] 2024-02-08 hour 0: 240692 events in 0 files, snapshot none (task 8369 ms: download 5425 ms overlapping gunzip 1237 ms, parse 5582 ms, sort 0 ms, write 0 ms, index 778 ms: 10 candidates, 92251 repo-hours, 1212 releases; waiting 492 ms; commit 0 ms)
2026-11-08T04:33:02Z [load_day 2024-02-08] 2024-02-08 hour 1: 230346 events in 0 files, snapshot none (task 7974 ms: download 5075 ms overlapping gunzip 1189 ms, parse 5239 ms, sort 0 ms, write 0 ms, index 694 ms: 5 candidates, 88895 repo-hours, 832 releases; waiting 482 ms; commit 0 ms)
2026-11-08T04:33:10Z [load_day 2024-02-08] 2024-02-08 hour 2: 200325 events in 0 files, snapshot none (task 6874 ms: download 4080 ms overlapping gunzip 1122 ms, parse 4789 ms, sort 0 ms, write 0 ms, index 391 ms: 5 candidates, 54607 repo-hours, 652 releases; waiting 295 ms; commit 0 ms)
2026-11-08T04:33:10Z [load_day 2024-02-08] 2024-02-08 hour 3: 200981 events in 0 files, snapshot none (task 6056 ms: download 3455 ms overlapping gunzip 962 ms, parse 4185 ms, sort 0 ms, write 0 ms, index 445 ms: 6 candidates, 55261 repo-hours, 743 releases; waiting 259 ms; commit 0 ms)
2026-11-08T04:33:17Z [load_day 2024-02-08] 2024-02-08 hour 4: 203263 events in 0 files, snapshot none (task 6632 ms: download 3834 ms overlapping gunzip 956 ms, parse 4398 ms, sort 0 ms, write 0 ms, index 541 ms: 6 candidates, 56108 repo-hours, 558 releases; waiting 524 ms; commit 0 ms)
2026-11-08T04:33:17Z [load_day 2024-02-08] 2024-02-08 hour 5: 206381 events in 0 files, snapshot none (task 6628 ms: download 3547 ms overlapping gunzip 1033 ms, parse 4631 ms, sort 0 ms, write 0 ms, index 492 ms: 9 candidates, 58820 repo-hours, 637 releases; waiting 262 ms; commit 0 ms)
2026-11-08T04:33:24Z [load_day 2024-02-08] 2024-02-08 hour 6: 217727 events in 0 files, snapshot none (task 7018 ms: download 4136 ms overlapping gunzip 1009 ms, parse 4622 ms, sort 0 ms, write 0 ms, index 614 ms: 7 candidates, 68112 repo-hours, 761 releases; waiting 513 ms; commit 0 ms)
2026-11-08T04:33:24Z [load_day 2024-02-08] 2024-02-08 hour 7: 209308 events in 0 files, snapshot none (task 6637 ms: download 3809 ms overlapping gunzip 1063 ms, parse 4510 ms, sort 0 ms, write 0 ms, index 621 ms: 6 candidates, 64605 repo-hours, 711 releases; waiting 239 ms; commit 0 ms)
2026-11-08T04:33:31Z [load_day 2024-02-08] 2024-02-08 hour 8: 166703 events in 0 files, snapshot none (task 6581 ms: download 3948 ms overlapping gunzip 979 ms, parse 4323 ms, sort 0 ms, write 0 ms, index 535 ms: 10 candidates, 60866 repo-hours, 654 releases; waiting 474 ms; commit 0 ms)
2026-11-08T04:33:31Z [load_day 2024-02-08] 2024-02-08 hour 9: 173797 events in 0 files, snapshot none (task 7000 ms: download 4377 ms overlapping gunzip 1073 ms, parse 4544 ms, sort 0 ms, write 0 ms, index 585 ms: 8 candidates, 64902 repo-hours, 849 releases; waiting 583 ms; commit 0 ms)
2026-11-08T04:33:40Z [load_day 2024-02-08] 2024-02-08 hour 10: 215704 events in 0 files, snapshot none (task 8515 ms: download 5020 ms overlapping gunzip 1332 ms, parse 5569 ms, sort 0 ms, write 0 ms, index 837 ms: 8 candidates, 73629 repo-hours, 879 releases; waiting 534 ms; commit 0 ms)
2026-11-08T04:33:42Z [load_day 2024-02-08] 2024-02-08 hour 11: 247643 events in 0 files, snapshot none (task 10012 ms: download 7245 ms overlapping gunzip 1662 ms, parse 6966 ms, sort 0 ms, write 0 ms, index 671 ms: 10 candidates, 79193 repo-hours, 1006 releases; waiting 368 ms; commit 0 ms)
2026-11-08T04:33:50Z [load_day 2024-02-08] 2024-02-08 hour 12: 302669 events in 0 files, snapshot none (task 9285 ms: download 5748 ms overlapping gunzip 1306 ms, parse 6153 ms, sort 0 ms, write 0 ms, index 1026 ms: 13 candidates, 111736 repo-hours, 1141 releases; waiting 537 ms; commit 0 ms)
2026-11-08T04:33:52Z [load_day 2024-02-08] 2024-02-08 hour 13: 278819 events in 0 files, snapshot none (task 9742 ms: download 6888 ms overlapping gunzip 1448 ms, parse 6525 ms, sort 0 ms, write 0 ms, index 969 ms: 12 candidates, 105550 repo-hours, 1199 releases; waiting 539 ms; commit 0 ms)
2026-11-08T04:34:01Z [load_day 2024-02-08] 2024-02-08 hour 14: 270920 events in 0 files, snapshot none (task 10177 ms: download 6658 ms overlapping gunzip 1561 ms, parse 6910 ms, sort 0 ms, write 0 ms, index 943 ms: 10 candidates, 95611 repo-hours, 1277 releases; waiting 501 ms; commit 0 ms)
2026-11-08T04:34:04Z [load_day 2024-02-08] 2024-02-08 hour 15: 269834 events in 0 files, snapshot none (task 10760 ms: download 7804 ms overlapping gunzip 1671 ms, parse 7191 ms, sort 0 ms, write 0 ms, index 999 ms: 9 candidates, 99234 repo-hours, 1358 releases; waiting 583 ms; commit 0 ms)
2026-11-08T04:34:10Z [load_day 2024-02-08] 2024-02-08 hour 16: 276434 events in 0 files, snapshot none (task 8374 ms: download 5787 ms overlapping gunzip 1337 ms, parse 5571 ms, sort 0 ms, write 0 ms, index 693 ms: 12 candidates, 101304 repo-hours, 1114 releases; waiting 520 ms; commit 0 ms)
2026-11-08T04:34:12Z [load_day 2024-02-08] 2024-02-08 hour 17: 259376 events in 0 files, snapshot none (task 8243 ms: download 5601 ms overlapping gunzip 1295 ms, parse 5403 ms, sort 0 ms, write 0 ms, index 815 ms: 8 candidates, 90628 repo-hours, 1193 releases; waiting 469 ms; commit 0 ms)
2026-11-08T04:34:19Z [load_day 2024-02-08] 2024-02-08 hour 18: 260329 events in 0 files, snapshot none (task 8599 ms: download 4692 ms overlapping gunzip 1204 ms, parse 5035 ms, sort 0 ms, write 0 ms, index 1530 ms: 6 candidates, 95240 repo-hours, 1169 releases; waiting 535 ms; commit 0 ms)
2026-11-08T04:34:23Z [load_day 2024-02-08] 2024-02-08 hour 19: 235536 events in 0 files, snapshot none (task 10081 ms: download 6394 ms overlapping gunzip 1636 ms, parse 6801 ms, sort 0 ms, write 0 ms, index 817 ms: 9 candidates, 80329 repo-hours, 1079 releases; waiting 518 ms; commit 0 ms)
2026-11-08T04:34:28Z [load_day 2024-02-08] 2024-02-08 hour 20: 231920 events in 0 files, snapshot none (task 8606 ms: download 4865 ms overlapping gunzip 1254 ms, parse 5472 ms, sort 0 ms, write 0 ms, index 1114 ms: 5 candidates, 77229 repo-hours, 889 releases; waiting 502 ms; commit 0 ms)
2026-11-08T04:34:32Z [load_day 2024-02-08] 2024-02-08 hour 21: 233664 events in 0 files, snapshot none (task 8658 ms: download 5593 ms overlapping gunzip 1368 ms, parse 5927 ms, sort 0 ms, write 0 ms, index 587 ms: 6 candidates, 75325 repo-hours, 1096 releases; waiting 491 ms; commit 0 ms)
2026-11-08T04:34:36Z [load_day 2024-02-08] 2024-02-08 hour 22: 213358 events in 0 files, snapshot none (task 7667 ms: download 4180 ms overlapping gunzip 1194 ms, parse 4903 ms, sort 0 ms, write 0 ms, index 771 ms: 10 candidates, 68986 repo-hours, 1025 releases; waiting 514 ms; commit 0 ms)
2026-11-08T04:34:39Z [load_day 2024-02-08] 2024-02-08 hour 23: 197433 events in 0 files, snapshot none (task 6460 ms: download 3989 ms overlapping gunzip 951 ms, parse 4242 ms, sort 0 ms, write 0 ms, index 490 ms: 3 candidates, 59325 repo-hours, 799 releases; waiting 504 ms; commit 0 ms)
2026-11-08T04:34:49Z [load_day 2024-02-08] 2024-02-08: repo_hour merged from 24 files to 1 (1877746 rows, 9661 ms)
2026-11-08T04:34:51Z [load_day 2024-02-08] 2024-02-08: index committed in 12362 ms (24 + 1 + 24 files)
2026-11-08T04:34:51Z [load_day 2024-02-08] 2024-02-08: 5543162 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:34:51Z [load_day 2024-02-08] attempt 1 succeeded