orcaLog in

Runs · run 3242

load_day 2024-11-25, attempt 1 succeeded

Host
73ccef5e07c2:212434
Started
2026-11-08T09:01:32Z
Ended
2026-11-08T09:04:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
774 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
266.3 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3242/load_day/2024-11-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:01:32Z [load_day 2024-11-25] attempt 1 started
2026-11-08T09:01:33Z [load_day 2024-11-25] 2024-11-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:01:41Z [load_day 2024-11-25] 2024-11-25 hour 0: 182878 events in 0 files, snapshot none (task 7440 ms: download 4426 ms overlapping gunzip 1212 ms, parse 4871 ms, sort 0 ms, write 0 ms, index 821 ms: 12 candidates, 83548 repo-hours, 1093 releases; waiting 295 ms; commit 0 ms)
2026-11-08T09:01:41Z [load_day 2024-11-25] 2024-11-25 hour 1: 211180 events in 0 files, snapshot none (task 8088 ms: download 5038 ms overlapping gunzip 1282 ms, parse 5193 ms, sort 0 ms, write 0 ms, index 873 ms: 6 candidates, 112251 repo-hours, 778 releases; waiting 461 ms; commit 0 ms)
2026-11-08T09:01:49Z [load_day 2024-11-25] 2024-11-25 hour 2: 189226 events in 0 files, snapshot none (task 7803 ms: download 5059 ms overlapping gunzip 1264 ms, parse 4796 ms, sort 0 ms, write 0 ms, index 970 ms: 4 candidates, 79580 repo-hours, 887 releases; waiting 506 ms; commit 0 ms)
2026-11-08T09:01:52Z [load_day 2024-11-25] 2024-11-25 hour 3: 220745 events in 0 files, snapshot none (task 9816 ms: download 7215 ms overlapping gunzip 1697 ms, parse 6475 ms, sort 0 ms, write 0 ms, index 832 ms: 3 candidates, 80391 repo-hours, 3833 releases; waiting 541 ms; commit 0 ms)
2026-11-08T09:02:00Z [load_day 2024-11-25] 2024-11-25 hour 4: 203898 events in 0 files, snapshot none (task 10834 ms: download 8048 ms overlapping gunzip 1989 ms, parse 7452 ms, sort 0 ms, write 0 ms, index 586 ms: 5 candidates, 67831 repo-hours, 629 releases; waiting 521 ms; commit 0 ms)
2026-11-08T09:02:02Z [load_day 2024-11-25] 2024-11-25 hour 5: 208342 events in 0 files, snapshot none (task 10104 ms: download 7538 ms overlapping gunzip 1717 ms, parse 6739 ms, sort 0 ms, write 0 ms, index 824 ms: 7 candidates, 71392 repo-hours, 752 releases; waiting 463 ms; commit 0 ms)
2026-11-08T09:02:11Z [load_day 2024-11-25] 2024-11-25 hour 6: 231609 events in 0 files, snapshot none (task 10690 ms: download 8346 ms overlapping gunzip 1910 ms, parse 7366 ms, sort 0 ms, write 0 ms, index 669 ms: 2 candidates, 93352 repo-hours, 878 releases; waiting 515 ms; commit 0 ms)
2026-11-08T09:02:15Z [load_day 2024-11-25] 2024-11-25 hour 7: 230789 events in 0 files, snapshot none (task 11984 ms: download 8772 ms overlapping gunzip 2063 ms, parse 7937 ms, sort 0 ms, write 0 ms, index 1141 ms: 3 candidates, 82639 repo-hours, 965 releases; waiting 476 ms; commit 0 ms)
2026-11-08T09:02:27Z [load_day 2024-11-25] 2024-11-25 hour 8: 248933 events in 0 files, snapshot none (task 15622 ms: download 13110 ms overlapping gunzip 2292 ms, parse 9155 ms, sort 0 ms, write 0 ms, index 725 ms: 4 candidates, 94140 repo-hours, 1008 releases; waiting 3161 ms; commit 0 ms)
2026-11-08T09:02:28Z [load_day 2024-11-25] 2024-11-25 hour 9: 263000 events in 0 files, snapshot none (task 12611 ms: download 9834 ms overlapping gunzip 2389 ms, parse 8984 ms, sort 0 ms, write 0 ms, index 712 ms: 4 candidates, 101102 repo-hours, 1233 releases; waiting 270 ms; commit 0 ms)
2026-11-08T09:02:40Z [load_day 2024-11-25] 2024-11-25 hour 10: 254298 events in 0 files, snapshot none (task 12360 ms: download 9924 ms overlapping gunzip 2229 ms, parse 8569 ms, sort 0 ms, write 0 ms, index 707 ms: 8 candidates, 94912 repo-hours, 1059 releases; waiting 562 ms; commit 0 ms)
2026-11-08T09:02:40Z [load_day 2024-11-25] 2024-11-25 hour 11: 258750 events in 0 files, snapshot none (task 11792 ms: download 9439 ms overlapping gunzip 2216 ms, parse 8322 ms, sort 0 ms, write 0 ms, index 675 ms: 6 candidates, 92798 repo-hours, 1177 releases; waiting 287 ms; commit 0 ms)
2026-11-08T09:02:51Z [load_day 2024-11-25] 2024-11-25 hour 12: 281029 events in 0 files, snapshot none (task 9516 ms: download 6517 ms overlapping gunzip 1514 ms, parse 6121 ms, sort 0 ms, write 0 ms, index 1014 ms: 10 candidates, 138465 repo-hours, 1298 releases; waiting 502 ms; commit 0 ms)
2026-11-08T09:02:51Z [load_day 2024-11-25] 2024-11-25 hour 13: 280404 events in 0 files, snapshot none (task 10416 ms: download 7871 ms overlapping gunzip 1867 ms, parse 6752 ms, sort 0 ms, write 0 ms, index 797 ms: 7 candidates, 116751 repo-hours, 1041 releases; waiting 639 ms; commit 0 ms)
2026-11-08T09:03:03Z [load_day 2024-11-25] 2024-11-25 hour 14: 274195 events in 0 files, snapshot none (task 12403 ms: download 9214 ms overlapping gunzip 2228 ms, parse 8530 ms, sort 0 ms, write 0 ms, index 861 ms: 5 candidates, 105234 repo-hours, 1223 releases; waiting 505 ms; commit 0 ms)
2026-11-08T09:03:04Z [load_day 2024-11-25] 2024-11-25 hour 15: 278938 events in 0 files, snapshot none (task 12505 ms: download 9603 ms overlapping gunzip 2208 ms, parse 8573 ms, sort 0 ms, write 0 ms, index 878 ms: 6 candidates, 112352 repo-hours, 1333 releases; waiting 538 ms; commit 0 ms)
2026-11-08T09:03:18Z [load_day 2024-11-25] 2024-11-25 hour 16: 267937 events in 0 files, snapshot none (task 14155 ms: download 11210 ms overlapping gunzip 2510 ms, parse 9561 ms, sort 0 ms, write 0 ms, index 1116 ms: 5 candidates, 105164 repo-hours, 1293 releases; waiting 640 ms; commit 0 ms)
2026-11-08T09:03:18Z [load_day 2024-11-25] 2024-11-25 hour 17: 266055 events in 0 files, snapshot none (task 13652 ms: download 10807 ms overlapping gunzip 2435 ms, parse 9361 ms, sort 0 ms, write 0 ms, index 1050 ms: 9 candidates, 98006 repo-hours, 1120 releases; waiting 521 ms; commit 0 ms)
2026-11-08T09:03:32Z [load_day 2024-11-25] 2024-11-25 hour 18: 270165 events in 0 files, snapshot none (task 13618 ms: download 10748 ms overlapping gunzip 2425 ms, parse 9547 ms, sort 0 ms, write 0 ms, index 827 ms: 7 candidates, 109293 repo-hours, 1143 releases; waiting 537 ms; commit 0 ms)
2026-11-08T09:03:32Z [load_day 2024-11-25] 2024-11-25 hour 19: 249484 events in 0 files, snapshot none (task 12875 ms: download 9585 ms overlapping gunzip 2374 ms, parse 8759 ms, sort 0 ms, write 0 ms, index 877 ms: 10 candidates, 88221 repo-hours, 1060 releases; waiting 500 ms; commit 0 ms)
2026-11-08T09:03:46Z [load_day 2024-11-25] 2024-11-25 hour 20: 243659 events in 0 files, snapshot none (task 13265 ms: download 10284 ms overlapping gunzip 2421 ms, parse 9192 ms, sort 0 ms, write 0 ms, index 933 ms: 11 candidates, 87424 repo-hours, 952 releases; waiting 502 ms; commit 0 ms)
2026-11-08T09:03:46Z [load_day 2024-11-25] 2024-11-25 hour 21: 244722 events in 0 files, snapshot none (task 12891 ms: download 9782 ms overlapping gunzip 2348 ms, parse 8821 ms, sort 0 ms, write 0 ms, index 873 ms: 8 candidates, 87912 repo-hours, 1128 releases; waiting 531 ms; commit 0 ms)
2026-11-08T09:04:00Z [load_day 2024-11-25] 2024-11-25 hour 22: 225709 events in 0 files, snapshot none (task 13437 ms: download 10531 ms overlapping gunzip 2439 ms, parse 9402 ms, sort 0 ms, write 0 ms, index 879 ms: 7 candidates, 77442 repo-hours, 1217 releases; waiting 384 ms; commit 0 ms)
2026-11-08T09:04:00Z [load_day 2024-11-25] 2024-11-25 hour 23: 220578 events in 0 files, snapshot none (task 13428 ms: download 10628 ms overlapping gunzip 2473 ms, parse 9421 ms, sort 0 ms, write 0 ms, index 683 ms: 5 candidates, 73934 repo-hours, 813 releases; waiting 531 ms; commit 0 ms)
2026-11-08T09:04:10Z [load_day 2024-11-25] 2024-11-25: repo_hour merged from 24 files to 1 (2254134 rows, 9847 ms)
2026-11-08T09:04:13Z [load_day 2024-11-25] 2024-11-25: index committed in 12553 ms (24 + 1 + 24 files)
2026-11-08T09:04:13Z [load_day 2024-11-25] 2024-11-25: 5806523 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:04:13Z [load_day 2024-11-25] attempt 1 succeeded