orcaLog in

Runs · run 4973

load_day 2026-02-25, attempt 1 succeeded

Host
73ccef5e07c2:447783
Started
2026-11-08T15:25:13Z
Ended
2026-11-08T15:26:22Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
715 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
73.2 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4973/load_day/2026-02-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:25:13Z [load_day 2026-02-25] attempt 1 started
2026-11-08T15:25:14Z [load_day 2026-02-25] 2026-02-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:25:19Z [load_day 2026-02-25] 2026-02-25 hour 0: 147613 events in 0 files, snapshot none (task 4139 ms: download 2462 ms overlapping gunzip 463 ms, parse 1428 ms, sort 0 ms, write 0 ms, index 597 ms: 8 candidates, 72356 repo-hours, 1092 releases; waiting 1090 ms; commit 0 ms)
2026-11-08T15:25:19Z [load_day 2026-02-25] 2026-02-25 hour 1: 155603 events in 0 files, snapshot none (task 3409 ms: download 2026 ms overlapping gunzip 403 ms, parse 1233 ms, sort 0 ms, write 0 ms, index 664 ms: 7 candidates, 89409 repo-hours, 618 releases; waiting 785 ms; commit 0 ms)
2026-11-08T15:25:24Z [load_day 2026-02-25] 2026-02-25 hour 2: 151251 events in 0 files, snapshot none (task 4091 ms: download 2633 ms overlapping gunzip 502 ms, parse 1488 ms, sort 0 ms, write 0 ms, index 641 ms: 4 candidates, 87089 repo-hours, 699 releases; waiting 1041 ms; commit 0 ms)
2026-11-08T15:25:24Z [load_day 2026-02-25] 2026-02-25 hour 3: 146886 events in 0 files, snapshot none (task 3626 ms: download 2164 ms overlapping gunzip 466 ms, parse 1368 ms, sort 0 ms, write 0 ms, index 671 ms: 7 candidates, 72226 repo-hours, 973 releases; waiting 861 ms; commit 0 ms)
2026-11-08T15:25:28Z [load_day 2026-02-25] 2026-02-25 hour 4: 150503 events in 0 files, snapshot none (task 4118 ms: download 2873 ms overlapping gunzip 462 ms, parse 1366 ms, sort 0 ms, write 0 ms, index 592 ms: 6 candidates, 75870 repo-hours, 1004 releases; waiting 1431 ms; commit 0 ms)
2026-11-08T15:25:28Z [load_day 2026-02-25] 2026-02-25 hour 5: 146452 events in 0 files, snapshot none (task 3169 ms: download 2174 ms overlapping gunzip 396 ms, parse 1212 ms, sort 0 ms, write 0 ms, index 577 ms: 5 candidates, 77092 repo-hours, 1593 releases; waiting 699 ms; commit 0 ms)
2026-11-08T15:25:33Z [load_day 2026-02-25] 2026-02-25 hour 6: 148753 events in 0 files, snapshot none (task 4390 ms: download 2883 ms overlapping gunzip 465 ms, parse 1377 ms, sort 0 ms, write 0 ms, index 828 ms: 6 candidates, 81110 repo-hours, 940 releases; waiting 1239 ms; commit 0 ms)
2026-11-08T15:25:33Z [load_day 2026-02-25] 2026-02-25 hour 7: 145364 events in 0 files, snapshot none (task 4119 ms: download 2758 ms overlapping gunzip 485 ms, parse 1401 ms, sort 0 ms, write 0 ms, index 788 ms: 5 candidates, 77988 repo-hours, 865 releases; waiting 1123 ms; commit 0 ms)
2026-11-08T15:25:38Z [load_day 2026-02-25] 2026-02-25 hour 8: 146464 events in 0 files, snapshot none (task 4089 ms: download 2584 ms overlapping gunzip 463 ms, parse 1377 ms, sort 0 ms, write 0 ms, index 984 ms: 10 candidates, 81295 repo-hours, 710 releases; waiting 961 ms; commit 0 ms)
2026-11-08T15:25:38Z [load_day 2026-02-25] 2026-02-25 hour 9: 145395 events in 0 files, snapshot none (task 3962 ms: download 2221 ms overlapping gunzip 516 ms, parse 1520 ms, sort 0 ms, write 0 ms, index 913 ms: 8 candidates, 82808 repo-hours, 721 releases; waiting 708 ms; commit 0 ms)
2026-11-08T15:25:42Z [load_day 2026-02-25] 2026-02-25 hour 10: 140196 events in 0 files, snapshot none (task 4240 ms: download 3037 ms overlapping gunzip 487 ms, parse 1346 ms, sort 0 ms, write 0 ms, index 632 ms: 9 candidates, 79629 repo-hours, 751 releases; waiting 1422 ms; commit 0 ms)
2026-11-08T15:25:42Z [load_day 2026-02-25] 2026-02-25 hour 11: 138884 events in 0 files, snapshot none (task 4039 ms: download 2581 ms overlapping gunzip 449 ms, parse 1460 ms, sort 0 ms, write 0 ms, index 646 ms: 7 candidates, 79287 repo-hours, 571 releases; waiting 1035 ms; commit 0 ms)
2026-11-08T15:25:47Z [load_day 2026-02-25] 2026-02-25 hour 12: 146475 events in 0 files, snapshot none (task 3578 ms: download 2051 ms overlapping gunzip 453 ms, parse 1366 ms, sort 0 ms, write 0 ms, index 793 ms: 2 candidates, 89478 repo-hours, 453 releases; waiting 684 ms; commit 0 ms)
2026-11-08T15:25:47Z [load_day 2026-02-25] 2026-02-25 hour 13: 146181 events in 0 files, snapshot none (task 3349 ms: download 1932 ms overlapping gunzip 415 ms, parse 1258 ms, sort 0 ms, write 0 ms, index 800 ms: 5 candidates, 90834 repo-hours, 381 releases; waiting 616 ms; commit 0 ms)
2026-11-08T15:25:51Z [load_day 2026-02-25] 2026-02-25 hour 14: 136408 events in 0 files, snapshot none (task 4064 ms: download 2514 ms overlapping gunzip 551 ms, parse 1699 ms, sort 0 ms, write 0 ms, index 626 ms: 6 candidates, 80369 repo-hours, 628 releases; waiting 825 ms; commit 0 ms)
2026-11-08T15:25:51Z [load_day 2026-02-25] 2026-02-25 hour 15: 131979 events in 0 files, snapshot none (task 4229 ms: download 2801 ms overlapping gunzip 591 ms, parse 1537 ms, sort 0 ms, write 0 ms, index 709 ms: 6 candidates, 77936 repo-hours, 753 releases; waiting 1086 ms; commit 0 ms)
2026-11-08T15:25:56Z [load_day 2026-02-25] 2026-02-25 hour 16: 120490 events in 0 files, snapshot none (task 3889 ms: download 2461 ms overlapping gunzip 571 ms, parse 1492 ms, sort 0 ms, write 0 ms, index 594 ms: 6 candidates, 73418 repo-hours, 519 releases; waiting 919 ms; commit 0 ms)
2026-11-08T15:25:56Z [load_day 2026-02-25] 2026-02-25 hour 17: 128438 events in 0 files, snapshot none (task 3510 ms: download 1873 ms overlapping gunzip 376 ms, parse 1265 ms, sort 0 ms, write 0 ms, index 713 ms: 6 candidates, 70381 repo-hours, 241 releases; waiting 804 ms; commit 0 ms)
2026-11-08T15:25:59Z [load_day 2026-02-25] 2026-02-25 hour 18: 130360 events in 0 files, snapshot none (task 2972 ms: download 1896 ms overlapping gunzip 264 ms, parse 832 ms, sort 0 ms, write 0 ms, index 597 ms: 6 candidates, 73342 repo-hours, 274 releases; waiting 954 ms; commit 0 ms)
2026-11-08T15:25:59Z [load_day 2026-02-25] 2026-02-25 hour 19: 138427 events in 0 files, snapshot none (task 2273 ms: download 1086 ms overlapping gunzip 274 ms, parse 907 ms, sort 0 ms, write 0 ms, index 637 ms: 10 candidates, 76743 repo-hours, 332 releases; waiting 181 ms; commit 0 ms)
2026-11-08T15:26:03Z [load_day 2026-02-25] 2026-02-25 hour 20: 133876 events in 0 files, snapshot none (task 3509 ms: download 1766 ms overlapping gunzip 417 ms, parse 1238 ms, sort 0 ms, write 0 ms, index 821 ms: 4 candidates, 70352 repo-hours, 570 releases; waiting 683 ms; commit 0 ms)
2026-11-08T15:26:04Z [load_day 2026-02-25] 2026-02-25 hour 21: 132900 events in 0 files, snapshot none (task 3769 ms: download 2004 ms overlapping gunzip 400 ms, parse 1270 ms, sort 0 ms, write 0 ms, index 1030 ms: 4 candidates, 70242 repo-hours, 810 releases; waiting 794 ms; commit 0 ms)
2026-11-08T15:26:08Z [load_day 2026-02-25] 2026-02-25 hour 22: 134213 events in 0 files, snapshot none (task 4150 ms: download 2496 ms overlapping gunzip 555 ms, parse 1719 ms, sort 0 ms, write 0 ms, index 590 ms: 6 candidates, 70246 repo-hours, 836 releases; waiting 957 ms; commit 0 ms)
2026-11-08T15:26:08Z [load_day 2026-02-25] 2026-02-25 hour 23: 140544 events in 0 files, snapshot none (task 3886 ms: download 2172 ms overlapping gunzip 520 ms, parse 1632 ms, sort 0 ms, write 0 ms, index 650 ms: 3 candidates, 72162 repo-hours, 855 releases; waiting 580 ms; commit 0 ms)
2026-11-08T15:26:19Z [load_day 2026-02-25] 2026-02-25: repo_hour merged from 24 files to 1 (1871662 rows, 10661 ms)
2026-11-08T15:26:22Z [load_day 2026-02-25] 2026-02-25: index committed in 13664 ms (24 + 1 + 24 files)
2026-11-08T15:26:22Z [load_day 2026-02-25] 2026-02-25: 3383655 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:26:22Z [load_day 2026-02-25] attempt 1 succeeded