orcaLog in

Runs · run 4970

load_day 2026-02-24, attempt 1 succeeded

Host
73ccef5e07c2:447332
Started
2026-11-08T15:24:25Z
Ended
2026-11-08T15:25:29Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
721 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
72.5 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4970/load_day/2026-02-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:24:25Z [load_day 2026-02-24] attempt 1 started
2026-11-08T15:24:26Z [load_day 2026-02-24] 2026-02-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:24:31Z [load_day 2026-02-24] 2026-02-24 hour 0: 145125 events in 0 files, snapshot none (task 4278 ms: download 2756 ms overlapping gunzip 686 ms, parse 2016 ms, sort 0 ms, write 0 ms, index 604 ms: 6 candidates, 71359 repo-hours, 1018 releases; waiting 732 ms; commit 0 ms)
2026-11-08T15:24:31Z [load_day 2026-02-24] 2026-02-24 hour 1: 151733 events in 0 files, snapshot none (task 3597 ms: download 2069 ms overlapping gunzip 550 ms, parse 1760 ms, sort 0 ms, write 0 ms, index 740 ms: 7 candidates, 90823 repo-hours, 706 releases; waiting 253 ms; commit 0 ms)
2026-11-08T15:24:36Z [load_day 2026-02-24] 2026-02-24 hour 2: 153539 events in 0 files, snapshot none (task 3973 ms: download 2423 ms overlapping gunzip 547 ms, parse 1748 ms, sort 0 ms, write 0 ms, index 736 ms: 7 candidates, 88897 repo-hours, 660 releases; waiting 556 ms; commit 0 ms)
2026-11-08T15:24:36Z [load_day 2026-02-24] 2026-02-24 hour 3: 145619 events in 0 files, snapshot none (task 3638 ms: download 2157 ms overlapping gunzip 569 ms, parse 1616 ms, sort 0 ms, write 0 ms, index 629 ms: 6 candidates, 73246 repo-hours, 936 releases; waiting 528 ms; commit 0 ms)
2026-11-08T15:24:40Z [load_day 2026-02-24] 2026-02-24 hour 4: 145806 events in 0 files, snapshot none (task 3826 ms: download 2321 ms overlapping gunzip 672 ms, parse 1997 ms, sort 0 ms, write 0 ms, index 638 ms: 10 candidates, 74905 repo-hours, 1107 releases; waiting 323 ms; commit 0 ms)
2026-11-08T15:24:40Z [load_day 2026-02-24] 2026-02-24 hour 5: 147839 events in 0 files, snapshot none (task 3909 ms: download 2823 ms overlapping gunzip 554 ms, parse 1693 ms, sort 0 ms, write 0 ms, index 607 ms: 11 candidates, 76343 repo-hours, 1585 releases; waiting 716 ms; commit 0 ms)
2026-11-08T15:24:44Z [load_day 2026-02-24] 2026-02-24 hour 6: 147685 events in 0 files, snapshot none (task 4047 ms: download 2704 ms overlapping gunzip 513 ms, parse 1459 ms, sort 0 ms, write 0 ms, index 631 ms: 11 candidates, 80963 repo-hours, 921 releases; waiting 1154 ms; commit 0 ms)
2026-11-08T15:24:44Z [load_day 2026-02-24] 2026-02-24 hour 7: 148995 events in 0 files, snapshot none (task 3615 ms: download 2067 ms overlapping gunzip 512 ms, parse 1506 ms, sort 0 ms, write 0 ms, index 697 ms: 6 candidates, 82626 repo-hours, 882 releases; waiting 580 ms; commit 0 ms)
2026-11-08T15:24:49Z [load_day 2026-02-24] 2026-02-24 hour 8: 146084 events in 0 files, snapshot none (task 4183 ms: download 3068 ms overlapping gunzip 402 ms, parse 1190 ms, sort 0 ms, write 0 ms, index 739 ms: 10 candidates, 82859 repo-hours, 758 releases; waiting 1521 ms; commit 0 ms)
2026-11-08T15:24:49Z [load_day 2026-02-24] 2026-02-24 hour 9: 145266 events in 0 files, snapshot none (task 3059 ms: download 2006 ms overlapping gunzip 420 ms, parse 1193 ms, sort 0 ms, write 0 ms, index 644 ms: 10 candidates, 82118 repo-hours, 672 releases; waiting 520 ms; commit 0 ms)
2026-11-08T15:24:53Z [load_day 2026-02-24] 2026-02-24 hour 10: 142510 events in 0 files, snapshot none (task 3992 ms: download 2647 ms overlapping gunzip 576 ms, parse 1534 ms, sort 0 ms, write 0 ms, index 649 ms: 8 candidates, 79773 repo-hours, 793 releases; waiting 884 ms; commit 0 ms)
2026-11-08T15:24:53Z [load_day 2026-02-24] 2026-02-24 hour 11: 140048 events in 0 files, snapshot none (task 3852 ms: download 2547 ms overlapping gunzip 556 ms, parse 1473 ms, sort 0 ms, write 0 ms, index 613 ms: 6 candidates, 79704 repo-hours, 834 releases; waiting 718 ms; commit 0 ms)
2026-11-08T15:24:58Z [load_day 2026-02-24] 2026-02-24 hour 12: 142789 events in 0 files, snapshot none (task 4037 ms: download 2306 ms overlapping gunzip 412 ms, parse 1246 ms, sort 0 ms, write 0 ms, index 625 ms: 7 candidates, 87310 repo-hours, 667 releases; waiting 1100 ms; commit 0 ms)
2026-11-08T15:24:58Z [load_day 2026-02-24] 2026-02-24 hour 13: 146760 events in 0 files, snapshot none (task 2788 ms: download 1417 ms overlapping gunzip 321 ms, parse 944 ms, sort 0 ms, write 0 ms, index 798 ms: 8 candidates, 93704 repo-hours, 446 releases; waiting 421 ms; commit 0 ms)
2026-11-08T15:25:02Z [load_day 2026-02-24] 2026-02-24 hour 14: 140484 events in 0 files, snapshot none (task 3449 ms: download 2327 ms overlapping gunzip 359 ms, parse 1079 ms, sort 0 ms, write 0 ms, index 717 ms: 5 candidates, 84646 repo-hours, 500 releases; waiting 968 ms; commit 0 ms)
2026-11-08T15:25:02Z [load_day 2026-02-24] 2026-02-24 hour 15: 134579 events in 0 files, snapshot none (task 2898 ms: download 1600 ms overlapping gunzip 338 ms, parse 992 ms, sort 0 ms, write 0 ms, index 717 ms: 10 candidates, 81635 repo-hours, 565 releases; waiting 514 ms; commit 0 ms)
2026-11-08T15:25:05Z [load_day 2026-02-24] 2026-02-24 hour 16: 126061 events in 0 files, snapshot none (task 2945 ms: download 1447 ms overlapping gunzip 281 ms, parse 886 ms, sort 0 ms, write 0 ms, index 605 ms: 9 candidates, 76062 repo-hours, 409 releases; waiting 856 ms; commit 0 ms)
2026-11-08T15:25:05Z [load_day 2026-02-24] 2026-02-24 hour 17: 127787 events in 0 files, snapshot none (task 2692 ms: download 1462 ms overlapping gunzip 284 ms, parse 845 ms, sort 0 ms, write 0 ms, index 612 ms: 10 candidates, 76702 repo-hours, 327 releases; waiting 379 ms; commit 0 ms)
2026-11-08T15:25:09Z [load_day 2026-02-24] 2026-02-24 hour 18: 120104 events in 0 files, snapshot none (task 2997 ms: download 1778 ms overlapping gunzip 261 ms, parse 814 ms, sort 0 ms, write 0 ms, index 586 ms: 10 candidates, 72463 repo-hours, 299 releases; waiting 1115 ms; commit 0 ms)
2026-11-08T15:25:09Z [load_day 2026-02-24] 2026-02-24 hour 19: 123009 events in 0 files, snapshot none (task 2469 ms: download 1467 ms overlapping gunzip 272 ms, parse 804 ms, sort 0 ms, write 0 ms, index 615 ms: 8 candidates, 71155 repo-hours, 328 releases; waiting 489 ms; commit 0 ms)
2026-11-08T15:25:12Z [load_day 2026-02-24] 2026-02-24 hour 20: 136936 events in 0 files, snapshot none (task 3084 ms: download 2026 ms overlapping gunzip 345 ms, parse 1021 ms, sort 0 ms, write 0 ms, index 606 ms: 14 candidates, 74362 repo-hours, 384 releases; waiting 750 ms; commit 0 ms)
2026-11-08T15:25:13Z [load_day 2026-02-24] 2026-02-24 hour 21: 151140 events in 0 files, snapshot none (task 3477 ms: download 2295 ms overlapping gunzip 443 ms, parse 1393 ms, sort 0 ms, write 0 ms, index 574 ms: 11 candidates, 79286 repo-hours, 731 releases; waiting 830 ms; commit 0 ms)
2026-11-08T15:25:17Z [load_day 2026-02-24] 2026-02-24 hour 22: 144392 events in 0 files, snapshot none (task 3860 ms: download 1966 ms overlapping gunzip 514 ms, parse 1473 ms, sort 0 ms, write 0 ms, index 908 ms: 6 candidates, 74551 repo-hours, 905 releases; waiting 577 ms; commit 0 ms)
2026-11-08T15:25:17Z [load_day 2026-02-24] 2026-02-24 hour 23: 146817 events in 0 files, snapshot none (task 3322 ms: download 1808 ms overlapping gunzip 515 ms, parse 1469 ms, sort 0 ms, write 0 ms, index 643 ms: 7 candidates, 73895 repo-hours, 990 releases; waiting 393 ms; commit 0 ms)
2026-11-08T15:25:26Z [load_day 2026-02-24] 2026-02-24: repo_hour merged from 24 files to 1 (1909387 rows, 8801 ms)
2026-11-08T15:25:29Z [load_day 2026-02-24] 2026-02-24: index committed in 11932 ms (24 + 1 + 24 files)
2026-11-08T15:25:29Z [load_day 2026-02-24] 2026-02-24: 3401107 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:25:29Z [load_day 2026-02-24] attempt 1 succeeded