orcaLog in

Runs · run 3018

load_day 2024-09-28, attempt 1 succeeded

Host
73ccef5e07c2:184549
Started
2026-11-08T08:07:33Z
Ended
2026-11-08T08:08:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
654 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
97.3 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3018/load_day/2024-09-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:07:33Z [load_day 2024-09-28] attempt 1 started
2026-11-08T08:07:34Z [load_day 2024-09-28] 2024-09-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:07:41Z [load_day 2024-09-28] 2024-09-28 hour 0: 158000 events in 0 files, snapshot none (task 6239 ms: download 3312 ms overlapping gunzip 925 ms, parse 3766 ms, sort 0 ms, write 0 ms, index 721 ms: 3 candidates, 76834 repo-hours, 1174 releases; waiting 532 ms; commit 0 ms)
2026-11-08T08:07:41Z [load_day 2024-09-28] 2024-09-28 hour 1: 168608 events in 0 files, snapshot none (task 6216 ms: download 2763 ms overlapping gunzip 872 ms, parse 3520 ms, sort 0 ms, write 0 ms, index 981 ms: 4 candidates, 90444 repo-hours, 732 releases; waiting 436 ms; commit 0 ms)
2026-11-08T08:07:46Z [load_day 2024-09-28] 2024-09-28 hour 2: 140823 events in 0 files, snapshot none (task 4606 ms: download 2199 ms overlapping gunzip 563 ms, parse 2309 ms, sort 0 ms, write 0 ms, index 900 ms: 7 candidates, 61433 repo-hours, 632 releases; waiting 502 ms; commit 0 ms)
2026-11-08T08:07:46Z [load_day 2024-09-28] 2024-09-28 hour 3: 155094 events in 0 files, snapshot none (task 4988 ms: download 2158 ms overlapping gunzip 639 ms, parse 2667 ms, sort 0 ms, write 0 ms, index 786 ms: 3 candidates, 62022 repo-hours, 3886 releases; waiting 556 ms; commit 0 ms)
2026-11-08T08:07:51Z [load_day 2024-09-28] 2024-09-28 hour 4: 137200 events in 0 files, snapshot none (task 4941 ms: download 2292 ms overlapping gunzip 725 ms, parse 2817 ms, sort 0 ms, write 0 ms, index 597 ms: 3 candidates, 51834 repo-hours, 595 releases; waiting 480 ms; commit 0 ms)
2026-11-08T08:07:52Z [load_day 2024-09-28] 2024-09-28 hour 5: 141270 events in 0 files, snapshot none (task 4686 ms: download 2195 ms overlapping gunzip 684 ms, parse 2649 ms, sort 0 ms, write 0 ms, index 611 ms: 2 candidates, 53961 repo-hours, 726 releases; waiting 513 ms; commit 0 ms)
2026-11-08T08:07:57Z [load_day 2024-09-28] 2024-09-28 hour 6: 168697 events in 0 files, snapshot none (task 4998 ms: download 2777 ms overlapping gunzip 639 ms, parse 2914 ms, sort 0 ms, write 0 ms, index 621 ms: 3 candidates, 71759 repo-hours, 916 releases; waiting 501 ms; commit 0 ms)
2026-11-08T08:07:57Z [load_day 2024-09-28] 2024-09-28 hour 7: 159282 events in 0 files, snapshot none (task 5002 ms: download 2604 ms overlapping gunzip 718 ms, parse 2974 ms, sort 0 ms, write 0 ms, index 460 ms: 0 candidates, 59462 repo-hours, 876 releases; waiting 504 ms; commit 0 ms)
2026-11-08T08:08:02Z [load_day 2024-09-28] 2024-09-28 hour 8: 163652 events in 0 files, snapshot none (task 4362 ms: download 2817 ms overlapping gunzip 598 ms, parse 2306 ms, sort 0 ms, write 0 ms, index 535 ms: 9 candidates, 63882 repo-hours, 946 releases; waiting 612 ms; commit 0 ms)
2026-11-08T08:08:02Z [load_day 2024-09-28] 2024-09-28 hour 9: 170859 events in 0 files, snapshot none (task 4331 ms: download 2413 ms overlapping gunzip 550 ms, parse 2283 ms, sort 0 ms, write 0 ms, index 646 ms: 2 candidates, 69092 repo-hours, 1023 releases; waiting 557 ms; commit 0 ms)
2026-11-08T08:08:07Z [load_day 2024-09-28] 2024-09-28 hour 10: 166037 events in 0 files, snapshot none (task 5113 ms: download 2481 ms overlapping gunzip 750 ms, parse 3122 ms, sort 0 ms, write 0 ms, index 473 ms: 7 candidates, 63682 repo-hours, 776 releases; waiting 489 ms; commit 0 ms)
2026-11-08T08:08:07Z [load_day 2024-09-28] 2024-09-28 hour 11: 160230 events in 0 files, snapshot none (task 4573 ms: download 3037 ms overlapping gunzip 634 ms, parse 2698 ms, sort 0 ms, write 0 ms, index 429 ms: 2 candidates, 59616 repo-hours, 660 releases; waiting 507 ms; commit 0 ms)
2026-11-08T08:08:14Z [load_day 2024-09-28] 2024-09-28 hour 12: 227547 events in 0 files, snapshot none (task 6157 ms: download 3221 ms overlapping gunzip 797 ms, parse 3847 ms, sort 0 ms, write 0 ms, index 729 ms: 6 candidates, 110814 repo-hours, 764 releases; waiting 538 ms; commit 0 ms)
2026-11-08T08:08:14Z [load_day 2024-09-28] 2024-09-28 hour 13: 196351 events in 0 files, snapshot none (task 5506 ms: download 2718 ms overlapping gunzip 795 ms, parse 3494 ms, sort 0 ms, write 0 ms, index 628 ms: 6 candidates, 89106 repo-hours, 850 releases; waiting 258 ms; commit 0 ms)
2026-11-08T08:08:20Z [load_day 2024-09-28] 2024-09-28 hour 14: 183538 events in 0 files, snapshot none (task 5378 ms: download 2872 ms overlapping gunzip 743 ms, parse 3193 ms, sort 0 ms, write 0 ms, index 526 ms: 9 candidates, 71601 repo-hours, 831 releases; waiting 512 ms; commit 0 ms)
2026-11-08T08:08:20Z [load_day 2024-09-28] 2024-09-28 hour 15: 191318 events in 0 files, snapshot none (task 5379 ms: download 3111 ms overlapping gunzip 737 ms, parse 3147 ms, sort 0 ms, write 0 ms, index 612 ms: 9 candidates, 79812 repo-hours, 1088 releases; waiting 528 ms; commit 0 ms)
2026-11-08T08:08:24Z [load_day 2024-09-28] 2024-09-28 hour 16: 182767 events in 0 files, snapshot none (task 4031 ms: download 2370 ms overlapping gunzip 513 ms, parse 2165 ms, sort 0 ms, write 0 ms, index 560 ms: 7 candidates, 72478 repo-hours, 979 releases; waiting 511 ms; commit 0 ms)
2026-11-08T08:08:24Z [load_day 2024-09-28] 2024-09-28 hour 17: 175042 events in 0 files, snapshot none (task 4064 ms: download 2276 ms overlapping gunzip 529 ms, parse 2194 ms, sort 0 ms, write 0 ms, index 463 ms: 9 candidates, 65444 repo-hours, 803 releases; waiting 561 ms; commit 0 ms)
2026-11-08T08:08:29Z [load_day 2024-09-28] 2024-09-28 hour 18: 189897 events in 0 files, snapshot none (task 4438 ms: download 1980 ms overlapping gunzip 568 ms, parse 2481 ms, sort 0 ms, write 0 ms, index 634 ms: 1 candidates, 82082 repo-hours, 939 releases; waiting 511 ms; commit 0 ms)
2026-11-08T08:08:29Z [load_day 2024-09-28] 2024-09-28 hour 19: 163970 events in 0 files, snapshot none (task 3614 ms: download 1942 ms overlapping gunzip 471 ms, parse 1899 ms, sort 0 ms, write 0 ms, index 437 ms: 30 candidates, 59295 repo-hours, 831 releases; waiting 506 ms; commit 0 ms)
2026-11-08T08:08:33Z [load_day 2024-09-28] 2024-09-28 hour 20: 159739 events in 0 files, snapshot none (task 3710 ms: download 1966 ms overlapping gunzip 455 ms, parse 1961 ms, sort 0 ms, write 0 ms, index 461 ms: 4 candidates, 58044 repo-hours, 736 releases; waiting 515 ms; commit 0 ms)
2026-11-08T08:08:34Z [load_day 2024-09-28] 2024-09-28 hour 21: 156056 events in 0 files, snapshot none (task 3938 ms: download 2849 ms overlapping gunzip 456 ms, parse 1853 ms, sort 0 ms, write 0 ms, index 386 ms: 3 candidates, 57765 repo-hours, 865 releases; waiting 963 ms; commit 0 ms)
2026-11-08T08:08:38Z [load_day 2024-09-28] 2024-09-28 hour 22: 138829 events in 0 files, snapshot none (task 4625 ms: download 3741 ms overlapping gunzip 570 ms, parse 2323 ms, sort 0 ms, write 0 ms, index 377 ms: 3 candidates, 47978 repo-hours, 829 releases; waiting 1054 ms; commit 0 ms)
2026-11-08T08:08:38Z [load_day 2024-09-28] 2024-09-28 hour 23: 126514 events in 0 files, snapshot none (task 3979 ms: download 1734 ms overlapping gunzip 469 ms, parse 2325 ms, sort 0 ms, write 0 ms, index 414 ms: 4 candidates, 45285 repo-hours, 788 releases; waiting 529 ms; commit 0 ms)
2026-11-08T08:08:47Z [load_day 2024-09-28] 2024-09-28: repo_hour merged from 24 files to 1 (1623725 rows, 8142 ms)
2026-11-08T08:08:49Z [load_day 2024-09-28] 2024-09-28: index committed in 10924 ms (23 + 1 + 24 files)
2026-11-08T08:08:49Z [load_day 2024-09-28] 2024-09-28: 3981320 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:08:49Z [load_day 2024-09-28] attempt 1 succeeded