orcaLog in

Runs · run 2968

load_day 2024-09-16, attempt 1 succeeded

Host
73ccef5e07c2:178537
Started
2026-11-08T07:56:26Z
Ended
2026-11-08T07:58:33Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
738 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
200.7 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2968/load_day/2024-09-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:56:26Z [load_day 2024-09-16] attempt 1 started
2026-11-08T07:56:27Z [load_day 2024-09-16] 2024-09-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:56:34Z [load_day 2024-09-16] 2024-09-16 hour 0: 165832 events in 0 files, snapshot none (task 6412 ms: download 3902 ms overlapping gunzip 995 ms, parse 3940 ms, sort 0 ms, write 0 ms, index 753 ms: 7 candidates, 78800 repo-hours, 1040 releases; waiting 454 ms; commit 0 ms)
2026-11-08T07:56:34Z [load_day 2024-09-16] 2024-09-16 hour 1: 183381 events in 0 files, snapshot none (task 7138 ms: download 4071 ms overlapping gunzip 1086 ms, parse 4644 ms, sort 0 ms, write 0 ms, index 703 ms: 7 candidates, 98712 repo-hours, 865 releases; waiting 429 ms; commit 0 ms)
2026-11-08T07:56:41Z [load_day 2024-09-16] 2024-09-16 hour 2: 152664 events in 0 files, snapshot none (task 6567 ms: download 4942 ms overlapping gunzip 992 ms, parse 3967 ms, sort 0 ms, write 0 ms, index 459 ms: 10 candidates, 65225 repo-hours, 772 releases; waiting 784 ms; commit 0 ms)
2026-11-08T07:56:41Z [load_day 2024-09-16] 2024-09-16 hour 3: 173385 events in 0 files, snapshot none (task 6636 ms: download 4116 ms overlapping gunzip 1111 ms, parse 4207 ms, sort 0 ms, write 0 ms, index 525 ms: 8 candidates, 66738 repo-hours, 3932 releases; waiting 502 ms; commit 0 ms)
2026-11-08T07:56:48Z [load_day 2024-09-16] 2024-09-16 hour 4: 159484 events in 0 files, snapshot none (task 6714 ms: download 4413 ms overlapping gunzip 1114 ms, parse 4365 ms, sort 0 ms, write 0 ms, index 445 ms: 2 candidates, 57955 repo-hours, 689 releases; waiting 519 ms; commit 0 ms)
2026-11-08T07:56:48Z [load_day 2024-09-16] 2024-09-16 hour 5: 164624 events in 0 files, snapshot none (task 6114 ms: download 3789 ms overlapping gunzip 970 ms, parse 3772 ms, sort 0 ms, write 0 ms, index 479 ms: 2 candidates, 61236 repo-hours, 803 releases; waiting 553 ms; commit 0 ms)
2026-11-08T07:56:57Z [load_day 2024-09-16] 2024-09-16 hour 6: 196775 events in 0 files, snapshot none (task 8675 ms: download 5623 ms overlapping gunzip 1506 ms, parse 5779 ms, sort 0 ms, write 0 ms, index 650 ms: 8 candidates, 84310 repo-hours, 938 releases; waiting 480 ms; commit 0 ms)
2026-11-08T07:56:57Z [load_day 2024-09-16] 2024-09-16 hour 7: 206783 events in 0 files, snapshot none (task 9037 ms: download 5984 ms overlapping gunzip 1600 ms, parse 6149 ms, sort 0 ms, write 0 ms, index 631 ms: 8 candidates, 78216 repo-hours, 937 releases; waiting 309 ms; commit 0 ms)
2026-11-08T07:57:07Z [load_day 2024-09-16] 2024-09-16 hour 8: 219431 events in 0 files, snapshot none (task 9573 ms: download 6603 ms overlapping gunzip 1675 ms, parse 6583 ms, sort 0 ms, write 0 ms, index 834 ms: 5 candidates, 86128 repo-hours, 1232 releases; waiting 208 ms; commit 0 ms)
2026-11-08T07:57:09Z [load_day 2024-09-16] 2024-09-16 hour 9: 230947 events in 0 files, snapshot none (task 10997 ms: download 8329 ms overlapping gunzip 1796 ms, parse 7557 ms, sort 0 ms, write 0 ms, index 810 ms: 7 candidates, 93218 repo-hours, 1348 releases; waiting 513 ms; commit 0 ms)
2026-11-08T07:57:15Z [load_day 2024-09-16] 2024-09-16 hour 10: 222179 events in 0 files, snapshot none (task 7969 ms: download 5524 ms overlapping gunzip 1300 ms, parse 5163 ms, sort 0 ms, write 0 ms, index 632 ms: 10 candidates, 87696 repo-hours, 1146 releases; waiting 579 ms; commit 0 ms)
2026-11-08T07:57:17Z [load_day 2024-09-16] 2024-09-16 hour 11: 226661 events in 0 files, snapshot none (task 7657 ms: download 5202 ms overlapping gunzip 1283 ms, parse 5101 ms, sort 0 ms, write 0 ms, index 625 ms: 14 candidates, 87382 repo-hours, 1209 releases; waiting 328 ms; commit 0 ms)
2026-11-08T07:57:26Z [load_day 2024-09-16] 2024-09-16 hour 12: 276073 events in 0 files, snapshot none (task 10433 ms: download 7225 ms overlapping gunzip 1641 ms, parse 6900 ms, sort 0 ms, write 0 ms, index 1170 ms: 12 candidates, 133162 repo-hours, 1394 releases; waiting 506 ms; commit 0 ms)
2026-11-08T07:57:27Z [load_day 2024-09-16] 2024-09-16 hour 13: 264324 events in 0 files, snapshot none (task 9817 ms: download 7084 ms overlapping gunzip 1565 ms, parse 6638 ms, sort 0 ms, write 0 ms, index 821 ms: 9 candidates, 118546 repo-hours, 1442 releases; waiting 498 ms; commit 0 ms)
2026-11-08T07:57:39Z [load_day 2024-09-16] 2024-09-16 hour 14: 259957 events in 0 files, snapshot none (task 11696 ms: download 8089 ms overlapping gunzip 1912 ms, parse 7782 ms, sort 0 ms, write 0 ms, index 1198 ms: 9 candidates, 106867 repo-hours, 1424 releases; waiting 519 ms; commit 0 ms)
2026-11-08T07:57:40Z [load_day 2024-09-16] 2024-09-16 hour 15: 257299 events in 0 files, snapshot none (task 12656 ms: download 8375 ms overlapping gunzip 2081 ms, parse 8620 ms, sort 0 ms, write 0 ms, index 1075 ms: 14 candidates, 109725 repo-hours, 1522 releases; waiting 539 ms; commit 0 ms)
2026-11-08T07:57:51Z [load_day 2024-09-16] 2024-09-16 hour 16: 239301 events in 0 files, snapshot none (task 11430 ms: download 8266 ms overlapping gunzip 1906 ms, parse 7798 ms, sort 0 ms, write 0 ms, index 859 ms: 8 candidates, 99524 repo-hours, 1190 releases; waiting 524 ms; commit 0 ms)
2026-11-08T07:57:51Z [load_day 2024-09-16] 2024-09-16 hour 17: 225823 events in 0 files, snapshot none (task 10569 ms: download 7877 ms overlapping gunzip 1916 ms, parse 7473 ms, sort 0 ms, write 0 ms, index 645 ms: 6 candidates, 91402 repo-hours, 1081 releases; waiting 218 ms; commit 0 ms)
2026-11-08T07:58:01Z [load_day 2024-09-16] 2024-09-16 hour 18: 235849 events in 0 files, snapshot none (task 10377 ms: download 7231 ms overlapping gunzip 1772 ms, parse 6851 ms, sort 0 ms, write 0 ms, index 882 ms: 12 candidates, 104053 repo-hours, 1283 releases; waiting 516 ms; commit 0 ms)
2026-11-08T07:58:02Z [load_day 2024-09-16] 2024-09-16 hour 19: 222235 events in 0 files, snapshot none (task 10055 ms: download 7524 ms overlapping gunzip 1703 ms, parse 6963 ms, sort 0 ms, write 0 ms, index 630 ms: 6 candidates, 84141 repo-hours, 1186 releases; waiting 500 ms; commit 0 ms)
2026-11-08T07:58:12Z [load_day 2024-09-16] 2024-09-16 hour 20: 214589 events in 0 files, snapshot none (task 10240 ms: download 7893 ms overlapping gunzip 1771 ms, parse 6881 ms, sort 0 ms, write 0 ms, index 587 ms: 12 candidates, 84002 repo-hours, 1002 releases; waiting 756 ms; commit 0 ms)
2026-11-08T07:58:12Z [load_day 2024-09-16] 2024-09-16 hour 21: 177881 events in 0 files, snapshot none (task 8739 ms: download 6093 ms overlapping gunzip 1433 ms, parse 5822 ms, sort 0 ms, write 0 ms, index 602 ms: 13 candidates, 74358 repo-hours, 817 releases; waiting 556 ms; commit 0 ms)
2026-11-08T07:58:21Z [load_day 2024-09-16] 2024-09-16 hour 22: 183834 events in 0 files, snapshot none (task 8620 ms: download 6010 ms overlapping gunzip 1509 ms, parse 5956 ms, sort 0 ms, write 0 ms, index 605 ms: 11 candidates, 66417 repo-hours, 1028 releases; waiting 336 ms; commit 0 ms)
2026-11-08T07:58:21Z [load_day 2024-09-16] 2024-09-16 hour 23: 172563 events in 0 files, snapshot none (task 8647 ms: download 5761 ms overlapping gunzip 1492 ms, parse 5777 ms, sort 0 ms, write 0 ms, index 598 ms: 16 candidates, 62008 repo-hours, 891 releases; waiting 491 ms; commit 0 ms)
2026-11-08T07:58:31Z [load_day 2024-09-16] 2024-09-16: repo_hour merged from 24 files to 1 (2079821 rows, 9586 ms)
2026-11-08T07:58:33Z [load_day 2024-09-16] 2024-09-16: index committed in 12039 ms (24 + 1 + 24 files)
2026-11-08T07:58:33Z [load_day 2024-09-16] 2024-09-16: 5031874 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:58:33Z [load_day 2024-09-16] attempt 1 succeeded