orcaLog in

Runs · run 2370

load_day 2024-04-25, attempt 1 succeeded

Host
73ccef5e07c2:114065
Started
2026-11-08T05:47:05Z
Ended
2026-11-08T05:49:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
726 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
206.7 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2370/load_day/2024-04-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:47:05Z [load_day 2024-04-25] attempt 1 started
2026-11-08T05:47:06Z [load_day 2024-04-25] 2024-04-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:47:14Z [load_day 2024-04-25] 2024-04-25 hour 0: 185825 events in 0 files, snapshot none (task 7398 ms: download 4091 ms overlapping gunzip 1095 ms, parse 5005 ms, sort 0 ms, write 0 ms, index 845 ms: 6 candidates, 89310 repo-hours, 1068 releases; waiting 172 ms; commit 0 ms)
2026-11-08T05:47:14Z [load_day 2024-04-25] 2024-04-25 hour 1: 200976 events in 0 files, snapshot none (task 7657 ms: download 4448 ms overlapping gunzip 1123 ms, parse 4773 ms, sort 0 ms, write 0 ms, index 891 ms: 7 candidates, 102919 repo-hours, 891 releases; waiting 519 ms; commit 0 ms)
2026-11-08T05:47:21Z [load_day 2024-04-25] 2024-04-25 hour 2: 176324 events in 0 files, snapshot none (task 7093 ms: download 4374 ms overlapping gunzip 1058 ms, parse 4570 ms, sort 0 ms, write 0 ms, index 606 ms: 8 candidates, 70589 repo-hours, 825 releases; waiting 489 ms; commit 0 ms)
2026-11-08T05:47:22Z [load_day 2024-04-25] 2024-04-25 hour 3: 187355 events in 0 files, snapshot none (task 7056 ms: download 4526 ms overlapping gunzip 1046 ms, parse 4517 ms, sort 0 ms, write 0 ms, index 615 ms: 7 candidates, 69461 repo-hours, 2108 releases; waiting 572 ms; commit 0 ms)
2026-11-08T05:47:29Z [load_day 2024-04-25] 2024-04-25 hour 4: 170115 events in 0 files, snapshot none (task 7062 ms: download 4010 ms overlapping gunzip 1095 ms, parse 4669 ms, sort 0 ms, write 0 ms, index 555 ms: 9 candidates, 62434 repo-hours, 755 releases; waiting 480 ms; commit 0 ms)
2026-11-08T05:47:31Z [load_day 2024-04-25] 2024-04-25 hour 5: 185114 events in 0 files, snapshot none (task 8625 ms: download 5918 ms overlapping gunzip 1537 ms, parse 5784 ms, sort 0 ms, write 0 ms, index 688 ms: 9 candidates, 69553 repo-hours, 966 releases; waiting 359 ms; commit 0 ms)
2026-11-08T05:47:38Z [load_day 2024-04-25] 2024-04-25 hour 6: 217270 events in 0 files, snapshot none (task 8357 ms: download 5231 ms overlapping gunzip 1273 ms, parse 5282 ms, sort 0 ms, write 0 ms, index 1020 ms: 8 candidates, 87877 repo-hours, 1341 releases; waiting 510 ms; commit 0 ms)
2026-11-08T05:47:41Z [load_day 2024-04-25] 2024-04-25 hour 7: 225109 events in 0 files, snapshot none (task 9409 ms: download 6534 ms overlapping gunzip 1449 ms, parse 6460 ms, sort 0 ms, write 0 ms, index 749 ms: 10 candidates, 87480 repo-hours, 1449 releases; waiting 516 ms; commit 0 ms)
2026-11-08T05:47:48Z [load_day 2024-04-25] 2024-04-25 hour 8: 241000 events in 0 files, snapshot none (task 9833 ms: download 6396 ms overlapping gunzip 1474 ms, parse 6838 ms, sort 0 ms, write 0 ms, index 852 ms: 20 candidates, 94571 repo-hours, 1265 releases; waiting 304 ms; commit 0 ms)
2026-11-08T05:47:53Z [load_day 2024-04-25] 2024-04-25 hour 9: 245253 events in 0 files, snapshot none (task 11817 ms: download 7004 ms overlapping gunzip 1564 ms, parse 6702 ms, sort 0 ms, write 0 ms, index 2828 ms: 15 candidates, 95180 repo-hours, 1375 releases; waiting 457 ms; commit 0 ms)
2026-11-08T05:47:59Z [load_day 2024-04-25] 2024-04-25 hour 10: 231058 events in 0 files, snapshot none (task 10212 ms: download 4935 ms overlapping gunzip 1163 ms, parse 4974 ms, sort 0 ms, write 0 ms, index 3297 ms: 6 candidates, 91079 repo-hours, 1288 releases; waiting 495 ms; commit 0 ms)
2026-11-08T05:48:02Z [load_day 2024-04-25] 2024-04-25 hour 11: 233373 events in 0 files, snapshot none (task 8137 ms: download 5407 ms overlapping gunzip 1260 ms, parse 5295 ms, sort 0 ms, write 0 ms, index 738 ms: 21 candidates, 88585 repo-hours, 1283 releases; waiting 489 ms; commit 0 ms)
2026-11-08T05:48:10Z [load_day 2024-04-25] 2024-04-25 hour 12: 300894 events in 0 files, snapshot none (task 10451 ms: download 5534 ms overlapping gunzip 1370 ms, parse 6226 ms, sort 0 ms, write 0 ms, index 2052 ms: 15 candidates, 123496 repo-hours, 1220 releases; waiting 513 ms; commit 0 ms)
2026-11-08T05:48:13Z [load_day 2024-04-25] 2024-04-25 hour 13: 271457 events in 0 files, snapshot none (task 10626 ms: download 7686 ms overlapping gunzip 1572 ms, parse 7368 ms, sort 0 ms, write 0 ms, index 868 ms: 16 candidates, 114575 repo-hours, 1273 releases; waiting 514 ms; commit 0 ms)
2026-11-08T05:48:22Z [load_day 2024-04-25] 2024-04-25 hour 14: 272129 events in 0 files, snapshot none (task 11552 ms: download 8526 ms overlapping gunzip 1816 ms, parse 8100 ms, sort 0 ms, write 0 ms, index 804 ms: 13 candidates, 103605 repo-hours, 1340 releases; waiting 496 ms; commit 0 ms)
2026-11-08T05:48:25Z [load_day 2024-04-25] 2024-04-25 hour 15: 265923 events in 0 files, snapshot none (task 12038 ms: download 8384 ms overlapping gunzip 1816 ms, parse 8169 ms, sort 0 ms, write 0 ms, index 1279 ms: 14 candidates, 105107 repo-hours, 1373 releases; waiting 489 ms; commit 0 ms)
2026-11-08T05:48:32Z [load_day 2024-04-25] 2024-04-25 hour 16: 254501 events in 0 files, snapshot none (task 9675 ms: download 6662 ms overlapping gunzip 1459 ms, parse 6452 ms, sort 0 ms, write 0 ms, index 905 ms: 19 candidates, 95546 repo-hours, 1183 releases; waiting 540 ms; commit 0 ms)
2026-11-08T05:48:36Z [load_day 2024-04-25] 2024-04-25 hour 17: 249333 events in 0 files, snapshot none (task 10048 ms: download 6692 ms overlapping gunzip 1385 ms, parse 6907 ms, sort 0 ms, write 0 ms, index 944 ms: 17 candidates, 89016 repo-hours, 1071 releases; waiting 506 ms; commit 0 ms)
2026-11-08T05:48:42Z [load_day 2024-04-25] 2024-04-25 hour 18: 247135 events in 0 files, snapshot none (task 9275 ms: download 5851 ms overlapping gunzip 1373 ms, parse 6059 ms, sort 0 ms, write 0 ms, index 1052 ms: 11 candidates, 98445 repo-hours, 1211 releases; waiting 511 ms; commit 0 ms)
2026-11-08T05:48:46Z [load_day 2024-04-25] 2024-04-25 hour 19: 229466 events in 0 files, snapshot none (task 9867 ms: download 6710 ms overlapping gunzip 1443 ms, parse 6450 ms, sort 0 ms, write 0 ms, index 959 ms: 18 candidates, 83358 repo-hours, 1074 releases; waiting 683 ms; commit 0 ms)
2026-11-08T05:48:51Z [load_day 2024-04-25] 2024-04-25 hour 20: 237784 events in 0 files, snapshot none (task 7556 ms: download 5031 ms overlapping gunzip 1139 ms, parse 4962 ms, sort 0 ms, write 0 ms, index 612 ms: 6 candidates, 78880 repo-hours, 1206 releases; waiting 528 ms; commit 0 ms)
2026-11-08T05:48:53Z [load_day 2024-04-25] 2024-04-25 hour 21: 217151 events in 0 files, snapshot none (task 6496 ms: download 4138 ms overlapping gunzip 980 ms, parse 4180 ms, sort 0 ms, write 0 ms, index 514 ms: 12 candidates, 72842 repo-hours, 1019 releases; waiting 524 ms; commit 0 ms)
2026-11-08T05:49:12Z [load_day 2024-04-25] 2024-04-25 hour 22: 182488 events in 0 files, snapshot none (task 9258 ms: download 6439 ms overlapping gunzip 1359 ms, parse 6029 ms, sort 0 ms, write 0 ms, index 486 ms: 2 candidates, 62907 repo-hours, 976 releases; waiting 1159 ms; commit 0 ms)
2026-11-08T05:49:12Z [load_day 2024-04-25] 2024-04-25 hour 23: 171965 events in 0 files, snapshot none (task 8682 ms: download 5263 ms overlapping gunzip 1347 ms, parse 5872 ms, sort 0 ms, write 0 ms, index 605 ms: 7 candidates, 60348 repo-hours, 815 releases; waiting 502 ms; commit 0 ms)
2026-11-08T05:49:22Z [load_day 2024-04-25] 2024-04-25: repo_hour merged from 24 files to 1 (2097163 rows, 9641 ms)
2026-11-08T05:49:24Z [load_day 2024-04-25] 2024-04-25: index committed in 11901 ms (24 + 1 + 24 files)
2026-11-08T05:49:24Z [load_day 2024-04-25] 2024-04-25: 5398998 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:49:24Z [load_day 2024-04-25] attempt 1 succeeded