orcaLog in

Runs · run 3763

load_day 2025-04-07, attempt 1 succeeded

Host
73ccef5e07c2:284359
Started
2026-11-08T11:17:17Z
Ended
2026-11-08T11:19:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
949 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
243.5 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3763/load_day/2025-04-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:17:17Z [load_day 2025-04-07] attempt 1 started
2026-11-08T11:17:18Z [load_day 2025-04-07] 2025-04-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:17:27Z [load_day 2025-04-07] 2025-04-07 hour 0: 200860 events in 0 files, snapshot none (task 8878 ms: download 5449 ms overlapping gunzip 1434 ms, parse 5740 ms, sort 0 ms, write 0 ms, index 862 ms: 11 candidates, 88104 repo-hours, 1380 releases; waiting 517 ms; commit 0 ms)
2026-11-08T11:17:28Z [load_day 2025-04-07] 2025-04-07 hour 1: 237075 events in 0 files, snapshot none (task 9989 ms: download 6768 ms overlapping gunzip 1655 ms, parse 6530 ms, sort 0 ms, write 0 ms, index 998 ms: 4 candidates, 124635 repo-hours, 1067 releases; waiting 528 ms; commit 0 ms)
2026-11-08T11:17:37Z [load_day 2025-04-07] 2025-04-07 hour 2: 205192 events in 0 files, snapshot none (task 9448 ms: download 6047 ms overlapping gunzip 1569 ms, parse 6083 ms, sort 0 ms, write 0 ms, index 841 ms: 4 candidates, 85022 repo-hours, 899 releases; waiting 585 ms; commit 0 ms)
2026-11-08T11:17:38Z [load_day 2025-04-07] 2025-04-07 hour 3: 218309 events in 0 files, snapshot none (task 9323 ms: download 6657 ms overlapping gunzip 1572 ms, parse 6245 ms, sort 0 ms, write 0 ms, index 710 ms: 6 candidates, 87286 repo-hours, 2954 releases; waiting 534 ms; commit 0 ms)
2026-11-08T11:17:46Z [load_day 2025-04-07] 2025-04-07 hour 4: 201314 events in 0 files, snapshot none (task 8739 ms: download 4911 ms overlapping gunzip 1318 ms, parse 5241 ms, sort 0 ms, write 0 ms, index 1414 ms: 3 candidates, 73411 repo-hours, 814 releases; waiting 519 ms; commit 0 ms)
2026-11-08T11:17:48Z [load_day 2025-04-07] 2025-04-07 hour 5: 217572 events in 0 files, snapshot none (task 9264 ms: download 6651 ms overlapping gunzip 1538 ms, parse 6203 ms, sort 0 ms, write 0 ms, index 728 ms: 4 candidates, 82539 repo-hours, 855 releases; waiting 538 ms; commit 0 ms)
2026-11-08T11:17:58Z [load_day 2025-04-07] 2025-04-07 hour 6: 244607 events in 0 files, snapshot none (task 10847 ms: download 7351 ms overlapping gunzip 1795 ms, parse 7141 ms, sort 0 ms, write 0 ms, index 1119 ms: 5 candidates, 106486 repo-hours, 1098 releases; waiting 502 ms; commit 0 ms)
2026-11-08T11:18:00Z [load_day 2025-04-07] 2025-04-07 hour 7: 248828 events in 0 files, snapshot none (task 11496 ms: download 8917 ms overlapping gunzip 2008 ms, parse 7959 ms, sort 0 ms, write 0 ms, index 825 ms: 8 candidates, 97850 repo-hours, 1043 releases; waiting 436 ms; commit 0 ms)
2026-11-08T11:18:11Z [load_day 2025-04-07] 2025-04-07 hour 8: 255356 events in 0 files, snapshot none (task 12370 ms: download 8988 ms overlapping gunzip 2031 ms, parse 8252 ms, sort 0 ms, write 0 ms, index 1127 ms: 9 candidates, 106753 repo-hours, 1276 releases; waiting 684 ms; commit 0 ms)
2026-11-08T11:18:13Z [load_day 2025-04-07] 2025-04-07 hour 9: 264261 events in 0 files, snapshot none (task 12383 ms: download 9705 ms overlapping gunzip 2250 ms, parse 8438 ms, sort 0 ms, write 0 ms, index 870 ms: 10 candidates, 109385 repo-hours, 1411 releases; waiting 542 ms; commit 0 ms)
2026-11-08T11:18:24Z [load_day 2025-04-07] 2025-04-07 hour 10: 256100 events in 0 files, snapshot none (task 12728 ms: download 9657 ms overlapping gunzip 2299 ms, parse 8737 ms, sort 0 ms, write 0 ms, index 805 ms: 11 candidates, 106005 repo-hours, 1133 releases; waiting 547 ms; commit 0 ms)
2026-11-08T11:18:25Z [load_day 2025-04-07] 2025-04-07 hour 11: 258389 events in 0 files, snapshot none (task 11692 ms: download 9047 ms overlapping gunzip 1953 ms, parse 8096 ms, sort 0 ms, write 0 ms, index 860 ms: 12 candidates, 100527 repo-hours, 1143 releases; waiting 495 ms; commit 0 ms)
2026-11-08T11:18:37Z [load_day 2025-04-07] 2025-04-07 hour 12: 283296 events in 0 files, snapshot none (task 12855 ms: download 9540 ms overlapping gunzip 2142 ms, parse 8868 ms, sort 0 ms, write 0 ms, index 1224 ms: 12 candidates, 142342 repo-hours, 1403 releases; waiting 220 ms; commit 0 ms)
2026-11-08T11:18:38Z [load_day 2025-04-07] 2025-04-07 hour 13: 277011 events in 0 files, snapshot none (task 12433 ms: download 9379 ms overlapping gunzip 2088 ms, parse 8553 ms, sort 0 ms, write 0 ms, index 1084 ms: 10 candidates, 129641 repo-hours, 1225 releases; waiting 468 ms; commit 0 ms)
2026-11-08T11:18:50Z [load_day 2025-04-07] 2025-04-07 hour 14: 273038 events in 0 files, snapshot none (task 12272 ms: download 9493 ms overlapping gunzip 2013 ms, parse 8519 ms, sort 0 ms, write 0 ms, index 891 ms: 10 candidates, 117285 repo-hours, 1284 releases; waiting 546 ms; commit 0 ms)
2026-11-08T11:18:52Z [load_day 2025-04-07] 2025-04-07 hour 15: 272333 events in 0 files, snapshot none (task 13161 ms: download 10050 ms overlapping gunzip 2224 ms, parse 8909 ms, sort 0 ms, write 0 ms, index 1270 ms: 4 candidates, 120074 repo-hours, 1432 releases; waiting 497 ms; commit 0 ms)
2026-11-08T11:19:02Z [load_day 2025-04-07] 2025-04-07 hour 16: 269679 events in 0 files, snapshot none (task 11315 ms: download 8409 ms overlapping gunzip 1889 ms, parse 7630 ms, sort 0 ms, write 0 ms, index 929 ms: 11 candidates, 113832 repo-hours, 1114 releases; waiting 532 ms; commit 0 ms)
2026-11-08T11:19:03Z [load_day 2025-04-07] 2025-04-07 hour 17: 263661 events in 0 files, snapshot none (task 10805 ms: download 7833 ms overlapping gunzip 1806 ms, parse 7047 ms, sort 0 ms, write 0 ms, index 1113 ms: 7 candidates, 107574 repo-hours, 1075 releases; waiting 501 ms; commit 0 ms)
2026-11-08T11:19:14Z [load_day 2025-04-07] 2025-04-07 hour 18: 268484 events in 0 files, snapshot none (task 11569 ms: download 7853 ms overlapping gunzip 1812 ms, parse 7574 ms, sort 0 ms, write 0 ms, index 1384 ms: 8 candidates, 119313 repo-hours, 1269 releases; waiting 490 ms; commit 0 ms)
2026-11-08T11:19:15Z [load_day 2025-04-07] 2025-04-07 hour 19: 256441 events in 0 files, snapshot none (task 10632 ms: download 7719 ms overlapping gunzip 1827 ms, parse 7253 ms, sort 0 ms, write 0 ms, index 787 ms: 5 candidates, 101436 repo-hours, 1231 releases; waiting 513 ms; commit 0 ms)
2026-11-08T11:19:25Z [load_day 2025-04-07] 2025-04-07 hour 20: 248128 events in 0 files, snapshot none (task 10550 ms: download 7641 ms overlapping gunzip 1698 ms, parse 7129 ms, sort 0 ms, write 0 ms, index 712 ms: 4 candidates, 99222 repo-hours, 1271 releases; waiting 710 ms; commit 0 ms)
2026-11-08T11:19:25Z [load_day 2025-04-07] 2025-04-07 hour 21: 234153 events in 0 files, snapshot none (task 9650 ms: download 6403 ms overlapping gunzip 1399 ms, parse 6235 ms, sort 0 ms, write 0 ms, index 873 ms: 8 candidates, 92319 repo-hours, 1421 releases; waiting 499 ms; commit 0 ms)
2026-11-08T11:19:33Z [load_day 2025-04-07] 2025-04-07 hour 22: 218801 events in 0 files, snapshot none (task 7466 ms: download 5057 ms overlapping gunzip 1261 ms, parse 4982 ms, sort 0 ms, write 0 ms, index 631 ms: 8 candidates, 81926 repo-hours, 1053 releases; waiting 274 ms; commit 0 ms)
2026-11-08T11:19:33Z [load_day 2025-04-07] 2025-04-07 hour 23: 211194 events in 0 files, snapshot none (task 7143 ms: download 4880 ms overlapping gunzip 1167 ms, parse 4412 ms, sort 0 ms, write 0 ms, index 622 ms: 8 candidates, 80953 repo-hours, 1052 releases; waiting 646 ms; commit 0 ms)
2026-11-08T11:19:44Z [load_day 2025-04-07] 2025-04-07: repo_hour merged from 24 files to 1 (2473920 rows, 10622 ms)
2026-11-08T11:19:47Z [load_day 2025-04-07] 2025-04-07: index committed in 13536 ms (24 + 1 + 24 files)
2026-11-08T11:19:47Z [load_day 2025-04-07] 2025-04-07: 5884082 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:19:47Z [load_day 2025-04-07] attempt 1 succeeded