orcaLog in

Runs · run 1854

load_day 2023-12-13, attempt 1 succeeded

Host
73ccef5e07c2:9390
Started
2026-11-08T03:44:50Z
Ended
2026-11-08T03:46:37Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
700 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
169.4 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1854/load_day/2023-12-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T03:44:50Z [load_day 2023-12-13] attempt 1 started
2026-11-08T03:44:51Z [load_day 2023-12-13] 2023-12-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T03:44:57Z [load_day 2023-12-13] 2023-12-13 hour 0: 170459 events in 0 files, snapshot none (task 5814 ms: download 3265 ms overlapping gunzip 823 ms, parse 3489 ms, sort 0 ms, write 0 ms, index 675 ms: 10 candidates, 88127 repo-hours, 986 releases; waiting 540 ms; commit 0 ms)
2026-11-08T03:44:57Z [load_day 2023-12-13] 2023-12-13 hour 1: 171512 events in 0 files, snapshot none (task 5471 ms: download 2979 ms overlapping gunzip 779 ms, parse 3310 ms, sort 0 ms, write 0 ms, index 656 ms: 10 candidates, 96035 repo-hours, 887 releases; waiting 491 ms; commit 0 ms)
2026-11-08T03:45:02Z [load_day 2023-12-13] 2023-12-13 hour 2: 142972 events in 0 files, snapshot none (task 4750 ms: download 2403 ms overlapping gunzip 676 ms, parse 2721 ms, sort 0 ms, write 0 ms, index 562 ms: 17 candidates, 63588 repo-hours, 825 releases; waiting 536 ms; commit 0 ms)
2026-11-08T03:45:02Z [load_day 2023-12-13] 2023-12-13 hour 3: 144737 events in 0 files, snapshot none (task 4663 ms: download 2324 ms overlapping gunzip 655 ms, parse 2735 ms, sort 0 ms, write 0 ms, index 499 ms: 5 candidates, 63457 repo-hours, 924 releases; waiting 518 ms; commit 0 ms)
2026-11-08T03:45:08Z [load_day 2023-12-13] 2023-12-13 hour 4: 135822 events in 0 files, snapshot none (task 4968 ms: download 2612 ms overlapping gunzip 721 ms, parse 3016 ms, sort 0 ms, write 0 ms, index 470 ms: 3 candidates, 58508 repo-hours, 571 releases; waiting 462 ms; commit 0 ms)
2026-11-08T03:45:09Z [load_day 2023-12-13] 2023-12-13 hour 5: 146223 events in 0 files, snapshot none (task 5430 ms: download 3065 ms overlapping gunzip 817 ms, parse 3504 ms, sort 0 ms, write 0 ms, index 444 ms: 7 candidates, 63996 repo-hours, 836 releases; waiting 448 ms; commit 0 ms)
2026-11-08T03:45:14Z [load_day 2023-12-13] 2023-12-13 hour 6: 164310 events in 0 files, snapshot none (task 5843 ms: download 3392 ms overlapping gunzip 865 ms, parse 3570 ms, sort 0 ms, write 0 ms, index 527 ms: 7 candidates, 76710 repo-hours, 880 releases; waiting 562 ms; commit 0 ms)
2026-11-08T03:45:16Z [load_day 2023-12-13] 2023-12-13 hour 7: 168673 events in 0 files, snapshot none (task 6735 ms: download 4371 ms overlapping gunzip 1070 ms, parse 4352 ms, sort 0 ms, write 0 ms, index 520 ms: 9 candidates, 76779 repo-hours, 839 releases; waiting 486 ms; commit 0 ms)
2026-11-08T03:45:22Z [load_day 2023-12-13] 2023-12-13 hour 8: 186584 events in 0 files, snapshot none (task 7536 ms: download 4941 ms overlapping gunzip 1092 ms, parse 4710 ms, sort 0 ms, write 0 ms, index 654 ms: 13 candidates, 84729 repo-hours, 1064 releases; waiting 761 ms; commit 0 ms)
2026-11-08T03:45:24Z [load_day 2023-12-13] 2023-12-13 hour 9: 200663 events in 0 files, snapshot none (task 8049 ms: download 5223 ms overlapping gunzip 1226 ms, parse 5141 ms, sort 0 ms, write 0 ms, index 841 ms: 5 candidates, 89016 repo-hours, 1276 releases; waiting 516 ms; commit 0 ms)
2026-11-08T03:45:31Z [load_day 2023-12-13] 2023-12-13 hour 10: 198934 events in 0 files, snapshot none (task 7833 ms: download 4435 ms overlapping gunzip 1224 ms, parse 5043 ms, sort 0 ms, write 0 ms, index 734 ms: 11 candidates, 89321 repo-hours, 1127 releases; waiting 518 ms; commit 0 ms)
2026-11-08T03:45:33Z [load_day 2023-12-13] 2023-12-13 hour 11: 196797 events in 0 files, snapshot none (task 8471 ms: download 5124 ms overlapping gunzip 1278 ms, parse 5380 ms, sort 0 ms, write 0 ms, index 949 ms: 8 candidates, 84775 repo-hours, 1102 releases; waiting 502 ms; commit 0 ms)
2026-11-08T03:45:39Z [load_day 2023-12-13] 2023-12-13 hour 12: 237180 events in 0 files, snapshot none (task 8026 ms: download 4116 ms overlapping gunzip 1155 ms, parse 5069 ms, sort 0 ms, write 0 ms, index 1593 ms: 8 candidates, 114533 repo-hours, 1118 releases; waiting 21 ms; commit 0 ms)
2026-11-08T03:45:42Z [load_day 2023-12-13] 2023-12-13 hour 13: 226497 events in 0 files, snapshot none (task 8479 ms: download 5544 ms overlapping gunzip 1194 ms, parse 5364 ms, sort 0 ms, write 0 ms, index 1103 ms: 10 candidates, 112505 repo-hours, 1152 releases; waiting 515 ms; commit 0 ms)
2026-11-08T03:45:49Z [load_day 2023-12-13] 2023-12-13 hour 14: 216009 events in 0 files, snapshot none (task 8633 ms: download 5347 ms overlapping gunzip 1246 ms, parse 5408 ms, sort 0 ms, write 0 ms, index 1161 ms: 14 candidates, 98173 repo-hours, 1243 releases; waiting 489 ms; commit 0 ms)
2026-11-08T03:45:53Z [load_day 2023-12-13] 2023-12-13 hour 15: 220227 events in 0 files, snapshot none (task 9997 ms: download 6767 ms overlapping gunzip 1624 ms, parse 6641 ms, sort 0 ms, write 0 ms, index 931 ms: 11 candidates, 99885 repo-hours, 1457 releases; waiting 489 ms; commit 0 ms)
2026-11-08T03:45:58Z [load_day 2023-12-13] 2023-12-13 hour 16: 215658 events in 0 files, snapshot none (task 9083 ms: download 4819 ms overlapping gunzip 1478 ms, parse 5877 ms, sort 0 ms, write 0 ms, index 1209 ms: 4 candidates, 96923 repo-hours, 1206 releases; waiting 222 ms; commit 0 ms)
2026-11-08T03:46:02Z [load_day 2023-12-13] 2023-12-13 hour 17: 200256 events in 0 files, snapshot none (task 8898 ms: download 5742 ms overlapping gunzip 1378 ms, parse 5903 ms, sort 0 ms, write 0 ms, index 824 ms: 9 candidates, 87944 repo-hours, 1056 releases; waiting 518 ms; commit 0 ms)
2026-11-08T03:46:07Z [load_day 2023-12-13] 2023-12-13 hour 18: 203131 events in 0 files, snapshot none (task 7761 ms: download 4612 ms overlapping gunzip 1208 ms, parse 4916 ms, sort 0 ms, write 0 ms, index 812 ms: 7 candidates, 89795 repo-hours, 1159 releases; waiting 523 ms; commit 0 ms)
2026-11-08T03:46:11Z [load_day 2023-12-13] 2023-12-13 hour 19: 184853 events in 0 files, snapshot none (task 8223 ms: download 4838 ms overlapping gunzip 1250 ms, parse 5200 ms, sort 0 ms, write 0 ms, index 855 ms: 9 candidates, 77488 repo-hours, 1409 releases; waiting 514 ms; commit 0 ms)
2026-11-08T03:46:15Z [load_day 2023-12-13] 2023-12-13 hour 20: 180514 events in 0 files, snapshot none (task 7689 ms: download 4861 ms overlapping gunzip 1168 ms, parse 4800 ms, sort 0 ms, write 0 ms, index 1006 ms: 2 candidates, 76106 repo-hours, 1063 releases; waiting 491 ms; commit 0 ms)
2026-11-08T03:46:19Z [load_day 2023-12-13] 2023-12-13 hour 21: 170463 events in 0 files, snapshot none (task 8125 ms: download 4983 ms overlapping gunzip 1236 ms, parse 5063 ms, sort 0 ms, write 0 ms, index 805 ms: 8 candidates, 69696 repo-hours, 1053 releases; waiting 647 ms; commit 0 ms)
2026-11-08T03:46:22Z [load_day 2023-12-13] 2023-12-13 hour 22: 160475 events in 0 files, snapshot none (task 6314 ms: download 4025 ms overlapping gunzip 982 ms, parse 3980 ms, sort 0 ms, write 0 ms, index 541 ms: 5 candidates, 65553 repo-hours, 944 releases; waiting 526 ms; commit 0 ms)
2026-11-08T03:46:26Z [load_day 2023-12-13] 2023-12-13 hour 23: 148216 events in 0 files, snapshot none (task 6104 ms: download 3786 ms overlapping gunzip 930 ms, parse 3856 ms, sort 0 ms, write 0 ms, index 476 ms: 4 candidates, 60345 repo-hours, 804 releases; waiting 647 ms; commit 0 ms)
2026-11-08T03:46:34Z [load_day 2023-12-13] 2023-12-13: repo_hour merged from 24 files to 1 (1983987 rows, 8328 ms)
2026-11-08T03:46:37Z [load_day 2023-12-13] 2023-12-13: index committed in 10809 ms (24 + 1 + 24 files)
2026-11-08T03:46:37Z [load_day 2023-12-13] 2023-12-13: 4391165 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T03:46:37Z [load_day 2023-12-13] attempt 1 succeeded