orcaLog in

Runs · run 1971

load_day 2024-01-15, attempt 1 succeeded

Host
73ccef5e07c2:23904
Started
2026-11-08T04:09:08Z
Ended
2026-11-08T04:11:14Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
684 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
183.0 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1971/load_day/2024-01-15/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:09:09Z [load_day 2024-01-15] attempt 1 started
2026-11-08T04:09:10Z [load_day 2024-01-15] 2024-01-15: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:09:18Z [load_day 2024-01-15] 2024-01-15 hour 0: 197313 events in 0 files, snapshot none (task 7493 ms: download 4424 ms overlapping gunzip 1111 ms, parse 4780 ms, sort 0 ms, write 0 ms, index 781 ms: 9 candidates, 74968 repo-hours, 945 releases; waiting 480 ms; commit 0 ms)
2026-11-08T04:09:19Z [load_day 2024-01-15] 2024-01-15 hour 1: 213965 events in 0 files, snapshot none (task 8313 ms: download 5233 ms overlapping gunzip 1255 ms, parse 5245 ms, sort 0 ms, write 0 ms, index 1010 ms: 5 candidates, 88445 repo-hours, 801 releases; waiting 525 ms; commit 0 ms)
2026-11-08T04:09:26Z [load_day 2024-01-15] 2024-01-15 hour 2: 190656 events in 0 files, snapshot none (task 7515 ms: download 3756 ms overlapping gunzip 1216 ms, parse 4736 ms, sort 0 ms, write 0 ms, index 699 ms: 5 candidates, 61323 repo-hours, 780 releases; waiting 539 ms; commit 0 ms)
2026-11-08T04:09:26Z [load_day 2024-01-15] 2024-01-15 hour 3: 189329 events in 0 files, snapshot none (task 7351 ms: download 4079 ms overlapping gunzip 1208 ms, parse 4932 ms, sort 0 ms, write 0 ms, index 445 ms: 8 candidates, 57471 repo-hours, 813 releases; waiting 481 ms; commit 0 ms)
2026-11-08T04:09:33Z [load_day 2024-01-15] 2024-01-15 hour 4: 189681 events in 0 files, snapshot none (task 7153 ms: download 4682 ms overlapping gunzip 1198 ms, parse 4753 ms, sort 0 ms, write 0 ms, index 388 ms: 6 candidates, 54611 repo-hours, 664 releases; waiting 541 ms; commit 0 ms)
2026-11-08T04:09:35Z [load_day 2024-01-15] 2024-01-15 hour 5: 196338 events in 0 files, snapshot none (task 7948 ms: download 5295 ms overlapping gunzip 1336 ms, parse 5169 ms, sort 0 ms, write 0 ms, index 744 ms: 7 candidates, 59291 repo-hours, 650 releases; waiting 430 ms; commit 0 ms)
2026-11-08T04:09:43Z [load_day 2024-01-15] 2024-01-15 hour 6: 214307 events in 0 files, snapshot none (task 8653 ms: download 5418 ms overlapping gunzip 1351 ms, parse 5724 ms, sort 0 ms, write 0 ms, index 865 ms: 9 candidates, 72272 repo-hours, 989 releases; waiting 450 ms; commit 0 ms)
2026-11-08T04:09:44Z [load_day 2024-01-15] 2024-01-15 hour 7: 221142 events in 0 files, snapshot none (task 8930 ms: download 5521 ms overlapping gunzip 1413 ms, parse 5916 ms, sort 0 ms, write 0 ms, index 847 ms: 12 candidates, 72175 repo-hours, 978 releases; waiting 514 ms; commit 0 ms)
2026-11-08T04:09:54Z [load_day 2024-01-15] 2024-01-15 hour 8: 232058 events in 0 files, snapshot none (task 11354 ms: download 6831 ms overlapping gunzip 1942 ms, parse 7883 ms, sort 0 ms, write 0 ms, index 864 ms: 14 candidates, 80168 repo-hours, 1018 releases; waiting 465 ms; commit 0 ms)
2026-11-08T04:09:56Z [load_day 2024-01-15] 2024-01-15 hour 9: 246225 events in 0 files, snapshot none (task 11332 ms: download 8224 ms overlapping gunzip 1854 ms, parse 7769 ms, sort 0 ms, write 0 ms, index 900 ms: 7 candidates, 85478 repo-hours, 1099 releases; waiting 528 ms; commit 0 ms)
2026-11-08T04:10:05Z [load_day 2024-01-15] 2024-01-15 hour 10: 247199 events in 0 files, snapshot none (task 10084 ms: download 7209 ms overlapping gunzip 1783 ms, parse 7261 ms, sort 0 ms, write 0 ms, index 816 ms: 7 candidates, 86288 repo-hours, 1082 releases; waiting 18 ms; commit 0 ms)
2026-11-08T04:10:07Z [load_day 2024-01-15] 2024-01-15 hour 11: 247580 events in 0 files, snapshot none (task 10069 ms: download 6633 ms overlapping gunzip 1647 ms, parse 6836 ms, sort 0 ms, write 0 ms, index 1344 ms: 5 candidates, 81721 repo-hours, 1020 releases; waiting 21 ms; commit 0 ms)
2026-11-08T04:10:16Z [load_day 2024-01-15] 2024-01-15 hour 12: 286864 events in 0 files, snapshot none (task 9940 ms: download 6369 ms overlapping gunzip 1649 ms, parse 7138 ms, sort 0 ms, write 0 ms, index 906 ms: 3 candidates, 112349 repo-hours, 1176 releases; waiting 31 ms; commit 0 ms)
2026-11-08T04:10:17Z [load_day 2024-01-15] 2024-01-15 hour 13: 272954 events in 0 files, snapshot none (task 9737 ms: download 6957 ms overlapping gunzip 1574 ms, parse 7123 ms, sort 0 ms, write 0 ms, index 837 ms: 11 candidates, 106397 repo-hours, 1048 releases; waiting 9 ms; commit 0 ms)
2026-11-08T04:10:26Z [load_day 2024-01-15] 2024-01-15 hour 14: 267250 events in 0 files, snapshot none (task 10127 ms: download 7045 ms overlapping gunzip 1793 ms, parse 7224 ms, sort 0 ms, write 0 ms, index 904 ms: 5 candidates, 94168 repo-hours, 1154 releases; waiting 4 ms; commit 0 ms)
2026-11-08T04:10:28Z [load_day 2024-01-15] 2024-01-15 hour 15: 266871 events in 0 files, snapshot none (task 10215 ms: download 7029 ms overlapping gunzip 1553 ms, parse 6692 ms, sort 0 ms, write 0 ms, index 1224 ms: 10 candidates, 95020 repo-hours, 1247 releases; waiting 475 ms; commit 0 ms)
2026-11-08T04:10:35Z [load_day 2024-01-15] 2024-01-15 hour 16: 264379 events in 0 files, snapshot none (task 7971 ms: download 5411 ms overlapping gunzip 1374 ms, parse 5657 ms, sort 0 ms, write 0 ms, index 736 ms: 12 candidates, 91976 repo-hours, 1044 releases; waiting 7 ms; commit 0 ms)
2026-11-08T04:10:36Z [load_day 2024-01-15] 2024-01-15 hour 17: 254139 events in 0 files, snapshot none (task 7547 ms: download 4983 ms overlapping gunzip 1324 ms, parse 5337 ms, sort 0 ms, write 0 ms, index 687 ms: 13 candidates, 84376 repo-hours, 961 releases; waiting 3 ms; commit 0 ms)
2026-11-08T04:10:45Z [load_day 2024-01-15] 2024-01-15 hour 18: 256354 events in 0 files, snapshot none (task 9460 ms: download 6447 ms overlapping gunzip 1577 ms, parse 6845 ms, sort 0 ms, write 0 ms, index 814 ms: 12 candidates, 86942 repo-hours, 1164 releases; waiting 24 ms; commit 0 ms)
2026-11-08T04:10:45Z [load_day 2024-01-15] 2024-01-15 hour 19: 234266 events in 0 files, snapshot none (task 8685 ms: download 5893 ms overlapping gunzip 1537 ms, parse 6307 ms, sort 0 ms, write 0 ms, index 654 ms: 13 candidates, 75054 repo-hours, 896 releases; waiting 14 ms; commit 0 ms)
2026-11-08T04:10:54Z [load_day 2024-01-15] 2024-01-15 hour 20: 224465 events in 0 files, snapshot none (task 8901 ms: download 6160 ms overlapping gunzip 1510 ms, parse 6503 ms, sort 0 ms, write 0 ms, index 673 ms: 7 candidates, 72376 repo-hours, 837 releases; waiting 22 ms; commit 0 ms)
2026-11-08T04:10:54Z [load_day 2024-01-15] 2024-01-15 hour 21: 217491 events in 0 files, snapshot none (task 8738 ms: download 6167 ms overlapping gunzip 1568 ms, parse 6412 ms, sort 0 ms, write 0 ms, index 538 ms: 10 candidates, 66200 repo-hours, 937 releases; waiting 14 ms; commit 0 ms)
2026-11-08T04:11:02Z [load_day 2024-01-15] 2024-01-15 hour 22: 205285 events in 0 files, snapshot none (task 7481 ms: download 4980 ms overlapping gunzip 1259 ms, parse 5492 ms, sort 0 ms, write 0 ms, index 511 ms: 5 candidates, 60940 repo-hours, 940 releases; waiting 15 ms; commit 0 ms)
2026-11-08T04:11:02Z [load_day 2024-01-15] 2024-01-15 hour 23: 192190 events in 0 files, snapshot none (task 7111 ms: download 4546 ms overlapping gunzip 1266 ms, parse 5126 ms, sort 0 ms, write 0 ms, index 492 ms: 7 candidates, 55887 repo-hours, 748 releases; waiting 11 ms; commit 0 ms)
2026-11-08T04:11:11Z [load_day 2024-01-15] 2024-01-15: repo_hour merged from 24 files to 1 (1875896 rows, 9465 ms)
2026-11-08T04:11:14Z [load_day 2024-01-15] 2024-01-15: index committed in 11771 ms (24 + 1 + 24 files)
2026-11-08T04:11:14Z [load_day 2024-01-15] 2024-01-15: 5528301 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:11:14Z [load_day 2024-01-15] attempt 1 succeeded