orcaLog in

Runs · run 2749

load_day 2024-07-23, attempt 1 succeeded

Host
73ccef5e07c2:153396
Started
2026-11-08T07:06:43Z
Ended
2026-11-08T07:08:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
839 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
185.9 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2749/load_day/2024-07-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:06:43Z [load_day 2024-07-23] attempt 1 started
2026-11-08T07:06:44Z [load_day 2024-07-23] 2024-07-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:06:52Z [load_day 2024-07-23] 2024-07-23 hour 0: 186858 events in 0 files, snapshot none (task 6943 ms: download 4386 ms overlapping gunzip 1012 ms, parse 4507 ms, sort 0 ms, write 0 ms, index 734 ms: 8 candidates, 99811 repo-hours, 1152 releases; waiting 472 ms; commit 0 ms)
2026-11-08T07:06:52Z [load_day 2024-07-23] 2024-07-23 hour 1: 188905 events in 0 files, snapshot none (task 6598 ms: download 4003 ms overlapping gunzip 960 ms, parse 4155 ms, sort 0 ms, write 0 ms, index 734 ms: 9 candidates, 108950 repo-hours, 778 releases; waiting 473 ms; commit 0 ms)
2026-11-08T07:07:00Z [load_day 2024-07-23] 2024-07-23 hour 2: 164481 events in 0 files, snapshot none (task 6980 ms: download 4191 ms overlapping gunzip 1090 ms, parse 4476 ms, sort 0 ms, write 0 ms, index 589 ms: 5 candidates, 71758 repo-hours, 801 releases; waiting 500 ms; commit 0 ms)
2026-11-08T07:07:00Z [load_day 2024-07-23] 2024-07-23 hour 3: 177217 events in 0 files, snapshot none (task 7510 ms: download 4471 ms overlapping gunzip 1190 ms, parse 4909 ms, sort 0 ms, write 0 ms, index 600 ms: 7 candidates, 78351 repo-hours, 5277 releases; waiting 495 ms; commit 0 ms)
2026-11-08T07:07:09Z [load_day 2024-07-23] 2024-07-23 hour 4: 161804 events in 0 files, snapshot none (task 8610 ms: download 4642 ms overlapping gunzip 1485 ms, parse 5813 ms, sort 0 ms, write 0 ms, index 739 ms: 6 candidates, 62768 repo-hours, 736 releases; waiting 349 ms; commit 0 ms)
2026-11-08T07:07:12Z [load_day 2024-07-23] 2024-07-23 hour 5: 175756 events in 0 files, snapshot none (task 11451 ms: download 7092 ms overlapping gunzip 1898 ms, parse 7614 ms, sort 0 ms, write 0 ms, index 1101 ms: 7 candidates, 69844 repo-hours, 866 releases; waiting 503 ms; commit 0 ms)
2026-11-08T07:07:18Z [load_day 2024-07-23] 2024-07-23 hour 6: 208261 events in 0 files, snapshot none (task 8440 ms: download 4505 ms overlapping gunzip 1164 ms, parse 4932 ms, sort 0 ms, write 0 ms, index 1570 ms: 10 candidates, 96059 repo-hours, 1144 releases; waiting 481 ms; commit 0 ms)
2026-11-08T07:07:23Z [load_day 2024-07-23] 2024-07-23 hour 7: 213429 events in 0 files, snapshot none (task 9976 ms: download 6097 ms overlapping gunzip 1623 ms, parse 6605 ms, sort 0 ms, write 0 ms, index 927 ms: 3 candidates, 88762 repo-hours, 1106 releases; waiting 539 ms; commit 0 ms)
2026-11-08T07:07:30Z [load_day 2024-07-23] 2024-07-23 hour 8: 224565 events in 0 files, snapshot none (task 11053 ms: download 6459 ms overlapping gunzip 1854 ms, parse 7360 ms, sort 0 ms, write 0 ms, index 1064 ms: 6 candidates, 93502 repo-hours, 1155 releases; waiting 490 ms; commit 0 ms)
2026-11-08T07:07:32Z [load_day 2024-07-23] 2024-07-23 hour 9: 225484 events in 0 files, snapshot none (task 9050 ms: download 6096 ms overlapping gunzip 1321 ms, parse 6019 ms, sort 0 ms, write 0 ms, index 908 ms: 13 candidates, 97396 repo-hours, 1439 releases; waiting 534 ms; commit 0 ms)
2026-11-08T07:07:37Z [load_day 2024-07-23] 2024-07-23 hour 10: 218056 events in 0 files, snapshot none (task 7016 ms: download 4570 ms overlapping gunzip 1080 ms, parse 4512 ms, sort 0 ms, write 0 ms, index 659 ms: 8 candidates, 91670 repo-hours, 1263 releases; waiting 508 ms; commit 0 ms)
2026-11-08T07:07:40Z [load_day 2024-07-23] 2024-07-23 hour 11: 216463 events in 0 files, snapshot none (task 7006 ms: download 4485 ms overlapping gunzip 1083 ms, parse 4461 ms, sort 0 ms, write 0 ms, index 709 ms: 3 candidates, 90007 repo-hours, 1126 releases; waiting 483 ms; commit 0 ms)
2026-11-08T07:07:45Z [load_day 2024-07-23] 2024-07-23 hour 12: 271401 events in 0 files, snapshot none (task 7841 ms: download 4991 ms overlapping gunzip 1153 ms, parse 4962 ms, sort 0 ms, write 0 ms, index 983 ms: 12 candidates, 133459 repo-hours, 1374 releases; waiting 499 ms; commit 0 ms)
2026-11-08T07:07:49Z [load_day 2024-07-23] 2024-07-23 hour 13: 250066 events in 0 files, snapshot none (task 8567 ms: download 5451 ms overlapping gunzip 1257 ms, parse 5437 ms, sort 0 ms, write 0 ms, index 1112 ms: 15 candidates, 115704 repo-hours, 1444 releases; waiting 512 ms; commit 0 ms)
2026-11-08T07:07:57Z [load_day 2024-07-23] 2024-07-23 hour 14: 241481 events in 0 files, snapshot none (task 11216 ms: download 8209 ms overlapping gunzip 1864 ms, parse 8147 ms, sort 0 ms, write 0 ms, index 776 ms: 14 candidates, 102049 repo-hours, 1431 releases; waiting 173 ms; commit 0 ms)
2026-11-08T07:08:00Z [load_day 2024-07-23] 2024-07-23 hour 15: 239889 events in 0 files, snapshot none (task 10264 ms: download 6934 ms overlapping gunzip 1512 ms, parse 6729 ms, sort 0 ms, write 0 ms, index 1294 ms: 8 candidates, 106363 repo-hours, 1410 releases; waiting 463 ms; commit 0 ms)
2026-11-08T07:08:08Z [load_day 2024-07-23] 2024-07-23 hour 16: 220815 events in 0 files, snapshot none (task 10108 ms: download 6225 ms overlapping gunzip 1622 ms, parse 6867 ms, sort 0 ms, write 0 ms, index 844 ms: 9 candidates, 93395 repo-hours, 1235 releases; waiting 497 ms; commit 0 ms)
2026-11-08T07:08:10Z [load_day 2024-07-23] 2024-07-23 hour 17: 215012 events in 0 files, snapshot none (task 9590 ms: download 6233 ms overlapping gunzip 1533 ms, parse 6248 ms, sort 0 ms, write 0 ms, index 942 ms: 5 candidates, 87760 repo-hours, 1218 releases; waiting 491 ms; commit 0 ms)
2026-11-08T07:08:18Z [load_day 2024-07-23] 2024-07-23 hour 18: 222879 events in 0 files, snapshot none (task 9930 ms: download 6800 ms overlapping gunzip 1409 ms, parse 5808 ms, sort 0 ms, write 0 ms, index 829 ms: 16 candidates, 103677 repo-hours, 1254 releases; waiting 1542 ms; commit 0 ms)
2026-11-08T07:08:19Z [load_day 2024-07-23] 2024-07-23 hour 19: 198688 events in 0 files, snapshot none (task 8840 ms: download 6374 ms overlapping gunzip 1405 ms, parse 5995 ms, sort 0 ms, write 0 ms, index 625 ms: 13 candidates, 81090 repo-hours, 1114 releases; waiting 521 ms; commit 0 ms)
2026-11-08T07:08:26Z [load_day 2024-07-23] 2024-07-23 hour 20: 200176 events in 0 files, snapshot none (task 8270 ms: download 5360 ms overlapping gunzip 1326 ms, parse 5263 ms, sort 0 ms, write 0 ms, index 776 ms: 12 candidates, 80221 repo-hours, 1017 releases; waiting 557 ms; commit 0 ms)
2026-11-08T07:08:28Z [load_day 2024-07-23] 2024-07-23 hour 21: 183798 events in 0 files, snapshot none (task 7960 ms: download 5512 ms overlapping gunzip 1313 ms, parse 5366 ms, sort 0 ms, write 0 ms, index 578 ms: 11 candidates, 73490 repo-hours, 1105 releases; waiting 493 ms; commit 0 ms)
2026-11-08T07:08:35Z [load_day 2024-07-23] 2024-07-23 hour 22: 160192 events in 0 files, snapshot none (task 8309 ms: download 5510 ms overlapping gunzip 1093 ms, parse 4392 ms, sort 0 ms, write 0 ms, index 434 ms: 14 candidates, 59351 repo-hours, 974 releases; waiting 1695 ms; commit 0 ms)
2026-11-08T07:08:35Z [load_day 2024-07-23] 2024-07-23 hour 23: 149755 events in 0 files, snapshot none (task 5713 ms: download 2639 ms overlapping gunzip 839 ms, parse 3503 ms, sort 0 ms, write 0 ms, index 600 ms: 10 candidates, 56452 repo-hours, 806 releases; waiting 503 ms; commit 0 ms)
2026-11-08T07:08:45Z [load_day 2024-07-23] 2024-07-23: repo_hour merged from 24 files to 1 (2141889 rows, 9388 ms)
2026-11-08T07:08:47Z [load_day 2024-07-23] 2024-07-23: index committed in 11987 ms (24 + 1 + 24 files)
2026-11-08T07:08:47Z [load_day 2024-07-23] 2024-07-23: 4915431 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:08:47Z [load_day 2024-07-23] attempt 1 succeeded