orcaLog in

Runs · run 2791

load_day 2024-08-02, attempt 1 succeeded

Host
73ccef5e07c2:158360
Started
2026-11-08T07:16:10Z
Ended
2026-11-08T07:17:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
683 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
171.9 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2791/load_day/2024-08-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:16:10Z [load_day 2024-08-02] attempt 1 started
2026-11-08T07:16:11Z [load_day 2024-08-02] 2024-08-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:16:20Z [load_day 2024-08-02] 2024-08-02 hour 0: 192310 events in 0 files, snapshot none (task 9062 ms: download 5780 ms overlapping gunzip 1407 ms, parse 6088 ms, sort 0 ms, write 0 ms, index 786 ms: 9 candidates, 95176 repo-hours, 1244 releases; waiting 503 ms; commit 0 ms)
2026-11-08T07:16:20Z [load_day 2024-08-02] 2024-08-02 hour 1: 206711 events in 0 files, snapshot none (task 9118 ms: download 6213 ms overlapping gunzip 1387 ms, parse 6053 ms, sort 0 ms, write 0 ms, index 848 ms: 12 candidates, 109841 repo-hours, 837 releases; waiting 554 ms; commit 0 ms)
2026-11-08T07:16:28Z [load_day 2024-08-02] 2024-08-02 hour 2: 165054 events in 0 files, snapshot none (task 7182 ms: download 4391 ms overlapping gunzip 1157 ms, parse 4669 ms, sort 0 ms, write 0 ms, index 633 ms: 4 candidates, 68869 repo-hours, 854 releases; waiting 505 ms; commit 0 ms)
2026-11-08T07:16:28Z [load_day 2024-08-02] 2024-08-02 hour 3: 177791 events in 0 files, snapshot none (task 7540 ms: download 4507 ms overlapping gunzip 1156 ms, parse 4992 ms, sort 0 ms, write 0 ms, index 657 ms: 5 candidates, 74162 repo-hours, 5554 releases; waiting 503 ms; commit 0 ms)
2026-11-08T07:16:34Z [load_day 2024-08-02] 2024-08-02 hour 4: 148281 events in 0 files, snapshot none (task 5081 ms: download 2189 ms overlapping gunzip 838 ms, parse 3314 ms, sort 0 ms, write 0 ms, index 452 ms: 4 candidates, 58010 repo-hours, 651 releases; waiting 261 ms; commit 0 ms)
2026-11-08T07:16:35Z [load_day 2024-08-02] 2024-08-02 hour 5: 157962 events in 0 files, snapshot none (task 5648 ms: download 3151 ms overlapping gunzip 843 ms, parse 3529 ms, sort 0 ms, write 0 ms, index 503 ms: 4 candidates, 62966 repo-hours, 796 releases; waiting 513 ms; commit 0 ms)
2026-11-08T07:16:41Z [load_day 2024-08-02] 2024-08-02 hour 6: 194300 events in 0 files, snapshot none (task 6389 ms: download 3878 ms overlapping gunzip 959 ms, parse 4020 ms, sort 0 ms, write 0 ms, index 662 ms: 6 candidates, 89960 repo-hours, 1101 releases; waiting 515 ms; commit 0 ms)
2026-11-08T07:16:42Z [load_day 2024-08-02] 2024-08-02 hour 7: 198253 events in 0 files, snapshot none (task 7028 ms: download 4613 ms overlapping gunzip 1059 ms, parse 4531 ms, sort 0 ms, write 0 ms, index 618 ms: 5 candidates, 80513 repo-hours, 983 releases; waiting 531 ms; commit 0 ms)
2026-11-08T07:16:48Z [load_day 2024-08-02] 2024-08-02 hour 8: 207935 events in 0 files, snapshot none (task 7105 ms: download 4657 ms overlapping gunzip 1112 ms, parse 4522 ms, sort 0 ms, write 0 ms, index 590 ms: 11 candidates, 87461 repo-hours, 1191 releases; waiting 566 ms; commit 0 ms)
2026-11-08T07:16:50Z [load_day 2024-08-02] 2024-08-02 hour 9: 218816 events in 0 files, snapshot none (task 7272 ms: download 4730 ms overlapping gunzip 1132 ms, parse 4709 ms, sort 0 ms, write 0 ms, index 695 ms: 13 candidates, 94579 repo-hours, 1239 releases; waiting 482 ms; commit 0 ms)
2026-11-08T07:16:55Z [load_day 2024-08-02] 2024-08-02 hour 10: 209798 events in 0 files, snapshot none (task 6675 ms: download 4216 ms overlapping gunzip 1038 ms, parse 4269 ms, sort 0 ms, write 0 ms, index 633 ms: 12 candidates, 85598 repo-hours, 1123 releases; waiting 524 ms; commit 0 ms)
2026-11-08T07:16:58Z [load_day 2024-08-02] 2024-08-02 hour 11: 202373 events in 0 files, snapshot none (task 7581 ms: download 4930 ms overlapping gunzip 1090 ms, parse 4421 ms, sort 0 ms, write 0 ms, index 1026 ms: 7 candidates, 79315 repo-hours, 1089 releases; waiting 711 ms; commit 0 ms)
2026-11-08T07:17:05Z [load_day 2024-08-02] 2024-08-02 hour 12: 265445 events in 0 files, snapshot none (task 9447 ms: download 5966 ms overlapping gunzip 1414 ms, parse 6276 ms, sort 0 ms, write 0 ms, index 950 ms: 9 candidates, 127680 repo-hours, 1280 releases; waiting 487 ms; commit 0 ms)
2026-11-08T07:17:08Z [load_day 2024-08-02] 2024-08-02 hour 13: 238005 events in 0 files, snapshot none (task 9008 ms: download 6139 ms overlapping gunzip 1346 ms, parse 5865 ms, sort 0 ms, write 0 ms, index 982 ms: 8 candidates, 107745 repo-hours, 1312 releases; waiting 493 ms; commit 0 ms)
2026-11-08T07:17:16Z [load_day 2024-08-02] 2024-08-02 hour 14: 224918 events in 0 files, snapshot none (task 9993 ms: download 6318 ms overlapping gunzip 1629 ms, parse 6739 ms, sort 0 ms, write 0 ms, index 835 ms: 8 candidates, 91676 repo-hours, 1424 releases; waiting 507 ms; commit 0 ms)
2026-11-08T07:17:18Z [load_day 2024-08-02] 2024-08-02 hour 15: 224908 events in 0 files, snapshot none (task 9185 ms: download 6206 ms overlapping gunzip 1456 ms, parse 5772 ms, sort 0 ms, write 0 ms, index 799 ms: 15 candidates, 97390 repo-hours, 1412 releases; waiting 663 ms; commit 0 ms)
2026-11-08T07:17:25Z [load_day 2024-08-02] 2024-08-02 hour 16: 214074 events in 0 files, snapshot none (task 8347 ms: download 5811 ms overlapping gunzip 1201 ms, parse 5395 ms, sort 0 ms, write 0 ms, index 786 ms: 10 candidates, 86912 repo-hours, 1315 releases; waiting 697 ms; commit 0 ms)
2026-11-08T07:17:25Z [load_day 2024-08-02] 2024-08-02 hour 17: 200173 events in 0 files, snapshot none (task 7127 ms: download 4607 ms overlapping gunzip 1085 ms, parse 4630 ms, sort 0 ms, write 0 ms, index 628 ms: 3 candidates, 79099 repo-hours, 1125 releases; waiting 518 ms; commit 0 ms)
2026-11-08T07:17:33Z [load_day 2024-08-02] 2024-08-02 hour 18: 208813 events in 0 files, snapshot none (task 7636 ms: download 4954 ms overlapping gunzip 1230 ms, parse 4934 ms, sort 0 ms, write 0 ms, index 705 ms: 6 candidates, 93009 repo-hours, 1084 releases; waiting 497 ms; commit 0 ms)
2026-11-08T07:17:33Z [load_day 2024-08-02] 2024-08-02 hour 19: 182033 events in 0 files, snapshot none (task 6131 ms: download 3336 ms overlapping gunzip 1016 ms, parse 4035 ms, sort 0 ms, write 0 ms, index 593 ms: 15 candidates, 67274 repo-hours, 835 releases; waiting 191 ms; commit 0 ms)
2026-11-08T07:17:40Z [load_day 2024-08-02] 2024-08-02 hour 20: 174440 events in 0 files, snapshot none (task 6451 ms: download 3561 ms overlapping gunzip 972 ms, parse 4177 ms, sort 0 ms, write 0 ms, index 575 ms: 4 candidates, 66089 repo-hours, 885 releases; waiting 503 ms; commit 0 ms)
2026-11-08T07:17:40Z [load_day 2024-08-02] 2024-08-02 hour 21: 167739 events in 0 files, snapshot none (task 6721 ms: download 3762 ms overlapping gunzip 1029 ms, parse 4151 ms, sort 0 ms, write 0 ms, index 514 ms: 4 candidates, 66345 repo-hours, 1037 releases; waiting 525 ms; commit 0 ms)
2026-11-08T07:17:46Z [load_day 2024-08-02] 2024-08-02 hour 22: 147186 events in 0 files, snapshot none (task 5951 ms: download 3233 ms overlapping gunzip 918 ms, parse 3856 ms, sort 0 ms, write 0 ms, index 364 ms: 9 candidates, 52771 repo-hours, 893 releases; waiting 519 ms; commit 0 ms)
2026-11-08T07:17:46Z [load_day 2024-08-02] 2024-08-02 hour 23: 131713 events in 0 files, snapshot none (task 5290 ms: download 2698 ms overlapping gunzip 779 ms, parse 3248 ms, sort 0 ms, write 0 ms, index 468 ms: 11 candidates, 48772 repo-hours, 831 releases; waiting 525 ms; commit 0 ms)
2026-11-08T07:17:55Z [load_day 2024-08-02] 2024-08-02: repo_hour merged from 24 files to 1 (1971212 rows, 9182 ms)
2026-11-08T07:17:58Z [load_day 2024-08-02] 2024-08-02: index committed in 11809 ms (24 + 1 + 24 files)
2026-11-08T07:17:58Z [load_day 2024-08-02] 2024-08-02: 4659031 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:17:58Z [load_day 2024-08-02] attempt 1 succeeded