orcaLog in

Runs · run 3634

load_day 2025-03-05, attempt 1 succeeded

Host
73ccef5e07c2:265550
Started
2026-11-08T10:40:28Z
Ended
2026-11-08T10:42:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
757 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
207.1 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3634/load_day/2025-03-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:40:28Z [load_day 2025-03-05] attempt 1 started
2026-11-08T10:40:29Z [load_day 2025-03-05] 2025-03-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:40:38Z [load_day 2025-03-05] 2025-03-05 hour 0: 206670 events in 0 files, snapshot none (task 8254 ms: download 4919 ms overlapping gunzip 1277 ms, parse 5431 ms, sort 0 ms, write 0 ms, index 882 ms: 11 candidates, 98473 repo-hours, 1305 releases; waiting 417 ms; commit 0 ms)
2026-11-08T10:40:38Z [load_day 2025-03-05] 2025-03-05 hour 1: 229596 events in 0 files, snapshot none (task 8144 ms: download 5023 ms overlapping gunzip 1184 ms, parse 5399 ms, sort 0 ms, write 0 ms, index 941 ms: 7 candidates, 122193 repo-hours, 1092 releases; waiting 348 ms; commit 0 ms)
2026-11-08T10:40:47Z [load_day 2025-03-05] 2025-03-05 hour 2: 205631 events in 0 files, snapshot none (task 8640 ms: download 5191 ms overlapping gunzip 1294 ms, parse 5602 ms, sort 0 ms, write 0 ms, index 965 ms: 9 candidates, 90927 repo-hours, 902 releases; waiting 509 ms; commit 0 ms)
2026-11-08T10:40:47Z [load_day 2025-03-05] 2025-03-05 hour 3: 224018 events in 0 files, snapshot none (task 8526 ms: download 5238 ms overlapping gunzip 1233 ms, parse 5633 ms, sort 0 ms, write 0 ms, index 811 ms: 6 candidates, 90957 repo-hours, 3861 releases; waiting 516 ms; commit 0 ms)
2026-11-08T10:40:55Z [load_day 2025-03-05] 2025-03-05 hour 4: 215164 events in 0 files, snapshot none (task 7917 ms: download 4846 ms overlapping gunzip 1187 ms, parse 4961 ms, sort 0 ms, write 0 ms, index 1012 ms: 7 candidates, 78736 repo-hours, 724 releases; waiting 515 ms; commit 0 ms)
2026-11-08T10:40:56Z [load_day 2025-03-05] 2025-03-05 hour 5: 228128 events in 0 files, snapshot none (task 8946 ms: download 5714 ms overlapping gunzip 1407 ms, parse 5881 ms, sort 0 ms, write 0 ms, index 845 ms: 4 candidates, 83323 repo-hours, 829 releases; waiting 521 ms; commit 0 ms)
2026-11-08T10:41:03Z [load_day 2025-03-05] 2025-03-05 hour 6: 243636 events in 0 files, snapshot none (task 7226 ms: download 4570 ms overlapping gunzip 1058 ms, parse 4611 ms, sort 0 ms, write 0 ms, index 733 ms: 3 candidates, 103058 repo-hours, 1074 releases; waiting 504 ms; commit 0 ms)
2026-11-08T10:41:04Z [load_day 2025-03-05] 2025-03-05 hour 7: 244970 events in 0 files, snapshot none (task 7102 ms: download 4664 ms overlapping gunzip 1137 ms, parse 4547 ms, sort 0 ms, write 0 ms, index 677 ms: 5 candidates, 93148 repo-hours, 1038 releases; waiting 501 ms; commit 0 ms)
2026-11-08T10:41:11Z [load_day 2025-03-05] 2025-03-05 hour 8: 254766 events in 0 files, snapshot none (task 7642 ms: download 4953 ms overlapping gunzip 1179 ms, parse 4881 ms, sort 0 ms, write 0 ms, index 781 ms: 9 candidates, 103719 repo-hours, 1279 releases; waiting 493 ms; commit 0 ms)
2026-11-08T10:41:13Z [load_day 2025-03-05] 2025-03-05 hour 9: 270803 events in 0 files, snapshot none (task 8250 ms: download 5613 ms overlapping gunzip 1280 ms, parse 5406 ms, sort 0 ms, write 0 ms, index 825 ms: 4 candidates, 111861 repo-hours, 1804 releases; waiting 493 ms; commit 0 ms)
2026-11-08T10:41:21Z [load_day 2025-03-05] 2025-03-05 hour 10: 261079 events in 0 files, snapshot none (task 9020 ms: download 5410 ms overlapping gunzip 1403 ms, parse 5831 ms, sort 0 ms, write 0 ms, index 944 ms: 9 candidates, 105166 repo-hours, 1248 releases; waiting 598 ms; commit 0 ms)
2026-11-08T10:41:21Z [load_day 2025-03-05] 2025-03-05 hour 11: 246477 events in 0 files, snapshot none (task 8176 ms: download 4955 ms overlapping gunzip 1222 ms, parse 5321 ms, sort 0 ms, write 0 ms, index 894 ms: 6 candidates, 97758 repo-hours, 1212 releases; waiting 396 ms; commit 0 ms)
2026-11-08T10:41:33Z [load_day 2025-03-05] 2025-03-05 hour 12: 279477 events in 0 files, snapshot none (task 11607 ms: download 8033 ms overlapping gunzip 1541 ms, parse 6745 ms, sort 0 ms, write 0 ms, index 1185 ms: 5 candidates, 136579 repo-hours, 1339 releases; waiting 1846 ms; commit 0 ms)
2026-11-08T10:41:33Z [load_day 2025-03-05] 2025-03-05 hour 13: 276935 events in 0 files, snapshot none (task 10588 ms: download 6942 ms overlapping gunzip 1597 ms, parse 6975 ms, sort 0 ms, write 0 ms, index 1117 ms: 10 candidates, 123786 repo-hours, 1272 releases; waiting 525 ms; commit 0 ms)
2026-11-08T10:41:45Z [load_day 2025-03-05] 2025-03-05 hour 14: 270938 events in 0 files, snapshot none (task 11274 ms: download 7620 ms overlapping gunzip 1845 ms, parse 7813 ms, sort 0 ms, write 0 ms, index 1156 ms: 11 candidates, 112491 repo-hours, 1382 releases; waiting 214 ms; commit 0 ms)
2026-11-08T10:41:46Z [load_day 2025-03-05] 2025-03-05 hour 15: 274158 events in 0 files, snapshot none (task 12705 ms: download 9073 ms overlapping gunzip 2053 ms, parse 8751 ms, sort 0 ms, write 0 ms, index 1167 ms: 6 candidates, 123125 repo-hours, 1579 releases; waiting 504 ms; commit 0 ms)
2026-11-08T10:41:56Z [load_day 2025-03-05] 2025-03-05 hour 16: 262857 events in 0 files, snapshot none (task 10863 ms: download 7479 ms overlapping gunzip 1690 ms, parse 7215 ms, sort 0 ms, write 0 ms, index 1143 ms: 6 candidates, 113011 repo-hours, 1403 releases; waiting 505 ms; commit 0 ms)
2026-11-08T10:41:57Z [load_day 2025-03-05] 2025-03-05 hour 17: 264063 events in 0 files, snapshot none (task 10432 ms: download 7399 ms overlapping gunzip 1674 ms, parse 7154 ms, sort 0 ms, write 0 ms, index 802 ms: 15 candidates, 105949 repo-hours, 1056 releases; waiting 540 ms; commit 0 ms)
2026-11-08T10:42:07Z [load_day 2025-03-05] 2025-03-05 hour 18: 264318 events in 0 files, snapshot none (task 10359 ms: download 6354 ms overlapping gunzip 1703 ms, parse 7066 ms, sort 0 ms, write 0 ms, index 1026 ms: 7 candidates, 115221 repo-hours, 1249 releases; waiting 280 ms; commit 0 ms)
2026-11-08T10:42:07Z [load_day 2025-03-05] 2025-03-05 hour 19: 246134 events in 0 files, snapshot none (task 9806 ms: download 6600 ms overlapping gunzip 1515 ms, parse 6690 ms, sort 0 ms, write 0 ms, index 811 ms: 5 candidates, 93410 repo-hours, 1036 releases; waiting 516 ms; commit 0 ms)
2026-11-08T10:42:17Z [load_day 2025-03-05] 2025-03-05 hour 20: 240142 events in 0 files, snapshot none (task 9262 ms: download 5887 ms overlapping gunzip 1495 ms, parse 5990 ms, sort 0 ms, write 0 ms, index 984 ms: 14 candidates, 93667 repo-hours, 1148 releases; waiting 522 ms; commit 0 ms)
2026-11-08T10:42:18Z [load_day 2025-03-05] 2025-03-05 hour 21: 239262 events in 0 files, snapshot none (task 10084 ms: download 7211 ms overlapping gunzip 1634 ms, parse 6831 ms, sort 0 ms, write 0 ms, index 764 ms: 8 candidates, 91666 repo-hours, 1215 releases; waiting 622 ms; commit 0 ms)
2026-11-08T10:42:26Z [load_day 2025-03-05] 2025-03-05 hour 22: 219205 events in 0 files, snapshot none (task 8782 ms: download 5361 ms overlapping gunzip 1417 ms, parse 5661 ms, sort 0 ms, write 0 ms, index 892 ms: 4 candidates, 80600 repo-hours, 1254 releases; waiting 504 ms; commit 0 ms)
2026-11-08T10:42:27Z [load_day 2025-03-05] 2025-03-05 hour 23: 206317 events in 0 files, snapshot none (task 8193 ms: download 5294 ms overlapping gunzip 1299 ms, parse 5476 ms, sort 0 ms, write 0 ms, index 681 ms: 6 candidates, 73399 repo-hours, 1164 releases; waiting 521 ms; commit 0 ms)
2026-11-08T10:42:37Z [load_day 2025-03-05] 2025-03-05: repo_hour merged from 24 files to 1 (2442223 rows, 10242 ms)
2026-11-08T10:42:39Z [load_day 2025-03-05] 2025-03-05: index committed in 12690 ms (24 + 1 + 24 files)
2026-11-08T10:42:39Z [load_day 2025-03-05] 2025-03-05: 5874744 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:42:39Z [load_day 2025-03-05] attempt 1 succeeded