orcaLog in

Runs · run 3405

load_day 2025-01-07, attempt 1 succeeded

Host
73ccef5e07c2:233741
Started
2026-11-08T09:41:55Z
Ended
2026-11-08T09:43:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
852 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
176.0 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3405/load_day/2025-01-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:41:55Z [load_day 2025-01-07] attempt 1 started
2026-11-08T09:41:56Z [load_day 2025-01-07] 2025-01-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:42:04Z [load_day 2025-01-07] 2025-01-07 hour 0: 159428 events in 0 files, snapshot none (task 6826 ms: download 3998 ms overlapping gunzip 958 ms, parse 4120 ms, sort 0 ms, write 0 ms, index 844 ms: 7 candidates, 83494 repo-hours, 1054 releases; waiting 668 ms; commit 0 ms)
2026-11-08T09:42:05Z [load_day 2025-01-07] 2025-01-07 hour 1: 203176 events in 0 files, snapshot none (task 7805 ms: download 3928 ms overlapping gunzip 1114 ms, parse 4735 ms, sort 0 ms, write 0 ms, index 1167 ms: 14 candidates, 111392 repo-hours, 986 releases; waiting 349 ms; commit 0 ms)
2026-11-08T09:42:10Z [load_day 2025-01-07] 2025-01-07 hour 2: 174982 events in 0 files, snapshot none (task 6133 ms: download 3281 ms overlapping gunzip 957 ms, parse 3865 ms, sort 0 ms, write 0 ms, index 610 ms: 5 candidates, 79227 repo-hours, 1045 releases; waiting 374 ms; commit 0 ms)
2026-11-08T09:42:12Z [load_day 2025-01-07] 2025-01-07 hour 3: 189753 events in 0 files, snapshot none (task 6737 ms: download 4041 ms overlapping gunzip 963 ms, parse 4292 ms, sort 0 ms, write 0 ms, index 729 ms: 3 candidates, 77258 repo-hours, 3975 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:42:19Z [load_day 2025-01-07] 2025-01-07 hour 4: 175772 events in 0 files, snapshot none (task 8154 ms: download 4365 ms overlapping gunzip 1295 ms, parse 5264 ms, sort 0 ms, write 0 ms, index 832 ms: 11 candidates, 64887 repo-hours, 737 releases; waiting 520 ms; commit 0 ms)
2026-11-08T09:42:21Z [load_day 2025-01-07] 2025-01-07 hour 5: 189550 events in 0 files, snapshot none (task 8437 ms: download 5775 ms overlapping gunzip 1351 ms, parse 5906 ms, sort 0 ms, write 0 ms, index 560 ms: 1 candidates, 72636 repo-hours, 789 releases; waiting 291 ms; commit 0 ms)
2026-11-08T09:42:28Z [load_day 2025-01-07] 2025-01-07 hour 6: 211661 events in 0 files, snapshot none (task 7903 ms: download 4011 ms overlapping gunzip 1141 ms, parse 4727 ms, sort 0 ms, write 0 ms, index 1262 ms: 7 candidates, 93395 repo-hours, 922 releases; waiting 533 ms; commit 0 ms)
2026-11-08T09:42:30Z [load_day 2025-01-07] 2025-01-07 hour 7: 219934 events in 0 files, snapshot none (task 8565 ms: download 5250 ms overlapping gunzip 1296 ms, parse 5642 ms, sort 0 ms, write 0 ms, index 802 ms: 6 candidates, 83514 repo-hours, 837 releases; waiting 210 ms; commit 0 ms)
2026-11-08T09:42:38Z [load_day 2025-01-07] 2025-01-07 hour 8: 235035 events in 0 files, snapshot none (task 10018 ms: download 6388 ms overlapping gunzip 1534 ms, parse 6047 ms, sort 0 ms, write 0 ms, index 1207 ms: 6 candidates, 93085 repo-hours, 1088 releases; waiting 971 ms; commit 0 ms)
2026-11-08T09:42:40Z [load_day 2025-01-07] 2025-01-07 hour 9: 248855 events in 0 files, snapshot none (task 9778 ms: download 6558 ms overlapping gunzip 1531 ms, parse 6494 ms, sort 0 ms, write 0 ms, index 975 ms: 11 candidates, 100501 repo-hours, 1420 releases; waiting 509 ms; commit 0 ms)
2026-11-08T09:42:48Z [load_day 2025-01-07] 2025-01-07 hour 10: 239049 events in 0 files, snapshot none (task 8768 ms: download 5432 ms overlapping gunzip 1476 ms, parse 5676 ms, sort 0 ms, write 0 ms, index 1040 ms: 4 candidates, 93667 repo-hours, 1184 releases; waiting 324 ms; commit 0 ms)
2026-11-08T09:42:50Z [load_day 2025-01-07] 2025-01-07 hour 11: 236968 events in 0 files, snapshot none (task 8680 ms: download 6148 ms overlapping gunzip 1361 ms, parse 5879 ms, sort 0 ms, write 0 ms, index 681 ms: 13 candidates, 88803 repo-hours, 1152 releases; waiting 516 ms; commit 0 ms)
2026-11-08T09:42:56Z [load_day 2025-01-07] 2025-01-07 hour 12: 288093 events in 0 files, snapshot none (task 8006 ms: download 4953 ms overlapping gunzip 1170 ms, parse 5037 ms, sort 0 ms, write 0 ms, index 974 ms: 6 candidates, 132704 repo-hours, 1335 releases; waiting 503 ms; commit 0 ms)
2026-11-08T09:42:59Z [load_day 2025-01-07] 2025-01-07 hour 13: 271897 events in 0 files, snapshot none (task 8517 ms: download 5811 ms overlapping gunzip 1186 ms, parse 4959 ms, sort 0 ms, write 0 ms, index 850 ms: 6 candidates, 113817 repo-hours, 1086 releases; waiting 1264 ms; commit 0 ms)
2026-11-08T09:43:02Z [load_day 2025-01-07] 2025-01-07 hour 14: 160575 events in 0 files, snapshot none (task 5171 ms: download 3163 ms overlapping gunzip 716 ms, parse 2938 ms, sort 0 ms, write 0 ms, index 466 ms: 4 candidates, 61268 repo-hours, 801 releases; waiting 764 ms; commit 0 ms)
2026-11-08T09:43:02Z [load_day 2025-01-07] 2025-01-07 hour 15: 56446 events in 0 files, snapshot none (task 2342 ms: download 1631 ms overlapping gunzip 250 ms, parse 1014 ms, sort 0 ms, write 0 ms, index 261 ms: 1 candidates, 33317 repo-hours, 267 releases; waiting 534 ms; commit 0 ms)
2026-11-08T09:43:13Z [load_day 2025-01-07] 2025-01-07 hour 16: 279041 events in 0 files, snapshot none (task 10503 ms: download 7743 ms overlapping gunzip 1659 ms, parse 7326 ms, sort 0 ms, write 0 ms, index 714 ms: 7 candidates, 102728 repo-hours, 1400 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:43:13Z [load_day 2025-01-07] 2025-01-07 hour 17: 262722 events in 0 files, snapshot none (task 9085 ms: download 6049 ms overlapping gunzip 1462 ms, parse 6087 ms, sort 0 ms, write 0 ms, index 690 ms: 10 candidates, 91478 repo-hours, 1138 releases; waiting 516 ms; commit 0 ms)
2026-11-08T09:43:23Z [load_day 2025-01-07] 2025-01-07 hour 18: 266091 events in 0 files, snapshot none (task 9872 ms: download 6600 ms overlapping gunzip 1508 ms, parse 6533 ms, sort 0 ms, write 0 ms, index 1007 ms: 7 candidates, 104457 repo-hours, 1261 releases; waiting 514 ms; commit 0 ms)
2026-11-08T09:43:23Z [load_day 2025-01-07] 2025-01-07 hour 19: 243033 events in 0 files, snapshot none (task 9099 ms: download 6426 ms overlapping gunzip 1413 ms, parse 6105 ms, sort 0 ms, write 0 ms, index 799 ms: 7 candidates, 80385 repo-hours, 1080 releases; waiting 519 ms; commit 0 ms)
2026-11-08T09:43:32Z [load_day 2025-01-07] 2025-01-07 hour 20: 241581 events in 0 files, snapshot none (task 8515 ms: download 5257 ms overlapping gunzip 1316 ms, parse 5686 ms, sort 0 ms, write 0 ms, index 681 ms: 12 candidates, 81081 repo-hours, 1079 releases; waiting 515 ms; commit 0 ms)
2026-11-08T09:43:32Z [load_day 2025-01-07] 2025-01-07 hour 21: 236082 events in 0 files, snapshot none (task 8201 ms: download 4887 ms overlapping gunzip 1277 ms, parse 5313 ms, sort 0 ms, write 0 ms, index 726 ms: 7 candidates, 78686 repo-hours, 1181 releases; waiting 623 ms; commit 0 ms)
2026-11-08T09:43:40Z [load_day 2025-01-07] 2025-01-07 hour 22: 218003 events in 0 files, snapshot none (task 7117 ms: download 4144 ms overlapping gunzip 1188 ms, parse 4637 ms, sort 0 ms, write 0 ms, index 601 ms: 6 candidates, 67033 repo-hours, 1150 releases; waiting 440 ms; commit 0 ms)
2026-11-08T09:43:40Z [load_day 2025-01-07] 2025-01-07 hour 23: 208394 events in 0 files, snapshot none (task 6480 ms: download 3678 ms overlapping gunzip 992 ms, parse 4097 ms, sort 0 ms, write 0 ms, index 600 ms: 5 candidates, 62147 repo-hours, 828 releases; waiting 508 ms; commit 0 ms)
2026-11-08T09:43:49Z [load_day 2025-01-07] 2025-01-07: repo_hour merged from 24 files to 1 (2050960 rows, 9401 ms)
2026-11-08T09:43:52Z [load_day 2025-01-07] 2025-01-07: index committed in 12180 ms (24 + 1 + 24 files)
2026-11-08T09:43:52Z [load_day 2025-01-07] 2025-01-07: 5216121 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:43:52Z [load_day 2025-01-07] attempt 1 succeeded