orcaLog in

Runs · run 3688

load_day 2025-03-19, attempt 1 succeeded

Host
73ccef5e07c2:273336
Started
2026-11-08T10:55:59Z
Ended
2026-11-08T10:58:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
1007 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
209.6 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3688/load_day/2025-03-19/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:55:59Z [load_day 2025-03-19] attempt 1 started
2026-11-08T10:56:00Z [load_day 2025-03-19] 2025-03-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:56:08Z [load_day 2025-03-19] 2025-03-19 hour 0: 214763 events in 0 files, snapshot none (task 7483 ms: download 4526 ms overlapping gunzip 1148 ms, parse 4685 ms, sort 0 ms, write 0 ms, index 712 ms: 8 candidates, 98602 repo-hours, 1521 releases; waiting 587 ms; commit 0 ms)
2026-11-08T10:56:08Z [load_day 2025-03-19] 2025-03-19 hour 1: 243542 events in 0 files, snapshot none (task 7831 ms: download 4509 ms overlapping gunzip 1127 ms, parse 4908 ms, sort 0 ms, write 0 ms, index 1009 ms: 10 candidates, 126632 repo-hours, 1160 releases; waiting 480 ms; commit 0 ms)
2026-11-08T10:56:15Z [load_day 2025-03-19] 2025-03-19 hour 2: 208006 events in 0 files, snapshot none (task 6408 ms: download 3636 ms overlapping gunzip 941 ms, parse 3963 ms, sort 0 ms, write 0 ms, index 674 ms: 11 candidates, 91515 repo-hours, 1116 releases; waiting 514 ms; commit 0 ms)
2026-11-08T10:56:15Z [load_day 2025-03-19] 2025-03-19 hour 3: 224048 events in 0 files, snapshot none (task 6701 ms: download 4087 ms overlapping gunzip 1004 ms, parse 4238 ms, sort 0 ms, write 0 ms, index 652 ms: 3 candidates, 91596 repo-hours, 3730 releases; waiting 488 ms; commit 0 ms)
2026-11-08T10:56:22Z [load_day 2025-03-19] 2025-03-19 hour 4: 199183 events in 0 files, snapshot none (task 6095 ms: download 3355 ms overlapping gunzip 878 ms, parse 3692 ms, sort 0 ms, write 0 ms, index 630 ms: 4 candidates, 76773 repo-hours, 823 releases; waiting 538 ms; commit 0 ms)
2026-11-08T10:56:23Z [load_day 2025-03-19] 2025-03-19 hour 5: 220914 events in 0 files, snapshot none (task 7081 ms: download 4360 ms overlapping gunzip 1008 ms, parse 4421 ms, sort 0 ms, write 0 ms, index 760 ms: 2 candidates, 83903 repo-hours, 865 releases; waiting 598 ms; commit 0 ms)
2026-11-08T10:56:29Z [load_day 2025-03-19] 2025-03-19 hour 6: 247734 events in 0 files, snapshot none (task 7282 ms: download 4162 ms overlapping gunzip 1019 ms, parse 4351 ms, sort 0 ms, write 0 ms, index 974 ms: 3 candidates, 105353 repo-hours, 1049 releases; waiting 574 ms; commit 0 ms)
2026-11-08T10:56:31Z [load_day 2025-03-19] 2025-03-19 hour 7: 236483 events in 0 files, snapshot none (task 7740 ms: download 4411 ms overlapping gunzip 1168 ms, parse 4729 ms, sort 0 ms, write 0 ms, index 1259 ms: 7 candidates, 93677 repo-hours, 1223 releases; waiting 283 ms; commit 0 ms)
2026-11-08T10:56:39Z [load_day 2025-03-19] 2025-03-19 hour 8: 255210 events in 0 files, snapshot none (task 8908 ms: download 5841 ms overlapping gunzip 1305 ms, parse 5643 ms, sort 0 ms, write 0 ms, index 1086 ms: 9 candidates, 107771 repo-hours, 1270 releases; waiting 505 ms; commit 0 ms)
2026-11-08T10:56:43Z [load_day 2025-03-19] 2025-03-19 hour 9: 265601 events in 0 files, snapshot none (task 11037 ms: download 7113 ms overlapping gunzip 1802 ms, parse 7516 ms, sort 0 ms, write 0 ms, index 954 ms: 5 candidates, 114821 repo-hours, 1418 releases; waiting 476 ms; commit 0 ms)
2026-11-08T10:56:50Z [load_day 2025-03-19] 2025-03-19 hour 10: 264039 events in 0 files, snapshot none (task 10097 ms: download 5859 ms overlapping gunzip 1585 ms, parse 6445 ms, sort 0 ms, write 0 ms, index 1359 ms: 7 candidates, 109124 repo-hours, 1403 releases; waiting 474 ms; commit 0 ms)
2026-11-08T10:56:54Z [load_day 2025-03-19] 2025-03-19 hour 11: 259103 events in 0 files, snapshot none (task 9962 ms: download 6688 ms overlapping gunzip 1526 ms, parse 6396 ms, sort 0 ms, write 0 ms, index 768 ms: 2 candidates, 103326 repo-hours, 1256 releases; waiting 865 ms; commit 0 ms)
2026-11-08T10:57:00Z [load_day 2025-03-19] 2025-03-19 hour 12: 288345 events in 0 files, snapshot none (task 10167 ms: download 6145 ms overlapping gunzip 1502 ms, parse 6553 ms, sort 0 ms, write 0 ms, index 1316 ms: 6 candidates, 143961 repo-hours, 1411 releases; waiting 470 ms; commit 0 ms)
2026-11-08T10:57:06Z [load_day 2025-03-19] 2025-03-19 hour 13: 276308 events in 0 files, snapshot none (task 11506 ms: download 7575 ms overlapping gunzip 1794 ms, parse 7252 ms, sort 0 ms, write 0 ms, index 1434 ms: 14 candidates, 129035 repo-hours, 1423 releases; waiting 471 ms; commit 0 ms)
2026-11-08T10:57:14Z [load_day 2025-03-19] 2025-03-19 hour 14: 274779 events in 0 files, snapshot none (task 13175 ms: download 8964 ms overlapping gunzip 2268 ms, parse 9288 ms, sort 0 ms, write 0 ms, index 959 ms: 16 candidates, 119299 repo-hours, 1668 releases; waiting 429 ms; commit 0 ms)
2026-11-08T10:57:19Z [load_day 2025-03-19] 2025-03-19 hour 15: 280921 events in 0 files, snapshot none (task 12627 ms: download 9268 ms overlapping gunzip 1974 ms, parse 8404 ms, sort 0 ms, write 0 ms, index 1448 ms: 8 candidates, 127011 repo-hours, 1584 releases; waiting 479 ms; commit 0 ms)
2026-11-08T10:57:27Z [load_day 2025-03-19] 2025-03-19 hour 16: 270255 events in 0 files, snapshot none (task 13054 ms: download 9566 ms overlapping gunzip 1919 ms, parse 9748 ms, sort 0 ms, write 0 ms, index 1132 ms: 9 candidates, 119170 repo-hours, 1644 releases; waiting 30 ms; commit 0 ms)
2026-11-08T10:57:29Z [load_day 2025-03-19] 2025-03-19 hour 17: 261974 events in 0 files, snapshot none (task 10009 ms: download 7333 ms overlapping gunzip 1634 ms, parse 7046 ms, sort 0 ms, write 0 ms, index 827 ms: 7 candidates, 106951 repo-hours, 1299 releases; waiting 222 ms; commit 0 ms)
2026-11-08T10:57:39Z [load_day 2025-03-19] 2025-03-19 hour 18: 262568 events in 0 files, snapshot none (task 10995 ms: download 7712 ms overlapping gunzip 1765 ms, parse 7543 ms, sort 0 ms, write 0 ms, index 868 ms: 5 candidates, 116885 repo-hours, 1483 releases; waiting 584 ms; commit 0 ms)
2026-11-08T10:57:40Z [load_day 2025-03-19] 2025-03-19 hour 19: 244923 events in 0 files, snapshot none (task 10017 ms: download 7349 ms overlapping gunzip 1578 ms, parse 6898 ms, sort 0 ms, write 0 ms, index 739 ms: 9 candidates, 96152 repo-hours, 1169 releases; waiting 501 ms; commit 0 ms)
2026-11-08T10:57:50Z [load_day 2025-03-19] 2025-03-19 hour 20: 235761 events in 0 files, snapshot none (task 10791 ms: download 7745 ms overlapping gunzip 1699 ms, parse 7024 ms, sort 0 ms, write 0 ms, index 776 ms: 13 candidates, 95007 repo-hours, 1189 releases; waiting 983 ms; commit 0 ms)
2026-11-08T10:57:50Z [load_day 2025-03-19] 2025-03-19 hour 21: 227988 events in 0 files, snapshot none (task 9395 ms: download 6239 ms overlapping gunzip 1463 ms, parse 6211 ms, sort 0 ms, write 0 ms, index 931 ms: 15 candidates, 90890 repo-hours, 1255 releases; waiting 507 ms; commit 0 ms)
2026-11-08T10:58:03Z [load_day 2025-03-19] 2025-03-19 hour 22: 215439 events in 0 files, snapshot none (task 11906 ms: download 9440 ms overlapping gunzip 1165 ms, parse 5133 ms, sort 0 ms, write 0 ms, index 590 ms: 9 candidates, 80324 repo-hours, 1451 releases; waiting 4687 ms; commit 0 ms)
2026-11-08T10:58:03Z [load_day 2025-03-19] 2025-03-19 hour 23: 200987 events in 0 files, snapshot none (task 6535 ms: download 3760 ms overlapping gunzip 1006 ms, parse 4153 ms, sort 0 ms, write 0 ms, index 770 ms: 5 candidates, 74967 repo-hours, 1111 releases; waiting 358 ms; commit 0 ms)
2026-11-08T10:58:13Z [load_day 2025-03-19] 2025-03-19: repo_hour merged from 24 files to 1 (2502745 rows, 10441 ms)
2026-11-08T10:58:16Z [load_day 2025-03-19] 2025-03-19: index committed in 13583 ms (24 + 1 + 24 files)
2026-11-08T10:58:16Z [load_day 2025-03-19] 2025-03-19: 5878874 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:58:16Z [load_day 2025-03-19] attempt 1 succeeded