orcaLog in

Runs · run 3166

load_day 2024-11-05, attempt 1 succeeded

Host
73ccef5e07c2:202692
Started
2026-11-08T08:39:26Z
Ended
2026-11-08T08:41:42Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
877 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
209.3 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3166/load_day/2024-11-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:39:26Z [load_day 2024-11-05] attempt 1 started
2026-11-08T08:39:27Z [load_day 2024-11-05] 2024-11-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:39:37Z [load_day 2024-11-05] 2024-11-05 hour 0: 201331 events in 0 files, snapshot none (task 8941 ms: download 5571 ms overlapping gunzip 1362 ms, parse 5939 ms, sort 0 ms, write 0 ms, index 786 ms: 9 candidates, 98390 repo-hours, 1252 releases; waiting 474 ms; commit 0 ms)
2026-11-08T08:39:37Z [load_day 2024-11-05] 2024-11-05 hour 1: 208030 events in 0 files, snapshot none (task 8819 ms: download 5503 ms overlapping gunzip 1262 ms, parse 5968 ms, sort 0 ms, write 0 ms, index 949 ms: 6 candidates, 113673 repo-hours, 1036 releases; waiting 315 ms; commit 0 ms)
2026-11-08T08:39:46Z [load_day 2024-11-05] 2024-11-05 hour 2: 190079 events in 0 files, snapshot none (task 9128 ms: download 5984 ms overlapping gunzip 1328 ms, parse 5449 ms, sort 0 ms, write 0 ms, index 720 ms: 3 candidates, 85003 repo-hours, 1034 releases; waiting 1308 ms; commit 0 ms)
2026-11-08T08:39:46Z [load_day 2024-11-05] 2024-11-05 hour 3: 208583 events in 0 files, snapshot none (task 8449 ms: download 5263 ms overlapping gunzip 1391 ms, parse 5487 ms, sort 0 ms, write 0 ms, index 895 ms: 4 candidates, 80877 repo-hours, 4243 releases; waiting 372 ms; commit 0 ms)
2026-11-08T08:39:53Z [load_day 2024-11-05] 2024-11-05 hour 4: 185809 events in 0 files, snapshot none (task 5988 ms: download 3676 ms overlapping gunzip 924 ms, parse 3715 ms, sort 0 ms, write 0 ms, index 598 ms: 8 candidates, 68231 repo-hours, 792 releases; waiting 528 ms; commit 0 ms)
2026-11-08T08:39:54Z [load_day 2024-11-05] 2024-11-05 hour 5: 200358 events in 0 files, snapshot none (task 6849 ms: download 4369 ms overlapping gunzip 1063 ms, parse 4125 ms, sort 0 ms, write 0 ms, index 815 ms: 10 candidates, 73087 repo-hours, 802 releases; waiting 509 ms; commit 0 ms)
2026-11-08T08:40:03Z [load_day 2024-11-05] 2024-11-05 hour 6: 220134 events in 0 files, snapshot none (task 9528 ms: download 5986 ms overlapping gunzip 1503 ms, parse 6243 ms, sort 0 ms, write 0 ms, index 887 ms: 9 candidates, 94621 repo-hours, 967 releases; waiting 558 ms; commit 0 ms)
2026-11-08T08:40:04Z [load_day 2024-11-05] 2024-11-05 hour 7: 217812 events in 0 files, snapshot none (task 9864 ms: download 7395 ms overlapping gunzip 1715 ms, parse 6751 ms, sort 0 ms, write 0 ms, index 625 ms: 3 candidates, 82952 repo-hours, 1012 releases; waiting 490 ms; commit 0 ms)
2026-11-08T08:40:15Z [load_day 2024-11-05] 2024-11-05 hour 8: 228775 events in 0 files, snapshot none (task 11216 ms: download 7661 ms overlapping gunzip 1805 ms, parse 7695 ms, sort 0 ms, write 0 ms, index 859 ms: 5 candidates, 93087 repo-hours, 1246 releases; waiting 517 ms; commit 0 ms)
2026-11-08T08:40:17Z [load_day 2024-11-05] 2024-11-05 hour 9: 249757 events in 0 files, snapshot none (task 12314 ms: download 9725 ms overlapping gunzip 2075 ms, parse 8402 ms, sort 0 ms, write 0 ms, index 841 ms: 3 candidates, 102171 repo-hours, 1403 releases; waiting 675 ms; commit 0 ms)
2026-11-08T08:40:26Z [load_day 2024-11-05] 2024-11-05 hour 10: 239670 events in 0 files, snapshot none (task 11072 ms: download 7645 ms overlapping gunzip 1793 ms, parse 7594 ms, sort 0 ms, write 0 ms, index 849 ms: 4 candidates, 95329 repo-hours, 1240 releases; waiting 503 ms; commit 0 ms)
2026-11-08T08:40:28Z [load_day 2024-11-05] 2024-11-05 hour 11: 244734 events in 0 files, snapshot none (task 10594 ms: download 8089 ms overlapping gunzip 1881 ms, parse 7312 ms, sort 0 ms, write 0 ms, index 723 ms: 4 candidates, 91866 repo-hours, 1148 releases; waiting 381 ms; commit 0 ms)
2026-11-08T08:40:37Z [load_day 2024-11-05] 2024-11-05 hour 12: 269490 events in 0 files, snapshot none (task 10276 ms: download 6279 ms overlapping gunzip 1503 ms, parse 6452 ms, sort 0 ms, write 0 ms, index 1500 ms: 7 candidates, 134601 repo-hours, 1436 releases; waiting 509 ms; commit 0 ms)
2026-11-08T08:40:41Z [load_day 2024-11-05] 2024-11-05 hour 13: 269720 events in 0 files, snapshot none (task 11131 ms: download 8316 ms overlapping gunzip 1801 ms, parse 7505 ms, sort 0 ms, write 0 ms, index 1047 ms: 9 candidates, 119392 repo-hours, 1215 releases; waiting 515 ms; commit 0 ms)
2026-11-08T08:40:49Z [load_day 2024-11-05] 2024-11-05 hour 14: 242979 events in 0 files, snapshot none (task 11313 ms: download 7617 ms overlapping gunzip 1853 ms, parse 7446 ms, sort 0 ms, write 0 ms, index 1201 ms: 11 candidates, 102751 repo-hours, 1500 releases; waiting 535 ms; commit 0 ms)
2026-11-08T08:40:53Z [load_day 2024-11-05] 2024-11-05 hour 15: 263620 events in 0 files, snapshot none (task 11362 ms: download 8609 ms overlapping gunzip 1883 ms, parse 7746 ms, sort 0 ms, write 0 ms, index 921 ms: 7 candidates, 112847 repo-hours, 1457 releases; waiting 518 ms; commit 0 ms)
2026-11-08T08:40:59Z [load_day 2024-11-05] 2024-11-05 hour 16: 254826 events in 0 files, snapshot none (task 9262 ms: download 6704 ms overlapping gunzip 1440 ms, parse 6168 ms, sort 0 ms, write 0 ms, index 735 ms: 9 candidates, 104705 repo-hours, 1438 releases; waiting 536 ms; commit 0 ms)
2026-11-08T08:41:01Z [load_day 2024-11-05] 2024-11-05 hour 17: 242844 events in 0 files, snapshot none (task 7919 ms: download 5595 ms overlapping gunzip 1331 ms, parse 5154 ms, sort 0 ms, write 0 ms, index 717 ms: 5 candidates, 95788 repo-hours, 1168 releases; waiting 514 ms; commit 0 ms)
2026-11-08T08:41:10Z [load_day 2024-11-05] 2024-11-05 hour 18: 245592 events in 0 files, snapshot none (task 10270 ms: download 6599 ms overlapping gunzip 1349 ms, parse 5447 ms, sort 0 ms, write 0 ms, index 1670 ms: 10 candidates, 107195 repo-hours, 1263 releases; waiting 1480 ms; commit 0 ms)
2026-11-08T08:41:10Z [load_day 2024-11-05] 2024-11-05 hour 19: 223968 events in 0 files, snapshot none (task 8623 ms: download 5007 ms overlapping gunzip 1372 ms, parse 5409 ms, sort 0 ms, write 0 ms, index 1042 ms: 6 candidates, 84207 repo-hours, 1281 releases; waiting 507 ms; commit 0 ms)
2026-11-08T08:41:19Z [load_day 2024-11-05] 2024-11-05 hour 20: 216468 events in 0 files, snapshot none (task 9106 ms: download 5760 ms overlapping gunzip 1439 ms, parse 6007 ms, sort 0 ms, write 0 ms, index 749 ms: 7 candidates, 84490 repo-hours, 1161 releases; waiting 531 ms; commit 0 ms)
2026-11-08T08:41:20Z [load_day 2024-11-05] 2024-11-05 hour 21: 216086 events in 0 files, snapshot none (task 9191 ms: download 5576 ms overlapping gunzip 1463 ms, parse 5995 ms, sort 0 ms, write 0 ms, index 795 ms: 11 candidates, 82053 repo-hours, 1193 releases; waiting 594 ms; commit 0 ms)
2026-11-08T08:41:30Z [load_day 2024-11-05] 2024-11-05 hour 22: 202146 events in 0 files, snapshot none (task 9507 ms: download 6539 ms overlapping gunzip 1662 ms, parse 6386 ms, sort 0 ms, write 0 ms, index 695 ms: 12 candidates, 72728 repo-hours, 1287 releases; waiting 531 ms; commit 0 ms)
2026-11-08T08:41:30Z [load_day 2024-11-05] 2024-11-05 hour 23: 193813 events in 0 files, snapshot none (task 8835 ms: download 4791 ms overlapping gunzip 1490 ms, parse 5426 ms, sort 0 ms, write 0 ms, index 892 ms: 7 candidates, 68827 repo-hours, 957 releases; waiting 504 ms; commit 0 ms)
2026-11-08T08:41:39Z [load_day 2024-11-05] 2024-11-05: repo_hour merged from 24 files to 1 (2248871 rows, 9974 ms)
2026-11-08T08:41:42Z [load_day 2024-11-05] 2024-11-05: index committed in 12413 ms (24 + 1 + 24 files)
2026-11-08T08:41:42Z [load_day 2024-11-05] 2024-11-05: 5436624 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:41:42Z [load_day 2024-11-05] attempt 1 succeeded