orcaLog in

Runs · run 3028

load_day 2024-09-30, attempt 1 succeeded

Host
73ccef5e07c2:185639
Started
2026-11-08T08:08:50Z
Ended
2026-11-08T08:10:35Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
866 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
163.3 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3028/load_day/2024-09-30/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:08:50Z [load_day 2024-09-30] attempt 1 started
2026-11-08T08:08:51Z [load_day 2024-09-30] 2024-09-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:08:57Z [load_day 2024-09-30] 2024-09-30 hour 0: 178976 events in 0 files, snapshot none (task 5920 ms: download 3335 ms overlapping gunzip 1066 ms, parse 3830 ms, sort 0 ms, write 0 ms, index 579 ms: 15 candidates, 81494 repo-hours, 1024 releases; waiting 175 ms; commit 0 ms)
2026-11-08T08:08:58Z [load_day 2024-09-30] 2024-09-30 hour 1: 199144 events in 0 files, snapshot none (task 6304 ms: download 3543 ms overlapping gunzip 986 ms, parse 3694 ms, sort 0 ms, write 0 ms, index 725 ms: 10 candidates, 104842 repo-hours, 817 releases; waiting 512 ms; commit 0 ms)
2026-11-08T08:09:03Z [load_day 2024-09-30] 2024-09-30 hour 2: 172155 events in 0 files, snapshot none (task 5516 ms: download 3067 ms overlapping gunzip 960 ms, parse 3386 ms, sort 0 ms, write 0 ms, index 539 ms: 9 candidates, 73800 repo-hours, 781 releases; waiting 338 ms; commit 0 ms)
2026-11-08T08:09:04Z [load_day 2024-09-30] 2024-09-30 hour 3: 194651 events in 0 files, snapshot none (task 5822 ms: download 3347 ms overlapping gunzip 1007 ms, parse 3675 ms, sort 0 ms, write 0 ms, index 582 ms: 8 candidates, 76636 repo-hours, 3932 releases; waiting 175 ms; commit 0 ms)
2026-11-08T08:09:10Z [load_day 2024-09-30] 2024-09-30 hour 4: 177750 events in 0 files, snapshot none (task 6380 ms: download 4688 ms overlapping gunzip 955 ms, parse 3326 ms, sort 0 ms, write 0 ms, index 499 ms: 7 candidates, 64296 repo-hours, 748 releases; waiting 773 ms; commit 0 ms)
2026-11-08T08:09:10Z [load_day 2024-09-30] 2024-09-30 hour 5: 184887 events in 0 files, snapshot none (task 5603 ms: download 3690 ms overlapping gunzip 888 ms, parse 3379 ms, sort 0 ms, write 0 ms, index 509 ms: 11 candidates, 68843 repo-hours, 863 releases; waiting 527 ms; commit 0 ms)
2026-11-08T08:09:17Z [load_day 2024-09-30] 2024-09-30 hour 6: 222862 events in 0 files, snapshot none (task 6940 ms: download 4295 ms overlapping gunzip 1106 ms, parse 4155 ms, sort 0 ms, write 0 ms, index 858 ms: 9 candidates, 95924 repo-hours, 977 releases; waiting 517 ms; commit 0 ms)
2026-11-08T08:09:17Z [load_day 2024-09-30] 2024-09-30 hour 7: 221413 events in 0 files, snapshot none (task 6722 ms: download 4391 ms overlapping gunzip 1190 ms, parse 4330 ms, sort 0 ms, write 0 ms, index 689 ms: 12 candidates, 87514 repo-hours, 1046 releases; waiting 235 ms; commit 0 ms)
2026-11-08T08:09:26Z [load_day 2024-09-30] 2024-09-30 hour 8: 235357 events in 0 files, snapshot none (task 8319 ms: download 4543 ms overlapping gunzip 1396 ms, parse 5133 ms, sort 0 ms, write 0 ms, index 1034 ms: 15 candidates, 96704 repo-hours, 1387 releases; waiting 462 ms; commit 0 ms)
2026-11-08T08:09:28Z [load_day 2024-09-30] 2024-09-30 hour 9: 244923 events in 0 files, snapshot none (task 9854 ms: download 7674 ms overlapping gunzip 1435 ms, parse 5110 ms, sort 0 ms, write 0 ms, index 832 ms: 10 candidates, 102490 repo-hours, 1406 releases; waiting 2120 ms; commit 0 ms)
2026-11-08T08:09:34Z [load_day 2024-09-30] 2024-09-30 hour 10: 233553 events in 0 files, snapshot none (task 7530 ms: download 4948 ms overlapping gunzip 1356 ms, parse 4897 ms, sort 0 ms, write 0 ms, index 684 ms: 5 candidates, 94028 repo-hours, 1190 releases; waiting 284 ms; commit 0 ms)
2026-11-08T08:09:36Z [load_day 2024-09-30] 2024-09-30 hour 11: 231339 events in 0 files, snapshot none (task 7873 ms: download 5246 ms overlapping gunzip 1300 ms, parse 4856 ms, sort 0 ms, write 0 ms, index 893 ms: 5 candidates, 89379 repo-hours, 1214 releases; waiting 555 ms; commit 0 ms)
2026-11-08T08:09:42Z [load_day 2024-09-30] 2024-09-30 hour 12: 270664 events in 0 files, snapshot none (task 7639 ms: download 5298 ms overlapping gunzip 1243 ms, parse 4700 ms, sort 0 ms, write 0 ms, index 921 ms: 11 candidates, 133700 repo-hours, 1287 releases; waiting 556 ms; commit 0 ms)
2026-11-08T08:09:44Z [load_day 2024-09-30] 2024-09-30 hour 13: 269895 events in 0 files, snapshot none (task 7370 ms: download 4733 ms overlapping gunzip 1248 ms, parse 4362 ms, sort 0 ms, write 0 ms, index 921 ms: 10 candidates, 121069 repo-hours, 1273 releases; waiting 540 ms; commit 0 ms)
2026-11-08T08:09:50Z [load_day 2024-09-30] 2024-09-30 hour 14: 264138 events in 0 files, snapshot none (task 7030 ms: download 4496 ms overlapping gunzip 1129 ms, parse 4169 ms, sort 0 ms, write 0 ms, index 907 ms: 21 candidates, 110473 repo-hours, 1323 releases; waiting 544 ms; commit 0 ms)
2026-11-08T08:09:51Z [load_day 2024-09-30] 2024-09-30 hour 15: 265610 events in 0 files, snapshot none (task 6824 ms: download 5389 ms overlapping gunzip 1150 ms, parse 4006 ms, sort 0 ms, write 0 ms, index 772 ms: 10 candidates, 112779 repo-hours, 1369 releases; waiting 573 ms; commit 0 ms)
2026-11-08T08:09:59Z [load_day 2024-09-30] 2024-09-30 hour 16: 246590 events in 0 files, snapshot none (task 8496 ms: download 5703 ms overlapping gunzip 1446 ms, parse 5364 ms, sort 0 ms, write 0 ms, index 747 ms: 13 candidates, 101566 repo-hours, 1230 releases; waiting 591 ms; commit 0 ms)
2026-11-08T08:09:59Z [load_day 2024-09-30] 2024-09-30 hour 17: 236713 events in 0 files, snapshot none (task 7852 ms: download 5285 ms overlapping gunzip 1308 ms, parse 5009 ms, sort 0 ms, write 0 ms, index 692 ms: 16 candidates, 94089 repo-hours, 1177 releases; waiting 539 ms; commit 0 ms)
2026-11-08T08:10:07Z [load_day 2024-09-30] 2024-09-30 hour 18: 250360 events in 0 files, snapshot none (task 8149 ms: download 5204 ms overlapping gunzip 1411 ms, parse 5185 ms, sort 0 ms, write 0 ms, index 1074 ms: 17 candidates, 109053 repo-hours, 1301 releases; waiting 184 ms; commit 0 ms)
2026-11-08T08:10:07Z [load_day 2024-09-30] 2024-09-30 hour 19: 218902 events in 0 files, snapshot none (task 7218 ms: download 4710 ms overlapping gunzip 1233 ms, parse 4411 ms, sort 0 ms, write 0 ms, index 742 ms: 8 candidates, 84888 repo-hours, 1094 releases; waiting 485 ms; commit 0 ms)
2026-11-08T08:10:15Z [load_day 2024-09-30] 2024-09-30 hour 20: 209386 events in 0 files, snapshot none (task 7048 ms: download 4327 ms overlapping gunzip 1154 ms, parse 4328 ms, sort 0 ms, write 0 ms, index 660 ms: 7 candidates, 80634 repo-hours, 1177 releases; waiting 590 ms; commit 0 ms)
2026-11-08T08:10:15Z [load_day 2024-09-30] 2024-09-30 hour 21: 189437 events in 0 files, snapshot none (task 6346 ms: download 3792 ms overlapping gunzip 999 ms, parse 3730 ms, sort 0 ms, write 0 ms, index 812 ms: 10 candidates, 74760 repo-hours, 1113 releases; waiting 529 ms; commit 0 ms)
2026-11-08T08:10:23Z [load_day 2024-09-30] 2024-09-30 hour 22: 185422 events in 0 files, snapshot none (task 7854 ms: download 5639 ms overlapping gunzip 866 ms, parse 3529 ms, sort 0 ms, write 0 ms, index 504 ms: 6 candidates, 66210 repo-hours, 1047 releases; waiting 2616 ms; commit 0 ms)
2026-11-08T08:10:23Z [load_day 2024-09-30] 2024-09-30 hour 23: 174022 events in 0 files, snapshot none (task 5573 ms: download 2903 ms overlapping gunzip 811 ms, parse 3137 ms, sort 0 ms, write 0 ms, index 563 ms: 9 candidates, 61740 repo-hours, 797 releases; waiting 721 ms; commit 0 ms)
2026-11-08T08:10:32Z [load_day 2024-09-30] 2024-09-30: repo_hour merged from 24 files to 1 (2186911 rows, 9444 ms)
2026-11-08T08:10:35Z [load_day 2024-09-30] 2024-09-30: index committed in 12101 ms (24 + 1 + 24 files)
2026-11-08T08:10:35Z [load_day 2024-09-30] 2024-09-30: 5278149 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:10:35Z [load_day 2024-09-30] attempt 1 succeeded