orcaLog in

Runs · run 59

load_day 2026-10-29, attempt 1 succeeded

Host
4e84322b8c45:14929
Started
2026-11-07T03:26:00Z
Ended
2026-11-07T03:26:26Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/59/load_day/2026-10-29/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:26:00Z [load_day 2026-10-29] attempt 1 started
2026-11-07T03:26:05Z [load_day 2026-10-29] 2026-10-29 hour 0: 3700 events in 1 files, snapshot 6848584724302636527 (task 2012 ms: download 728 ms overlapping gunzip 44 ms, parse 159 ms, sort 6 ms, write 858 ms, index 39 ms: 0 candidates, 3238 repo-hours, 144 releases; waiting 546 ms; commit 527 ms)
2026-11-07T03:26:05Z [load_day 2026-10-29] 2026-10-29 hour 1: 3966 events in 1 files, snapshot 8958519864487550487 (task 1521 ms: download 743 ms overlapping gunzip 56 ms, parse 175 ms, sort 5 ms, write 400 ms, index 40 ms: 0 candidates, 3470 repo-hours, 186 releases; waiting 547 ms; commit 500 ms)
2026-11-07T03:26:07Z [load_day 2026-10-29] 2026-10-29 hour 2: 3816 events in 1 files, snapshot 5174764929742181314 (task 1402 ms: download 733 ms overlapping gunzip 44 ms, parse 129 ms, sort 4 ms, write 317 ms, index 41 ms: 0 candidates, 3418 repo-hours, 164 releases; waiting 576 ms; commit 664 ms)
2026-11-07T03:26:08Z [load_day 2026-10-29] 2026-10-29 hour 3: 3897 events in 1 files, snapshot 5804443681535760116 (task 1386 ms: download 713 ms overlapping gunzip 38 ms, parse 128 ms, sort 4 ms, write 299 ms, index 41 ms: 0 candidates, 3384 repo-hours, 164 releases; waiting 560 ms; commit 594 ms)
2026-11-07T03:26:09Z [load_day 2026-10-29] 2026-10-29 hour 4: 3514 events in 1 files, snapshot 4547503451719827100 (task 1404 ms: download 714 ms overlapping gunzip 41 ms, parse 119 ms, sort 3 ms, write 319 ms, index 56 ms: 0 candidates, 3106 repo-hours, 120 releases; waiting 561 ms; commit 558 ms)
2026-11-07T03:26:10Z [load_day 2026-10-29] 2026-10-29 hour 5: 3503 events in 1 files, snapshot 6982656395157816955 (task 1330 ms: download 711 ms overlapping gunzip 43 ms, parse 124 ms, sort 3 ms, write 320 ms, index 35 ms: 0 candidates, 3114 repo-hours, 157 releases; waiting 554 ms; commit 661 ms)
2026-11-07T03:26:11Z [load_day 2026-10-29] 2026-10-29 hour 6: 4432 events in 1 files, snapshot 66478864757987205 (task 1572 ms: download 737 ms overlapping gunzip 57 ms, parse 159 ms, sort 4 ms, write 379 ms, index 42 ms: 0 candidates, 3853 repo-hours, 170 releases; waiting 556 ms; commit 569 ms)
2026-11-07T03:26:11Z [load_day 2026-10-29] 2026-10-29 hour 7: 4452 events in 1 files, snapshot 7122350050794124390 (task 1601 ms: download 759 ms overlapping gunzip 51 ms, parse 162 ms, sort 5 ms, write 455 ms, index 40 ms: 0 candidates, 3941 repo-hours, 305 releases; waiting 563 ms; commit 446 ms)
2026-11-07T03:26:13Z [load_day 2026-10-29] 2026-10-29 hour 8: 4076 events in 1 files, snapshot 4735580982534597781 (task 1510 ms: download 732 ms overlapping gunzip 46 ms, parse 149 ms, sort 5 ms, write 370 ms, index 48 ms: 1 candidates, 3633 repo-hours, 245 releases; waiting 559 ms; commit 490 ms)
2026-11-07T03:26:14Z [load_day 2026-10-29] 2026-10-29 hour 9: 4101 events in 1 files, snapshot 5111554617313347683 (task 1489 ms: download 737 ms overlapping gunzip 44 ms, parse 155 ms, sort 12 ms, write 379 ms, index 46 ms: 0 candidates, 3674 repo-hours, 246 releases; waiting 557 ms; commit 661 ms)
2026-11-07T03:26:14Z [load_day 2026-10-29] 2026-10-29 hour 10: 4175 events in 1 files, snapshot 1665663819846213816 (task 899 ms: download 101 ms overlapping gunzip 38 ms, parse 111 ms, sort 4 ms, write 398 ms, index 120 ms: 2 candidates, 3773 repo-hours, 272 releases; waiting 21 ms; commit 546 ms)
2026-11-07T03:26:15Z [load_day 2026-10-29] 2026-10-29 hour 11: 4035 events in 1 files, snapshot 7472420091724237661 (task 750 ms: download 84 ms overlapping gunzip 35 ms, parse 105 ms, sort 4 ms, write 330 ms, index 50 ms: 1 candidates, 3674 repo-hours, 255 releases; waiting 16 ms; commit 633 ms)
2026-11-07T03:26:16Z [load_day 2026-10-29] 2026-10-29 hour 12: 4887 events in 1 files, snapshot 3930323551870964252 (task 881 ms: download 98 ms overlapping gunzip 43 ms, parse 126 ms, sort 5 ms, write 436 ms, index 58 ms: 1 candidates, 4380 repo-hours, 327 releases; waiting 15 ms; commit 448 ms)
2026-11-07T03:26:16Z [load_day 2026-10-29] 2026-10-29 hour 13: 4423 events in 1 files, snapshot 5798178214890645953 (task 827 ms: download 88 ms overlapping gunzip 41 ms, parse 126 ms, sort 5 ms, write 419 ms, index 42 ms: 0 candidates, 4032 repo-hours, 277 releases; waiting 16 ms; commit 578 ms)
2026-11-07T03:26:17Z [load_day 2026-10-29] 2026-10-29 hour 14: 3788 events in 1 files, snapshot 4753766518643656723 (task 732 ms: download 80 ms overlapping gunzip 41 ms, parse 107 ms, sort 5 ms, write 328 ms, index 52 ms: 1 candidates, 3499 repo-hours, 272 releases; waiting 19 ms; commit 556 ms)
2026-11-07T03:26:17Z [load_day 2026-10-29] 2026-10-29 hour 15: 3722 events in 1 files, snapshot 7593297591304903616 (task 681 ms: download 70 ms overlapping gunzip 32 ms, parse 90 ms, sort 3 ms, write 296 ms, index 49 ms: 0 candidates, 3473 repo-hours, 236 releases; waiting 18 ms; commit 482 ms)
2026-11-07T03:26:19Z [load_day 2026-10-29] 2026-10-29 hour 16: 3478 events in 1 files, snapshot 6711231136307765531 (task 669 ms: download 69 ms overlapping gunzip 29 ms, parse 82 ms, sort 3 ms, write 281 ms, index 65 ms: 2 candidates, 3225 repo-hours, 235 releases; waiting 19 ms; commit 1151 ms)
2026-11-07T03:26:19Z [load_day 2026-10-29] 2026-10-29 hour 17: 3527 events in 1 files, snapshot 3787698790524826443 (task 676 ms: download 66 ms overlapping gunzip 30 ms, parse 81 ms, sort 3 ms, write 317 ms, index 39 ms: 0 candidates, 3247 repo-hours, 190 releases; waiting 16 ms; commit 596 ms)
2026-11-07T03:26:20Z [load_day 2026-10-29] 2026-10-29 hour 18: 3625 events in 1 files, snapshot 9052489253613177622 (task 667 ms: download 70 ms overlapping gunzip 37 ms, parse 86 ms, sort 3 ms, write 283 ms, index 40 ms: 0 candidates, 3320 repo-hours, 142 releases; waiting 17 ms; commit 518 ms)
2026-11-07T03:26:21Z [load_day 2026-10-29] 2026-10-29 hour 19: 3670 events in 1 files, snapshot 2354206288230254167 (task 650 ms: download 72 ms overlapping gunzip 31 ms, parse 81 ms, sort 3 ms, write 293 ms, index 39 ms: 0 candidates, 3310 repo-hours, 126 releases; waiting 17 ms; commit 627 ms)
2026-11-07T03:26:21Z [load_day 2026-10-29] 2026-10-29 hour 20: 3692 events in 1 files, snapshot 1079959570761558233 (task 729 ms: download 69 ms overlapping gunzip 32 ms, parse 88 ms, sort 3 ms, write 334 ms, index 67 ms: 1 candidates, 3291 repo-hours, 139 releases; waiting 15 ms; commit 633 ms)
2026-11-07T03:26:22Z [load_day 2026-10-29] 2026-10-29 hour 21: 3880 events in 1 files, snapshot 5179877329581142231 (task 710 ms: download 82 ms overlapping gunzip 34 ms, parse 88 ms, sort 4 ms, write 330 ms, index 50 ms: 2 candidates, 3405 repo-hours, 171 releases; waiting 16 ms; commit 548 ms)
2026-11-07T03:26:23Z [load_day 2026-10-29] 2026-10-29 hour 22: 3713 events in 1 files, snapshot 3586928107439083592 (task 639 ms: download 77 ms overlapping gunzip 30 ms, parse 80 ms, sort 4 ms, write 296 ms, index 36 ms: 0 candidates, 3283 repo-hours, 131 releases; waiting 16 ms; commit 619 ms)
2026-11-07T03:26:23Z [load_day 2026-10-29] 2026-10-29 hour 23: 3994 events in 1 files, snapshot 4077273120651604201 (task 755 ms: download 72 ms overlapping gunzip 40 ms, parse 102 ms, sort 4 ms, write 346 ms, index 52 ms: 1 candidates, 3464 repo-hours, 143 releases; waiting 15 ms; commit 334 ms)
2026-11-07T03:26:24Z [load_day 2026-10-29] 2026-10-29: repo_hour merged from 24 files to 1 (84207 rows, 1314 ms)
2026-11-07T03:26:26Z [load_day 2026-10-29] 2026-10-29: index committed in 2820 ms (9 + 1 + 24 files)
2026-11-07T03:26:26Z [load_day 2026-10-29] 2026-10-29: 94066 events in 24 hours
2026-11-07T03:26:26Z [load_day 2026-10-29] attempt 1 succeeded