orcaLog in

Runs · run 1432

load_day 2023-08-26, attempt 1 succeeded

Host
3c2b29713ce8:265164
Started
2026-11-08T00:14:31Z
Ended
2026-11-08T00:17:07Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1432/load_day/2023-08-26/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T00:14:31Z [load_day 2023-08-26] attempt 1 started
2026-11-08T00:14:33Z [load_day 2023-08-26] 2023-08-26: 2 hours in flight, about 1200 MB
2026-11-08T00:14:49Z [load_day 2023-08-26] 2023-08-26 hour 0: 141817 events in 3 files, snapshot 6581236037141238293 (task 13196 ms: download 3108 ms overlapping gunzip 764 ms, parse 3528 ms, sort 161 ms, write 7388 ms, index 537 ms: 9 candidates, 77320 repo-hours, 953 releases; waiting 524 ms; commit 2104 ms)
2026-11-08T00:14:53Z [load_day 2023-08-26] 2023-08-26 hour 1: 127844 events in 3 files, snapshot 6502354286459765249 (task 11944 ms: download 2808 ms overlapping gunzip 763 ms, parse 3272 ms, sort 90 ms, write 6522 ms, index 569 ms: 4 candidates, 71420 repo-hours, 619 releases; waiting 476 ms; commit 4228 ms)
2026-11-08T00:15:00Z [load_day 2023-08-26] 2023-08-26 hour 2: 103279 events in 3 files, snapshot 6189366521786003125 (task 9737 ms: download 2194 ms overlapping gunzip 547 ms, parse 2162 ms, sort 81 ms, write 5577 ms, index 496 ms: 5 candidates, 43001 repo-hours, 550 releases; waiting 521 ms; commit 2025 ms)
2026-11-08T00:15:03Z [load_day 2023-08-26] 2023-08-26 hour 3: 102612 events in 3 files, snapshot 4024680582386521493 (task 8934 ms: download 1634 ms overlapping gunzip 593 ms, parse 2532 ms, sort 82 ms, write 4515 ms, index 426 ms: 4 candidates, 41134 repo-hours, 690 releases; waiting 471 ms; commit 2943 ms)
2026-11-08T00:15:10Z [load_day 2023-08-26] 2023-08-26 hour 4: 101620 events in 3 files, snapshot 659067189205328063 (task 9097 ms: download 1917 ms overlapping gunzip 538 ms, parse 2223 ms, sort 83 ms, write 5110 ms, index 397 ms: 4 candidates, 40821 repo-hours, 589 releases; waiting 491 ms; commit 2126 ms)
2026-11-08T00:15:15Z [load_day 2023-08-26] 2023-08-26 hour 5: 107003 events in 3 files, snapshot 6346265491695806754 (task 8368 ms: download 2160 ms overlapping gunzip 497 ms, parse 2183 ms, sort 78 ms, write 4465 ms, index 307 ms: 3 candidates, 44221 repo-hours, 687 releases; waiting 500 ms; commit 4462 ms)
2026-11-08T00:15:22Z [load_day 2023-08-26] 2023-08-26 hour 6: 116534 events in 3 files, snapshot 5316494193744952878 (task 9907 ms: download 2516 ms overlapping gunzip 576 ms, parse 2390 ms, sort 82 ms, write 5296 ms, index 733 ms: 1 candidates, 52281 repo-hours, 597 releases; waiting 511 ms; commit 2943 ms)
2026-11-08T00:15:25Z [load_day 2023-08-26] 2023-08-26 hour 7: 112258 events in 3 files, snapshot 1670904924299656721 (task 10145 ms: download 2281 ms overlapping gunzip 526 ms, parse 2261 ms, sort 104 ms, write 5877 ms, index 542 ms: 4 candidates, 46631 repo-hours, 539 releases; waiting 482 ms; commit 2664 ms)
2026-11-08T00:15:32Z [load_day 2023-08-26] 2023-08-26 hour 8: 118062 events in 3 files, snapshot 43082636188608090 (task 9515 ms: download 1561 ms overlapping gunzip 587 ms, parse 2513 ms, sort 80 ms, write 5405 ms, index 411 ms: 6 candidates, 50670 repo-hours, 639 releases; waiting 187 ms; commit 2321 ms)
2026-11-08T00:15:37Z [load_day 2023-08-26] 2023-08-26 hour 9: 118981 events in 3 files, snapshot 7220284867866780271 (task 9417 ms: download 2085 ms overlapping gunzip 509 ms, parse 2418 ms, sort 98 ms, write 5190 ms, index 411 ms: 2 candidates, 50415 repo-hours, 717 releases; waiting 484 ms; commit 4103 ms)
2026-11-08T00:15:43Z [load_day 2023-08-26] 2023-08-26 hour 10: 121096 events in 3 files, snapshot 696576605322987927 (task 10061 ms: download 2272 ms overlapping gunzip 528 ms, parse 2399 ms, sort 92 ms, write 5729 ms, index 456 ms: 3 candidates, 51928 repo-hours, 645 releases; waiting 508 ms; commit 2437 ms)
2026-11-08T00:15:46Z [load_day 2023-08-26] 2023-08-26 hour 11: 118204 events in 3 files, snapshot 9180907094123658323 (task 9524 ms: download 1735 ms overlapping gunzip 478 ms, parse 2192 ms, sort 82 ms, write 5594 ms, index 363 ms: 3 candidates, 49519 repo-hours, 638 releases; waiting 506 ms; commit 2757 ms)
2026-11-08T00:16:04Z [load_day 2023-08-26] 2023-08-26 hour 12: 201002 events in 5 files, snapshot 5258292270601596041 (task 13431 ms: download 4398 ms overlapping gunzip 638 ms, parse 3383 ms, sort 163 ms, write 7512 ms, index 876 ms: 5 candidates, 84149 repo-hours, 789 releases; waiting 511 ms; commit 8797 ms)
2026-11-08T00:16:07Z [load_day 2023-08-26] 2023-08-26 hour 13: 151947 events in 4 files, snapshot 8032662364568418999 (task 11957 ms: download 4026 ms overlapping gunzip 584 ms, parse 2860 ms, sort 122 ms, write 7005 ms, index 646 ms: 3 candidates, 75912 repo-hours, 791 releases; waiting 462 ms; commit 2729 ms)
2026-11-08T00:16:11Z [load_day 2023-08-26] 2023-08-26 hour 14: 138253 events in 3 files, snapshot 6763827150350083247 (task 11392 ms: download 4146 ms overlapping gunzip 577 ms, parse 2528 ms, sort 92 ms, write 6842 ms, index 567 ms: 4 candidates, 60140 repo-hours, 766 releases; waiting 498 ms; commit 2423 ms)
2026-11-08T00:16:20Z [load_day 2023-08-26] 2023-08-26 hour 15: 141519 events in 3 files, snapshot 5254815547022653211 (task 11950 ms: download 4433 ms overlapping gunzip 677 ms, parse 3102 ms, sort 100 ms, write 6768 ms, index 461 ms: 8 candidates, 61551 repo-hours, 982 releases; waiting 512 ms; commit 2270 ms)
2026-11-08T00:16:25Z [load_day 2023-08-26] 2023-08-26 hour 16: 136773 events in 3 files, snapshot 7411580531386489121 (task 10992 ms: download 2621 ms overlapping gunzip 555 ms, parse 2569 ms, sort 95 ms, write 6232 ms, index 654 ms: 5 candidates, 59601 repo-hours, 735 releases; waiting 526 ms; commit 4085 ms)
2026-11-08T00:16:33Z [load_day 2023-08-26] 2023-08-26 hour 17: 135212 events in 3 files, snapshot 4061659332883922217 (task 11660 ms: download 2259 ms overlapping gunzip 763 ms, parse 3143 ms, sort 129 ms, write 6443 ms, index 419 ms: 3 candidates, 55443 repo-hours, 648 releases; waiting 476 ms; commit 2945 ms)
2026-11-08T00:16:36Z [load_day 2023-08-26] 2023-08-26 hour 18: 134435 events in 3 files, snapshot 8429598035323176029 (task 11091 ms: download 2142 ms overlapping gunzip 594 ms, parse 2626 ms, sort 169 ms, write 6376 ms, index 531 ms: 7 candidates, 60059 repo-hours, 808 releases; waiting 511 ms; commit 2606 ms)
2026-11-08T00:16:43Z [load_day 2023-08-26] 2023-08-26 hour 19: 120269 events in 3 files, snapshot 4143564586599122367 (task 9771 ms: download 2303 ms overlapping gunzip 562 ms, parse 2533 ms, sort 81 ms, write 5492 ms, index 349 ms: 5 candidates, 48659 repo-hours, 747 releases; waiting 454 ms; commit 2183 ms)
2026-11-08T00:16:47Z [load_day 2023-08-26] 2023-08-26 hour 20: 118457 events in 3 files, snapshot 1364126282299929395 (task 9229 ms: download 2124 ms overlapping gunzip 491 ms, parse 2144 ms, sort 117 ms, write 5331 ms, index 323 ms: 3 candidates, 48393 repo-hours, 636 releases; waiting 533 ms; commit 3500 ms)
2026-11-08T00:16:52Z [load_day 2023-08-26] 2023-08-26 hour 21: 108951 events in 3 files, snapshot 1229447370256943484 (task 7310 ms: download 1313 ms overlapping gunzip 408 ms, parse 1844 ms, sort 74 ms, write 4157 ms, index 318 ms: 7 candidates, 42668 repo-hours, 733 releases; waiting 184 ms; commit 1893 ms)
2026-11-08T00:16:54Z [load_day 2023-08-26] 2023-08-26 hour 22: 99014 events in 2 files, snapshot 7164873428091501350 (task 6551 ms: download 1795 ms overlapping gunzip 368 ms, parse 1589 ms, sort 72 ms, write 3372 ms, index 328 ms: 3 candidates, 38706 repo-hours, 627 releases; waiting 537 ms; commit 2139 ms)
2026-11-08T00:16:59Z [load_day 2023-08-26] 2023-08-26 hour 23: 93804 events in 2 files, snapshot 6865805008708541304 (task 5782 ms: download 1240 ms overlapping gunzip 330 ms, parse 1497 ms, sort 54 ms, write 3103 ms, index 279 ms: 6 candidates, 37160 repo-hours, 555 releases; waiting 268 ms; commit 1913 ms)
2026-11-08T00:17:05Z [load_day 2023-08-26] 2023-08-26: repo_hour merged from 24 files to 1 (1291802 rows, 6162 ms)
2026-11-08T00:17:07Z [load_day 2023-08-26] 2023-08-26: index committed in 8520 ms (24 + 1 + 24 files)
2026-11-08T00:17:07Z [load_day 2023-08-26] 2023-08-26: 2968946 events in 24 hours
2026-11-08T00:17:07Z [load_day 2023-08-26] attempt 1 succeeded