orcaLog in

Runs · run 62

load_day 2026-10-28, attempt 1 succeeded

Host
4e84322b8c45:15177
Started
2026-11-07T03:26:27Z
Ended
2026-11-07T03:26:54Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/62/load_day/2026-10-28/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:26:27Z [load_day 2026-10-28] attempt 1 started
2026-11-07T03:26:31Z [load_day 2026-10-28] 2026-10-28 hour 0: 3254 events in 1 files, snapshot 7484748239522378010 (task 1473 ms: download 725 ms overlapping gunzip 48 ms, parse 163 ms, sort 7 ms, write 402 ms, index 33 ms: 0 candidates, 2907 repo-hours, 110 releases; waiting 538 ms; commit 470 ms)
2026-11-07T03:26:32Z [load_day 2026-10-28] 2026-10-28 hour 1: 3466 events in 1 files, snapshot 8699524470035522779 (task 1569 ms: download 741 ms overlapping gunzip 44 ms, parse 152 ms, sort 5 ms, write 397 ms, index 34 ms: 0 candidates, 3008 repo-hours, 161 releases; waiting 565 ms; commit 651 ms)
2026-11-07T03:26:33Z [load_day 2026-10-28] 2026-10-28 hour 2: 3356 events in 1 files, snapshot 711752575221965138 (task 1366 ms: download 708 ms overlapping gunzip 49 ms, parse 135 ms, sort 3 ms, write 310 ms, index 49 ms: 0 candidates, 3016 repo-hours, 124 releases; waiting 533 ms; commit 707 ms)
2026-11-07T03:26:34Z [load_day 2026-10-28] 2026-10-28 hour 3: 3687 events in 1 files, snapshot 6804040755893957891 (task 1414 ms: download 745 ms overlapping gunzip 50 ms, parse 140 ms, sort 4 ms, write 372 ms, index 50 ms: 0 candidates, 3234 repo-hours, 138 releases; waiting 563 ms; commit 456 ms)
2026-11-07T03:26:35Z [load_day 2026-10-28] 2026-10-28 hour 4: 3657 events in 1 files, snapshot 6310535696335202785 (task 1394 ms: download 756 ms overlapping gunzip 52 ms, parse 142 ms, sort 4 ms, write 378 ms, index 37 ms: 0 candidates, 3239 repo-hours, 157 releases; waiting 570 ms; commit 761 ms)
2026-11-07T03:26:36Z [load_day 2026-10-28] 2026-10-28 hour 5: 3571 events in 1 files, snapshot 7917979458355727978 (task 1123 ms: download 422 ms overlapping gunzip 42 ms, parse 138 ms, sort 5 ms, write 352 ms, index 43 ms: 1 candidates, 3170 repo-hours, 122 releases; waiting 257 ms; commit 640 ms)
2026-11-07T03:26:37Z [load_day 2026-10-28] 2026-10-28 hour 6: 3626 events in 1 files, snapshot 4162478321791714593 (task 1454 ms: download 741 ms overlapping gunzip 48 ms, parse 146 ms, sort 4 ms, write 365 ms, index 48 ms: 1 candidates, 3229 repo-hours, 132 releases; waiting 557 ms; commit 495 ms)
2026-11-07T03:26:38Z [load_day 2026-10-28] 2026-10-28 hour 7: 3721 events in 1 files, snapshot 5146438759746203502 (task 1528 ms: download 746 ms overlapping gunzip 52 ms, parse 138 ms, sort 4 ms, write 363 ms, index 35 ms: 0 candidates, 3348 repo-hours, 171 releases; waiting 585 ms; commit 546 ms)
2026-11-07T03:26:39Z [load_day 2026-10-28] 2026-10-28 hour 8: 3874 events in 1 files, snapshot 5255184301602396526 (task 1527 ms: download 728 ms overlapping gunzip 47 ms, parse 146 ms, sort 4 ms, write 355 ms, index 101 ms: 1 candidates, 3495 repo-hours, 197 releases; waiting 544 ms; commit 639 ms)
2026-11-07T03:26:40Z [load_day 2026-10-28] 2026-10-28 hour 9: 3459 events in 1 files, snapshot 7978258434608063291 (task 1355 ms: download 720 ms overlapping gunzip 41 ms, parse 119 ms, sort 3 ms, write 307 ms, index 57 ms: 2 candidates, 3162 repo-hours, 182 releases; waiting 569 ms; commit 550 ms)
2026-11-07T03:26:41Z [load_day 2026-10-28] 2026-10-28 hour 10: 3422 events in 1 files, snapshot 205698904630175978 (task 1373 ms: download 765 ms overlapping gunzip 43 ms, parse 131 ms, sort 4 ms, write 314 ms, index 46 ms: 1 candidates, 3163 repo-hours, 231 releases; waiting 640 ms; commit 657 ms)
2026-11-07T03:26:42Z [load_day 2026-10-28] 2026-10-28 hour 11: 3903 events in 1 files, snapshot 6218435779417529287 (task 859 ms: download 85 ms overlapping gunzip 40 ms, parse 128 ms, sort 4 ms, write 419 ms, index 38 ms: 0 candidates, 3540 repo-hours, 291 releases; waiting 19 ms; commit 693 ms)
2026-11-07T03:26:43Z [load_day 2026-10-28] 2026-10-28 hour 12: 3841 events in 1 files, snapshot 1596310217025056017 (task 755 ms: download 99 ms overlapping gunzip 44 ms, parse 122 ms, sort 5 ms, write 341 ms, index 38 ms: 0 candidates, 3488 repo-hours, 335 releases; waiting 18 ms; commit 695 ms)
2026-11-07T03:26:43Z [load_day 2026-10-28] 2026-10-28 hour 13: 4829 events in 1 files, snapshot 5546061889787642457 (task 900 ms: download 103 ms overlapping gunzip 44 ms, parse 144 ms, sort 6 ms, write 448 ms, index 52 ms: 0 candidates, 4285 repo-hours, 508 releases; waiting 17 ms; commit 604 ms)
2026-11-07T03:26:44Z [load_day 2026-10-28] 2026-10-28 hour 14: 3870 events in 1 files, snapshot 5228868094776535387 (task 734 ms: download 78 ms overlapping gunzip 34 ms, parse 98 ms, sort 5 ms, write 307 ms, index 55 ms: 1 candidates, 3516 repo-hours, 350 releases; waiting 15 ms; commit 767 ms)
2026-11-07T03:26:44Z [load_day 2026-10-28] 2026-10-28 hour 15: 3004 events in 1 files, snapshot 6777021075421747669 (task 679 ms: download 61 ms overlapping gunzip 26 ms, parse 75 ms, sort 3 ms, write 241 ms, index 117 ms: 0 candidates, 2807 repo-hours, 220 releases; waiting 15 ms; commit 542 ms)
2026-11-07T03:26:45Z [load_day 2026-10-28] 2026-10-28 hour 16: 2979 events in 1 files, snapshot 1384216662832349563 (task 635 ms: download 64 ms overlapping gunzip 27 ms, parse 77 ms, sort 3 ms, write 277 ms, index 50 ms: 0 candidates, 2810 repo-hours, 218 releases; waiting 15 ms; commit 527 ms)
2026-11-07T03:26:46Z [load_day 2026-10-28] 2026-10-28 hour 17: 2787 events in 1 files, snapshot 4631878299376841392 (task 630 ms: download 79 ms overlapping gunzip 29 ms, parse 76 ms, sort 2 ms, write 278 ms, index 32 ms: 0 candidates, 2565 repo-hours, 165 releases; waiting 21 ms; commit 570 ms)
2026-11-07T03:26:47Z [load_day 2026-10-28] 2026-10-28 hour 18: 2635 events in 1 files, snapshot 3635307703742185914 (task 1248 ms: download 641 ms overlapping gunzip 32 ms, parse 92 ms, sort 2 ms, write 248 ms, index 40 ms: 1 candidates, 2430 repo-hours, 136 releases; waiting 525 ms; commit 594 ms)
2026-11-07T03:26:47Z [load_day 2026-10-28] 2026-10-28 hour 19: 2621 events in 1 files, snapshot 6599970731388771127 (task 1334 ms: download 657 ms overlapping gunzip 30 ms, parse 85 ms, sort 2 ms, write 326 ms, index 32 ms: 0 candidates, 2438 repo-hours, 124 releases; waiting 551 ms; commit 499 ms)
2026-11-07T03:26:49Z [load_day 2026-10-28] 2026-10-28 hour 20: 2735 events in 1 files, snapshot 6553704858490897316 (task 1134 ms: download 664 ms overlapping gunzip 30 ms, parse 88 ms, sort 2 ms, write 224 ms, index 33 ms: 0 candidates, 2466 repo-hours, 106 releases; waiting 555 ms; commit 614 ms)
2026-11-07T03:26:50Z [load_day 2026-10-28] 2026-10-28 hour 21: 2725 events in 1 files, snapshot 7453744419082546852 (task 1440 ms: download 667 ms overlapping gunzip 33 ms, parse 99 ms, sort 2 ms, write 222 ms, index 33 ms: 0 candidates, 2431 repo-hours, 100 releases; waiting 543 ms; commit 615 ms)
2026-11-07T03:26:51Z [load_day 2026-10-28] 2026-10-28 hour 22: 2954 events in 1 files, snapshot 5275945174638245732 (task 1375 ms: download 694 ms overlapping gunzip 36 ms, parse 101 ms, sort 2 ms, write 248 ms, index 33 ms: 0 candidates, 2626 repo-hours, 119 releases; waiting 564 ms; commit 720 ms)
2026-11-07T03:26:51Z [load_day 2026-10-28] 2026-10-28 hour 23: 3078 events in 1 files, snapshot 2677559578747064830 (task 1390 ms: download 701 ms overlapping gunzip 38 ms, parse 110 ms, sort 3 ms, write 280 ms, index 35 ms: 0 candidates, 2743 repo-hours, 140 releases; waiting 561 ms; commit 653 ms)
2026-11-07T03:26:53Z [load_day 2026-10-28] 2026-10-28: repo_hour merged from 24 files to 1 (73116 rows, 1291 ms)
2026-11-07T03:26:54Z [load_day 2026-10-28] 2026-10-28: index committed in 2802 ms (7 + 1 + 24 files)
2026-11-07T03:26:54Z [load_day 2026-10-28] 2026-10-28: 81054 events in 24 hours
2026-11-07T03:26:54Z [load_day 2026-10-28] attempt 1 succeeded