orcaLog in

Runs · run 98

load_day 2026-10-16, attempt 1 succeeded

Host
4e84322b8c45:19007
Started
2026-11-07T03:33:37Z
Ended
2026-11-07T03:34:07Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/98/load_day/2026-10-16/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:33:37Z [load_day 2026-10-16] attempt 1 started
2026-11-07T03:33:41Z [load_day 2026-10-16] 2026-10-16 hour 0: 5164 events in 1 files, snapshot 3100421313110641327 (task 1740 ms: download 771 ms overlapping gunzip 62 ms, parse 211 ms, sort 15 ms, write 547 ms, index 43 ms: 0 candidates, 4268 repo-hours, 346 releases; waiting 533 ms; commit 781 ms)
2026-11-07T03:33:43Z [load_day 2026-10-16] 2026-10-16 hour 1: 6959 events in 1 files, snapshot 6038384287528218202 (task 2118 ms: download 859 ms overlapping gunzip 90 ms, parse 285 ms, sort 22 ms, write 829 ms, index 47 ms: 0 candidates, 5580 repo-hours, 438 releases; waiting 540 ms; commit 1203 ms)
2026-11-07T03:33:43Z [load_day 2026-10-16] 2026-10-16 hour 2: 7004 events in 1 files, snapshot 6005484306771924876 (task 1270 ms: download 159 ms overlapping gunzip 85 ms, parse 238 ms, sort 9 ms, write 688 ms, index 61 ms: 1 candidates, 5730 repo-hours, 414 releases; waiting 14 ms; commit 521 ms)
2026-11-07T03:33:44Z [load_day 2026-10-16] 2026-10-16 hour 3: 6543 events in 1 files, snapshot 5232834766163305573 (task 1268 ms: download 164 ms overlapping gunzip 90 ms, parse 256 ms, sort 24 ms, write 648 ms, index 47 ms: 0 candidates, 5284 repo-hours, 476 releases; waiting 16 ms; commit 728 ms)
2026-11-07T03:33:45Z [load_day 2026-10-16] 2026-10-16 hour 4: 6196 events in 1 files, snapshot 1771438223274446511 (task 1225 ms: download 149 ms overlapping gunzip 83 ms, parse 208 ms, sort 8 ms, write 647 ms, index 66 ms: 0 candidates, 4902 repo-hours, 387 releases; waiting 18 ms; commit 733 ms)
2026-11-07T03:33:46Z [load_day 2026-10-16] 2026-10-16 hour 5: 5604 events in 1 files, snapshot 8782215361254409641 (task 1090 ms: download 155 ms overlapping gunzip 73 ms, parse 188 ms, sort 7 ms, write 566 ms, index 46 ms: 0 candidates, 4515 repo-hours, 414 releases; waiting 16 ms; commit 666 ms)
2026-11-07T03:33:47Z [load_day 2026-10-16] 2026-10-16 hour 6: 4943 events in 1 files, snapshot 3687289736938767493 (task 923 ms: download 124 ms overlapping gunzip 59 ms, parse 142 ms, sort 5 ms, write 468 ms, index 41 ms: 0 candidates, 4254 repo-hours, 250 releases; waiting 20 ms; commit 838 ms)
2026-11-07T03:33:47Z [load_day 2026-10-16] 2026-10-16 hour 7: 5101 events in 1 files, snapshot 1880495949116483441 (task 957 ms: download 131 ms overlapping gunzip 63 ms, parse 162 ms, sort 6 ms, write 485 ms, index 43 ms: 0 candidates, 4381 repo-hours, 284 releases; waiting 18 ms; commit 805 ms)
2026-11-07T03:33:48Z [load_day 2026-10-16] 2026-10-16 hour 8: 5228 events in 1 files, snapshot 967392306842351680 (task 1012 ms: download 127 ms overlapping gunzip 69 ms, parse 167 ms, sort 6 ms, write 499 ms, index 55 ms: 1 candidates, 4566 repo-hours, 296 releases; waiting 15 ms; commit 762 ms)
2026-11-07T03:33:49Z [load_day 2026-10-16] 2026-10-16 hour 9: 5005 events in 1 files, snapshot 5305956778657686204 (task 941 ms: download 131 ms overlapping gunzip 54 ms, parse 131 ms, sort 6 ms, write 464 ms, index 70 ms: 1 candidates, 4413 repo-hours, 276 releases; waiting 20 ms; commit 546 ms)
2026-11-07T03:33:50Z [load_day 2026-10-16] 2026-10-16 hour 10: 5585 events in 1 files, snapshot 4197591955938829681 (task 1680 ms: download 814 ms overlapping gunzip 75 ms, parse 199 ms, sort 6 ms, write 486 ms, index 51 ms: 0 candidates, 4873 repo-hours, 432 releases; waiting 565 ms; commit 543 ms)
2026-11-07T03:33:51Z [load_day 2026-10-16] 2026-10-16 hour 11: 5891 events in 1 files, snapshot 6408933289674670509 (task 1737 ms: download 821 ms overlapping gunzip 85 ms, parse 213 ms, sort 7 ms, write 514 ms, index 47 ms: 0 candidates, 5153 repo-hours, 350 releases; waiting 569 ms; commit 691 ms)
2026-11-07T03:33:53Z [load_day 2026-10-16] 2026-10-16 hour 12: 6171 events in 1 files, snapshot 511277467027214624 (task 1823 ms: download 801 ms overlapping gunzip 75 ms, parse 201 ms, sort 7 ms, write 625 ms, index 46 ms: 0 candidates, 5364 repo-hours, 319 releases; waiting 563 ms; commit 675 ms)
2026-11-07T03:33:53Z [load_day 2026-10-16] 2026-10-16 hour 13: 5768 events in 1 files, snapshot 6550154039867530588 (task 1718 ms: download 815 ms overlapping gunzip 68 ms, parse 192 ms, sort 7 ms, write 512 ms, index 46 ms: 0 candidates, 5095 repo-hours, 261 releases; waiting 592 ms; commit 573 ms)
2026-11-07T03:33:55Z [load_day 2026-10-16] 2026-10-16 hour 14: 5624 events in 1 files, snapshot 5932195710653896 (task 1486 ms: download 616 ms overlapping gunzip 67 ms, parse 178 ms, sort 6 ms, write 507 ms, index 55 ms: 0 candidates, 5005 repo-hours, 268 releases; waiting 393 ms; commit 791 ms)
2026-11-07T03:33:56Z [load_day 2026-10-16] 2026-10-16 hour 15: 4367 events in 1 files, snapshot 7214690269463963191 (task 1497 ms: download 760 ms overlapping gunzip 51 ms, parse 138 ms, sort 4 ms, write 386 ms, index 48 ms: 0 candidates, 3943 repo-hours, 199 releases; waiting 584 ms; commit 1500 ms)
2026-11-07T03:33:57Z [load_day 2026-10-16] 2026-10-16 hour 16: 3995 events in 1 files, snapshot 1489983104222387407 (task 1416 ms: download 724 ms overlapping gunzip 49 ms, parse 135 ms, sort 4 ms, write 349 ms, index 55 ms: 0 candidates, 3583 repo-hours, 160 releases; waiting 549 ms; commit 602 ms)
2026-11-07T03:33:58Z [load_day 2026-10-16] 2026-10-16 hour 17: 3999 events in 1 files, snapshot 6486945792395035119 (task 1433 ms: download 683 ms overlapping gunzip 45 ms, parse 125 ms, sort 4 ms, write 374 ms, index 66 ms: 1 candidates, 3519 repo-hours, 136 releases; waiting 519 ms; commit 577 ms)
2026-11-07T03:33:59Z [load_day 2026-10-16] 2026-10-16 hour 18: 3747 events in 1 files, snapshot 8176144391037051259 (task 1355 ms: download 706 ms overlapping gunzip 43 ms, parse 119 ms, sort 4 ms, write 294 ms, index 36 ms: 0 candidates, 3380 repo-hours, 206 releases; waiting 553 ms; commit 657 ms)
2026-11-07T03:34:00Z [load_day 2026-10-16] 2026-10-16 hour 19: 3094 events in 1 files, snapshot 8259019270136948888 (task 1327 ms: download 688 ms overlapping gunzip 38 ms, parse 103 ms, sort 3 ms, write 281 ms, index 45 ms: 1 candidates, 2802 repo-hours, 113 releases; waiting 554 ms; commit 667 ms)
2026-11-07T03:34:01Z [load_day 2026-10-16] 2026-10-16 hour 20: 4566 events in 1 files, snapshot 5170817854069221601 (task 1383 ms: download 737 ms overlapping gunzip 48 ms, parse 149 ms, sort 4 ms, write 381 ms, index 41 ms: 0 candidates, 3980 repo-hours, 216 releases; waiting 553 ms; commit 786 ms)
2026-11-07T03:34:02Z [load_day 2026-10-16] 2026-10-16 hour 21: 4154 events in 1 files, snapshot 868389899398564371 (task 1525 ms: download 719 ms overlapping gunzip 46 ms, parse 130 ms, sort 5 ms, write 398 ms, index 56 ms: 0 candidates, 3599 repo-hours, 167 releases; waiting 553 ms; commit 551 ms)
2026-11-07T03:34:03Z [load_day 2026-10-16] 2026-10-16 hour 22: 3326 events in 1 files, snapshot 2562023669712952366 (task 1309 ms: download 714 ms overlapping gunzip 37 ms, parse 102 ms, sort 3 ms, write 277 ms, index 33 ms: 0 candidates, 2843 repo-hours, 128 releases; waiting 583 ms; commit 704 ms)
2026-11-07T03:34:04Z [load_day 2026-10-16] 2026-10-16 hour 23: 3367 events in 1 files, snapshot 6723253936896149730 (task 1454 ms: download 711 ms overlapping gunzip 43 ms, parse 111 ms, sort 3 ms, write 314 ms, index 88 ms: 1 candidates, 2872 repo-hours, 129 releases; waiting 564 ms; commit 756 ms)
2026-11-07T03:34:05Z [load_day 2026-10-16] 2026-10-16: repo_hour merged from 24 files to 1 (103904 rows, 1404 ms)
2026-11-07T03:34:07Z [load_day 2026-10-16] 2026-10-16: index committed in 3277 ms (6 + 1 + 24 files)
2026-11-07T03:34:07Z [load_day 2026-10-16] 2026-10-16: 121401 events in 24 hours
2026-11-07T03:34:07Z [load_day 2026-10-16] attempt 1 succeeded