orcaLog in

Runs · run 74

load_day 2026-10-24, attempt 1 succeeded

Host
4e84322b8c45:16489
Started
2026-11-07T03:28:44Z
Ended
2026-11-07T03:29:19Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/74/load_day/2026-10-24/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:28:44Z [load_day 2026-10-24] attempt 1 started
2026-11-07T03:28:48Z [load_day 2026-10-24] 2026-10-24 hour 0: 2850 events in 1 files, snapshot 1834416557786640859 (task 1431 ms: download 699 ms overlapping gunzip 43 ms, parse 146 ms, sort 6 ms, write 359 ms, index 47 ms: 1 candidates, 2492 repo-hours, 111 releases; waiting 533 ms; commit 443 ms)
2026-11-07T03:28:48Z [load_day 2026-10-24] 2026-10-24 hour 1: 2662 events in 1 files, snapshot 8807768388660751966 (task 1385 ms: download 688 ms overlapping gunzip 37 ms, parse 114 ms, sort 3 ms, write 331 ms, index 54 ms: 0 candidates, 2311 repo-hours, 82 releases; waiting 546 ms; commit 776 ms)
2026-11-07T03:28:50Z [load_day 2026-10-24] 2026-10-24 hour 2: 2845 events in 1 files, snapshot 3298766835262876677 (task 1327 ms: download 661 ms overlapping gunzip 44 ms, parse 119 ms, sort 3 ms, write 289 ms, index 40 ms: 0 candidates, 2404 repo-hours, 108 releases; waiting 510 ms; commit 691 ms)
2026-11-07T03:28:50Z [load_day 2026-10-24] 2026-10-24 hour 3: 5126 events in 1 files, snapshot 2849501504202838778 (task 1574 ms: download 725 ms overlapping gunzip 45 ms, parse 131 ms, sort 5 ms, write 336 ms, index 70 ms: 1 candidates, 4494 repo-hours, 129 releases; waiting 564 ms; commit 444 ms)
2026-11-07T03:28:52Z [load_day 2026-10-24] 2026-10-24 hour 4: 11041 events in 1 files, snapshot 7797816402244168656 (task 1498 ms: download 737 ms overlapping gunzip 47 ms, parse 150 ms, sort 7 ms, write 324 ms, index 81 ms: 2 candidates, 8889 repo-hours, 119 releases; waiting 558 ms; commit 575 ms)
2026-11-07T03:28:52Z [load_day 2026-10-24] 2026-10-24 hour 5: 16529 events in 1 files, snapshot 7721498610376767710 (task 1520 ms: download 780 ms overlapping gunzip 53 ms, parse 166 ms, sort 10 ms, write 385 ms, index 111 ms: 6 candidates, 12713 repo-hours, 108 releases; waiting 584 ms; commit 616 ms)
2026-11-07T03:28:54Z [load_day 2026-10-24] 2026-10-24 hour 6: 22703 events in 1 files, snapshot 1694176438672335012 (task 1710 ms: download 778 ms overlapping gunzip 68 ms, parse 212 ms, sort 20 ms, write 423 ms, index 125 ms: 5 candidates, 16640 repo-hours, 87 releases; waiting 540 ms; commit 600 ms)
2026-11-07T03:28:55Z [load_day 2026-10-24] 2026-10-24 hour 7: 27256 events in 1 files, snapshot 1483541180673689546 (task 1750 ms: download 801 ms overlapping gunzip 69 ms, parse 212 ms, sort 16 ms, write 446 ms, index 144 ms: 2 candidates, 19700 repo-hours, 115 releases; waiting 558 ms; commit 686 ms)
2026-11-07T03:28:56Z [load_day 2026-10-24] 2026-10-24 hour 8: 27418 events in 1 files, snapshot 3008188001900391155 (task 1914 ms: download 811 ms overlapping gunzip 74 ms, parse 233 ms, sort 17 ms, write 607 ms, index 166 ms: 4 candidates, 19953 repo-hours, 120 releases; waiting 558 ms; commit 523 ms)
2026-11-07T03:28:57Z [load_day 2026-10-24] 2026-10-24 hour 9: 28181 events in 1 files, snapshot 8967309567825342389 (task 2051 ms: download 970 ms overlapping gunzip 78 ms, parse 238 ms, sort 25 ms, write 544 ms, index 160 ms: 4 candidates, 20568 repo-hours, 128 releases; waiting 704 ms; commit 582 ms)
2026-11-07T03:28:58Z [load_day 2026-10-24] 2026-10-24 hour 10: 27645 events in 1 files, snapshot 724251331863778488 (task 1221 ms: download 128 ms overlapping gunzip 63 ms, parse 191 ms, sort 16 ms, write 509 ms, index 221 ms: 4 candidates, 20704 repo-hours, 163 releases; waiting 15 ms; commit 572 ms)
2026-11-07T03:28:59Z [load_day 2026-10-24] 2026-10-24 hour 11: 27997 events in 1 files, snapshot 1093309796195281953 (task 1651 ms: download 648 ms overlapping gunzip 70 ms, parse 226 ms, sort 17 ms, write 503 ms, index 135 ms: 0 candidates, 20911 repo-hours, 130 releases; waiting 397 ms; commit 686 ms)
2026-11-07T03:29:01Z [load_day 2026-10-24] 2026-10-24 hour 12: 31538 events in 1 files, snapshot 2854196650208885883 (task 1974 ms: download 822 ms overlapping gunzip 90 ms, parse 267 ms, sort 20 ms, write 579 ms, index 161 ms: 4 candidates, 23190 repo-hours, 138 releases; waiting 542 ms; commit 663 ms)
2026-11-07T03:29:02Z [load_day 2026-10-24] 2026-10-24 hour 13: 31876 events in 1 files, snapshot 1938823277058934094 (task 1966 ms: download 829 ms overlapping gunzip 79 ms, parse 250 ms, sort 20 ms, write 589 ms, index 168 ms: 5 candidates, 23744 repo-hours, 146 releases; waiting 561 ms; commit 584 ms)
2026-11-07T03:29:03Z [load_day 2026-10-24] 2026-10-24 hour 14: 35351 events in 1 files, snapshot 7008651502866844080 (task 1998 ms: download 844 ms overlapping gunzip 84 ms, parse 260 ms, sort 24 ms, write 603 ms, index 192 ms: 5 candidates, 26222 repo-hours, 141 releases; waiting 552 ms; commit 565 ms)
2026-11-07T03:29:04Z [load_day 2026-10-24] 2026-10-24 hour 15: 36829 events in 1 files, snapshot 3114394107414358051 (task 1900 ms: download 702 ms overlapping gunzip 73 ms, parse 229 ms, sort 24 ms, write 574 ms, index 185 ms: 9 candidates, 28441 repo-hours, 143 releases; waiting 494 ms; commit 602 ms)
2026-11-07T03:29:06Z [load_day 2026-10-24] 2026-10-24 hour 16: 36920 events in 1 files, snapshot 6892157282716950191 (task 1964 ms: download 850 ms overlapping gunzip 84 ms, parse 255 ms, sort 23 ms, write 577 ms, index 172 ms: 3 candidates, 26047 repo-hours, 114 releases; waiting 558 ms; commit 675 ms)
2026-11-07T03:29:07Z [load_day 2026-10-24] 2026-10-24 hour 17: 34335 events in 1 files, snapshot 6152715450909705624 (task 1825 ms: download 771 ms overlapping gunzip 78 ms, parse 257 ms, sort 31 ms, write 550 ms, index 176 ms: 2 candidates, 25105 repo-hours, 141 releases; waiting 506 ms; commit 713 ms)
2026-11-07T03:29:08Z [load_day 2026-10-24] 2026-10-24 hour 18: 34922 events in 1 files, snapshot 2712627444078959964 (task 2009 ms: download 850 ms overlapping gunzip 94 ms, parse 279 ms, sort 24 ms, write 603 ms, index 178 ms: 6 candidates, 25464 repo-hours, 125 releases; waiting 541 ms; commit 803 ms)
2026-11-07T03:29:09Z [load_day 2026-10-24] 2026-10-24 hour 19: 31757 events in 1 files, snapshot 2766587271316438948 (task 1877 ms: download 813 ms overlapping gunzip 73 ms, parse 245 ms, sort 21 ms, write 557 ms, index 166 ms: 6 candidates, 23150 repo-hours, 117 releases; waiting 564 ms; commit 633 ms)
2026-11-07T03:29:11Z [load_day 2026-10-24] 2026-10-24 hour 20: 34723 events in 1 files, snapshot 7408950953732598410 (task 1954 ms: download 824 ms overlapping gunzip 85 ms, parse 272 ms, sort 31 ms, write 539 ms, index 188 ms: 10 candidates, 25069 repo-hours, 119 releases; waiting 559 ms; commit 715 ms)
2026-11-07T03:29:12Z [load_day 2026-10-24] 2026-10-24 hour 21: 36400 events in 1 files, snapshot 7769802087066766581 (task 2193 ms: download 886 ms overlapping gunzip 84 ms, parse 268 ms, sort 24 ms, write 568 ms, index 201 ms: 6 candidates, 25083 repo-hours, 111 releases; waiting 582 ms; commit 558 ms)
2026-11-07T03:29:14Z [load_day 2026-10-24] 2026-10-24 hour 22: 36891 events in 1 files, snapshot 1614236072406624262 (task 1949 ms: download 860 ms overlapping gunzip 92 ms, parse 285 ms, sort 24 ms, write 585 ms, index 184 ms: 5 candidates, 25433 repo-hours, 119 releases; waiting 544 ms; commit 734 ms)
2026-11-07T03:29:14Z [load_day 2026-10-24] 2026-10-24 hour 23: 36016 events in 1 files, snapshot 2280347496798974441 (task 2076 ms: download 879 ms overlapping gunzip 95 ms, parse 309 ms, sort 25 ms, write 587 ms, index 170 ms: 6 candidates, 23503 repo-hours, 132 releases; waiting 566 ms; commit 703 ms)
2026-11-07T03:29:17Z [load_day 2026-10-24] 2026-10-24: repo_hour merged from 24 files to 1 (452230 rows, 2724 ms)
2026-11-07T03:29:19Z [load_day 2026-10-24] 2026-10-24: index committed in 4708 ms (21 + 1 + 24 files)
2026-11-07T03:29:19Z [load_day 2026-10-24] 2026-10-24: 619811 events in 24 hours
2026-11-07T03:29:19Z [load_day 2026-10-24] attempt 1 succeeded