orcaLog in

Runs · run 627

load_day 2026-04-25, attempt 1 succeeded

Host
4e84322b8c45:152763
Started
2026-11-07T12:41:32Z
Ended
2026-11-07T12:43:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/627/load_day/2026-04-25/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T12:41:32Z [load_day 2026-04-25] attempt 1 started
2026-11-07T12:41:34Z [load_day 2026-04-25] 2026-04-25: replacing the 69 event files an earlier run committed
2026-11-07T12:41:45Z [load_day 2026-04-25] 2026-04-25 hour 0: 145157 events in 3 files, snapshot 681801476715286780 (task 5295 ms: download 1266 ms overlapping gunzip 437 ms, parse 1483 ms, sort 195 ms, write 2511 ms, index 434 ms: 5 candidates, 64641 repo-hours, 908 releases; waiting 19 ms; commit 5495 ms)
2026-11-07T12:41:47Z [load_day 2026-04-25] 2026-04-25 hour 1: 148214 events in 3 files, snapshot 8475397640532848692 (task 5100 ms: download 909 ms overlapping gunzip 325 ms, parse 1132 ms, sort 164 ms, write 2693 ms, index 538 ms: 11 candidates, 78069 repo-hours, 671 releases; waiting 17 ms; commit 1554 ms)
2026-11-07T12:41:48Z [load_day 2026-04-25] 2026-04-25 hour 2: 149649 events in 3 files, snapshot 6311077232438714148 (task 4938 ms: download 543 ms overlapping gunzip 318 ms, parse 1125 ms, sort 136 ms, write 2281 ms, index 853 ms: 9 candidates, 80343 repo-hours, 585 releases; waiting 26 ms; commit 1238 ms)
2026-11-07T12:41:53Z [load_day 2026-04-25] 2026-04-25 hour 3: 146771 events in 3 files, snapshot 6588001671960771008 (task 6118 ms: download 960 ms overlapping gunzip 565 ms, parse 1934 ms, sort 178 ms, write 2539 ms, index 670 ms: 10 candidates, 69576 repo-hours, 855 releases; waiting 23 ms; commit 1289 ms)
2026-11-07T12:41:55Z [load_day 2026-04-25] 2026-04-25 hour 4: 146694 events in 3 files, snapshot 2435019557913784089 (task 5390 ms: download 1082 ms overlapping gunzip 432 ms, parse 1501 ms, sort 170 ms, write 2494 ms, index 549 ms: 12 candidates, 64805 repo-hours, 765 releases; waiting 16 ms; commit 1814 ms)
2026-11-07T12:42:00Z [load_day 2026-04-25] 2026-04-25 hour 5: 149213 events in 3 files, snapshot 7085546716682217084 (task 6064 ms: download 1234 ms overlapping gunzip 614 ms, parse 1878 ms, sort 125 ms, write 2757 ms, index 445 ms: 5 candidates, 66846 repo-hours, 808 releases; waiting 20 ms; commit 1353 ms)
2026-11-07T12:42:03Z [load_day 2026-04-25] 2026-04-25 hour 6: 146462 events in 3 files, snapshot 7793024652641326847 (task 6768 ms: download 1017 ms overlapping gunzip 426 ms, parse 1433 ms, sort 133 ms, write 3198 ms, index 1338 ms: 7 candidates, 69527 repo-hours, 850 releases; waiting 16 ms; commit 1626 ms)
2026-11-07T12:42:08Z [load_day 2026-04-25] 2026-04-25 hour 7: 147355 events in 3 files, snapshot 2117056925393273223 (task 6420 ms: download 1364 ms overlapping gunzip 503 ms, parse 1602 ms, sort 324 ms, write 2981 ms, index 771 ms: 5 candidates, 75166 repo-hours, 751 releases; waiting 15 ms; commit 2505 ms)
2026-11-07T12:42:11Z [load_day 2026-04-25] 2026-04-25 hour 8: 147450 events in 3 files, snapshot 6192624646501199127 (task 6392 ms: download 1029 ms overlapping gunzip 480 ms, parse 1491 ms, sort 122 ms, write 2965 ms, index 1088 ms: 6 candidates, 72121 repo-hours, 699 releases; waiting 23 ms; commit 2511 ms)
2026-11-07T12:42:14Z [load_day 2026-04-25] 2026-04-25 hour 9: 148481 events in 3 files, snapshot 3126261391775290152 (task 6234 ms: download 808 ms overlapping gunzip 432 ms, parse 1455 ms, sort 221 ms, write 3129 ms, index 715 ms: 11 candidates, 75133 repo-hours, 733 releases; waiting 15 ms; commit 1463 ms)
2026-11-07T12:42:18Z [load_day 2026-04-25] 2026-04-25 hour 10: 146581 events in 3 files, snapshot 9188189904902746079 (task 6502 ms: download 1242 ms overlapping gunzip 562 ms, parse 1823 ms, sort 140 ms, write 3099 ms, index 617 ms: 9 candidates, 73226 repo-hours, 695 releases; waiting 20 ms; commit 2395 ms)
2026-11-07T12:42:22Z [load_day 2026-04-25] 2026-04-25 hour 11: 148373 events in 3 files, snapshot 6837533082136973599 (task 6589 ms: download 1070 ms overlapping gunzip 522 ms, parse 1661 ms, sort 251 ms, write 3351 ms, index 590 ms: 3 candidates, 74857 repo-hours, 726 releases; waiting 16 ms; commit 2335 ms)
2026-11-07T12:42:25Z [load_day 2026-04-25] 2026-04-25 hour 12: 147569 events in 3 files, snapshot 2324317661683503669 (task 6175 ms: download 1081 ms overlapping gunzip 399 ms, parse 1289 ms, sort 150 ms, write 3277 ms, index 809 ms: 8 candidates, 79164 repo-hours, 663 releases; waiting 27 ms; commit 2585 ms)
2026-11-07T12:42:29Z [load_day 2026-04-25] 2026-04-25 hour 13: 155879 events in 4 files, snapshot 5599036836314310803 (task 6315 ms: download 1085 ms overlapping gunzip 532 ms, parse 1697 ms, sort 141 ms, write 3013 ms, index 694 ms: 5 candidates, 87111 repo-hours, 653 releases; waiting 18 ms; commit 2410 ms)
2026-11-07T12:42:32Z [load_day 2026-04-25] 2026-04-25 hour 14: 150460 events in 4 files, snapshot 4330465512825821496 (task 7109 ms: download 1198 ms overlapping gunzip 454 ms, parse 1537 ms, sort 302 ms, write 3956 ms, index 620 ms: 9 candidates, 79190 repo-hours, 635 releases; waiting 20 ms; commit 1394 ms)
2026-11-07T12:42:36Z [load_day 2026-04-25] 2026-04-25 hour 15: 150238 events in 4 files, snapshot 7369892834764307632 (task 6693 ms: download 1415 ms overlapping gunzip 497 ms, parse 1566 ms, sort 152 ms, write 3450 ms, index 799 ms: 9 candidates, 79893 repo-hours, 675 releases; waiting 16 ms; commit 1562 ms)
2026-11-07T12:42:38Z [load_day 2026-04-25] 2026-04-25 hour 16: 151365 events in 4 files, snapshot 3683949634922170414 (task 6084 ms: download 903 ms overlapping gunzip 365 ms, parse 1284 ms, sort 121 ms, write 3380 ms, index 671 ms: 8 candidates, 78760 repo-hours, 677 releases; waiting 28 ms; commit 1377 ms)
2026-11-07T12:42:43Z [load_day 2026-04-25] 2026-04-25 hour 17: 150805 events in 4 files, snapshot 5565432436176563891 (task 6251 ms: download 995 ms overlapping gunzip 491 ms, parse 1680 ms, sort 197 ms, write 2939 ms, index 726 ms: 11 candidates, 78764 repo-hours, 761 releases; waiting 27 ms; commit 1235 ms)
2026-11-07T12:42:48Z [load_day 2026-04-25] 2026-04-25 hour 18: 152924 events in 4 files, snapshot 4218319382708673236 (task 5977 ms: download 987 ms overlapping gunzip 432 ms, parse 1365 ms, sort 159 ms, write 3041 ms, index 715 ms: 11 candidates, 79000 repo-hours, 723 releases; waiting 27 ms; commit 4362 ms)
2026-11-07T12:42:51Z [load_day 2026-04-25] 2026-04-25 hour 19: 146640 events in 3 files, snapshot 6647352018504194652 (task 7284 ms: download 876 ms overlapping gunzip 465 ms, parse 1513 ms, sort 210 ms, write 4076 ms, index 783 ms: 12 candidates, 71526 repo-hours, 713 releases; waiting 15 ms; commit 1564 ms)
2026-11-07T12:42:55Z [load_day 2026-04-25] 2026-04-25 hour 20: 148619 events in 3 files, snapshot 7936541524331177030 (task 7436 ms: download 1142 ms overlapping gunzip 647 ms, parse 1887 ms, sort 147 ms, write 3851 ms, index 655 ms: 7 candidates, 72415 repo-hours, 669 releases; waiting 20 ms; commit 2791 ms)
2026-11-07T12:42:59Z [load_day 2026-04-25] 2026-04-25 hour 21: 150416 events in 4 files, snapshot 7087946972224454257 (task 6948 ms: download 924 ms overlapping gunzip 460 ms, parse 1358 ms, sort 163 ms, write 4002 ms, index 708 ms: 9 candidates, 71610 repo-hours, 746 releases; waiting 22 ms; commit 1569 ms)
2026-11-07T12:43:02Z [load_day 2026-04-25] 2026-04-25 hour 22: 150130 events in 4 files, snapshot 5828801349944102724 (task 7227 ms: download 1100 ms overlapping gunzip 674 ms, parse 1955 ms, sort 205 ms, write 3380 ms, index 780 ms: 5 candidates, 67998 repo-hours, 714 releases; waiting 17 ms; commit 1886 ms)
2026-11-07T12:43:06Z [load_day 2026-04-25] 2026-04-25 hour 23: 147675 events in 3 files, snapshot 8878232591685149162 (task 6902 ms: download 1918 ms overlapping gunzip 465 ms, parse 1454 ms, sort 230 ms, write 3471 ms, index 490 ms: 8 candidates, 67186 repo-hours, 858 releases; waiting 565 ms; commit 1268 ms)
2026-11-07T12:43:14Z [load_day 2026-04-25] 2026-04-25: repo_hour merged from 24 files to 1 (1776927 rows, 7623 ms)
2026-11-07T12:43:16Z [load_day 2026-04-25] 2026-04-25: index committed in 9449 ms (24 + 1 + 24 files)
2026-11-07T12:43:16Z [load_day 2026-04-25] 2026-04-25: 3573120 events in 24 hours
2026-11-07T12:43:16Z [load_day 2026-04-25] attempt 1 succeeded