orcaLog in

Runs · run 128

load_day 2026-10-06, attempt 1 succeeded

Host
4e84322b8c45:22343
Started
2026-11-07T03:40:29Z
Ended
2026-11-07T03:41:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/128/load_day/2026-10-06/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:40:29Z [load_day 2026-10-06] attempt 1 started
2026-11-07T03:40:35Z [load_day 2026-10-06] 2026-10-06 hour 0: 78701 events in 2 files, snapshot 3943701746136768018 (task 3242 ms: download 1080 ms overlapping gunzip 164 ms, parse 530 ms, sort 65 ms, write 1392 ms, index 279 ms: 3 candidates, 44823 repo-hours, 177 releases; waiting 529 ms; commit 469 ms)
2026-11-07T03:40:35Z [load_day 2026-10-06] 2026-10-06 hour 1: 75587 events in 2 files, snapshot 6120541339476726026 (task 3292 ms: download 1144 ms overlapping gunzip 184 ms, parse 600 ms, sort 75 ms, write 1350 ms, index 317 ms: 9 candidates, 43696 repo-hours, 290 releases; waiting 513 ms; commit 623 ms)
2026-11-07T03:40:39Z [load_day 2026-10-06] 2026-10-06 hour 2: 76970 events in 2 files, snapshot 4398617443816378632 (task 3080 ms: download 1160 ms overlapping gunzip 184 ms, parse 549 ms, sort 77 ms, write 1111 ms, index 299 ms: 7 candidates, 44990 repo-hours, 404 releases; waiting 547 ms; commit 740 ms)
2026-11-07T03:40:39Z [load_day 2026-10-06] 2026-10-06 hour 3: 75629 events in 2 files, snapshot 8559582832595094642 (task 2964 ms: download 1088 ms overlapping gunzip 193 ms, parse 605 ms, sort 53 ms, write 1048 ms, index 296 ms: 5 candidates, 46253 repo-hours, 360 releases; waiting 530 ms; commit 539 ms)
2026-11-07T03:40:42Z [load_day 2026-10-06] 2026-10-06 hour 4: 80251 events in 2 files, snapshot 1455869369999549575 (task 2987 ms: download 1133 ms overlapping gunzip 166 ms, parse 546 ms, sort 56 ms, write 1082 ms, index 306 ms: 3 candidates, 45722 repo-hours, 401 releases; waiting 514 ms; commit 627 ms)
2026-11-07T03:40:43Z [load_day 2026-10-06] 2026-10-06 hour 5: 79991 events in 2 files, snapshot 8199682211338809830 (task 3032 ms: download 1090 ms overlapping gunzip 179 ms, parse 567 ms, sort 59 ms, write 1095 ms, index 314 ms: 12 candidates, 49626 repo-hours, 407 releases; waiting 517 ms; commit 694 ms)
2026-11-07T03:40:45Z [load_day 2026-10-06] 2026-10-06 hour 6: 82776 events in 2 files, snapshot 2200910808266678170 (task 2539 ms: download 610 ms overlapping gunzip 144 ms, parse 470 ms, sort 63 ms, write 1142 ms, index 311 ms: 9 candidates, 50029 repo-hours, 285 releases; waiting 183 ms; commit 599 ms)
2026-11-07T03:40:46Z [load_day 2026-10-06] 2026-10-06 hour 7: 84198 events in 2 files, snapshot 6035861426875577439 (task 2800 ms: download 1030 ms overlapping gunzip 158 ms, parse 523 ms, sort 74 ms, write 955 ms, index 322 ms: 5 candidates, 51792 repo-hours, 246 releases; waiting 553 ms; commit 695 ms)
2026-11-07T03:40:49Z [load_day 2026-10-06] 2026-10-06 hour 8: 80843 events in 2 files, snapshot 2690190525170536483 (task 3044 ms: download 1250 ms overlapping gunzip 160 ms, parse 511 ms, sort 67 ms, write 1054 ms, index 381 ms: 9 candidates, 50592 repo-hours, 368 releases; waiting 553 ms; commit 663 ms)
2026-11-07T03:40:50Z [load_day 2026-10-06] 2026-10-06 hour 9: 80302 events in 2 files, snapshot 5247272742850803862 (task 2960 ms: download 1061 ms overlapping gunzip 178 ms, parse 552 ms, sort 55 ms, write 1040 ms, index 312 ms: 5 candidates, 51371 repo-hours, 253 releases; waiting 537 ms; commit 542 ms)
2026-11-07T03:40:52Z [load_day 2026-10-06] 2026-10-06 hour 10: 78577 events in 2 files, snapshot 805115275498420579 (task 2971 ms: download 1309 ms overlapping gunzip 145 ms, parse 482 ms, sort 51 ms, write 985 ms, index 377 ms: 9 candidates, 50523 repo-hours, 248 releases; waiting 549 ms; commit 566 ms)
2026-11-07T03:40:53Z [load_day 2026-10-06] 2026-10-06 hour 11: 83168 events in 2 files, snapshot 4022290439894026762 (task 2771 ms: download 1049 ms overlapping gunzip 159 ms, parse 512 ms, sort 53 ms, write 952 ms, index 332 ms: 5 candidates, 53121 repo-hours, 254 releases; waiting 534 ms; commit 674 ms)
2026-11-07T03:40:56Z [load_day 2026-10-06] 2026-10-06 hour 12: 86821 events in 2 files, snapshot 6614231735292387400 (task 3053 ms: download 1216 ms overlapping gunzip 168 ms, parse 542 ms, sort 72 ms, write 1091 ms, index 354 ms: 8 candidates, 56043 repo-hours, 205 releases; waiting 548 ms; commit 671 ms)
2026-11-07T03:40:57Z [load_day 2026-10-06] 2026-10-06 hour 13: 90974 events in 2 files, snapshot 5500349463192645161 (task 2991 ms: download 1199 ms overlapping gunzip 156 ms, parse 516 ms, sort 58 ms, write 1042 ms, index 368 ms: 9 candidates, 57461 repo-hours, 425 releases; waiting 535 ms; commit 673 ms)
2026-11-07T03:40:59Z [load_day 2026-10-06] 2026-10-06 hour 14: 85774 events in 2 files, snapshot 5629841294142252045 (task 2822 ms: download 1147 ms overlapping gunzip 138 ms, parse 451 ms, sort 58 ms, write 954 ms, index 368 ms: 5 candidates, 56448 repo-hours, 164 releases; waiting 539 ms; commit 1015 ms)
2026-11-07T03:41:00Z [load_day 2026-10-06] 2026-10-06 hour 15: 81854 events in 2 files, snapshot 8005925842299514507 (task 2639 ms: download 905 ms overlapping gunzip 139 ms, parse 434 ms, sort 56 ms, write 880 ms, index 368 ms: 7 candidates, 54282 repo-hours, 108 releases; waiting 415 ms; commit 583 ms)
2026-11-07T03:41:02Z [load_day 2026-10-06] 2026-10-06 hour 16: 77872 events in 2 files, snapshot 5149858178647067781 (task 2626 ms: download 952 ms overlapping gunzip 132 ms, parse 451 ms, sort 48 ms, write 860 ms, index 359 ms: 7 candidates, 50837 repo-hours, 94 releases; waiting 545 ms; commit 600 ms)
2026-11-07T03:41:03Z [load_day 2026-10-06] 2026-10-06 hour 17: 60968 events in 2 files, snapshot 4032601048489554220 (task 2681 ms: download 1004 ms overlapping gunzip 126 ms, parse 391 ms, sort 41 ms, write 936 ms, index 283 ms: 4 candidates, 42354 repo-hours, 123 releases; waiting 546 ms; commit 508 ms)
2026-11-07T03:41:05Z [load_day 2026-10-06] 2026-10-06 hour 18: 27666 events in 1 files, snapshot 3709121264194697097 (task 2027 ms: download 920 ms overlapping gunzip 98 ms, parse 287 ms, sort 19 ms, write 679 ms, index 156 ms: 4 candidates, 21694 repo-hours, 225 releases; waiting 572 ms; commit 680 ms)
2026-11-07T03:41:05Z [load_day 2026-10-06] 2026-10-06 hour 19: 6815 events in 1 files, snapshot 7644561743370419792 (task 1868 ms: download 828 ms overlapping gunzip 75 ms, parse 211 ms, sort 8 ms, write 611 ms, index 62 ms: 1 candidates, 5823 repo-hours, 218 releases; waiting 576 ms; commit 465 ms)
2026-11-07T03:41:07Z [load_day 2026-10-06] 2026-10-06 hour 20: 7714 events in 1 files, snapshot 6041742550292165716 (task 1836 ms: download 841 ms overlapping gunzip 80 ms, parse 226 ms, sort 8 ms, write 632 ms, index 63 ms: 1 candidates, 6374 repo-hours, 252 releases; waiting 563 ms; commit 663 ms)
2026-11-07T03:41:08Z [load_day 2026-10-06] 2026-10-06 hour 21: 6605 events in 1 files, snapshot 7825247186250220075 (task 1765 ms: download 807 ms overlapping gunzip 79 ms, parse 235 ms, sort 9 ms, write 597 ms, index 58 ms: 2 candidates, 5473 repo-hours, 209 releases; waiting 560 ms; commit 585 ms)
2026-11-07T03:41:10Z [load_day 2026-10-06] 2026-10-06 hour 22: 7736 events in 1 files, snapshot 6100444700460617780 (task 2084 ms: download 855 ms overlapping gunzip 95 ms, parse 265 ms, sort 10 ms, write 712 ms, index 102 ms: 3 candidates, 6261 repo-hours, 239 releases; waiting 563 ms; commit 740 ms)
2026-11-07T03:41:10Z [load_day 2026-10-06] 2026-10-06 hour 23: 7889 events in 1 files, snapshot 7696571963405150476 (task 2067 ms: download 878 ms overlapping gunzip 83 ms, parse 245 ms, sort 11 ms, write 765 ms, index 63 ms: 1 candidates, 6326 repo-hours, 247 releases; waiting 616 ms; commit 637 ms)
2026-11-07T03:41:15Z [load_day 2026-10-06] 2026-10-06: repo_hour merged from 24 files to 1 (951914 rows, 4374 ms)
2026-11-07T03:41:16Z [load_day 2026-10-06] 2026-10-06: index committed in 5748 ms (24 + 1 + 24 files)
2026-11-07T03:41:16Z [load_day 2026-10-06] 2026-10-06: 1505681 events in 24 hours
2026-11-07T03:41:16Z [load_day 2026-10-06] attempt 1 succeeded