orcaLog in

Runs · run 158

load_day 2026-09-26, attempt 1 succeeded

Host
4e84322b8c45:27271
Started
2026-11-07T03:50:05Z
Ended
2026-11-07T03:50:57Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/158/load_day/2026-09-26/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:50:05Z [load_day 2026-09-26] attempt 1 started
2026-11-07T03:50:10Z [load_day 2026-09-26] 2026-09-26 hour 0: 74847 events in 2 files, snapshot 1337237093516740997 (task 2818 ms: download 1043 ms overlapping gunzip 141 ms, parse 496 ms, sort 89 ms, write 972 ms, index 266 ms: 5 candidates, 36972 repo-hours, 130 releases; waiting 530 ms; commit 851 ms)
2026-11-07T03:50:11Z [load_day 2026-09-26] 2026-09-26 hour 1: 75473 events in 2 files, snapshot 3076496035865077472 (task 2739 ms: download 1004 ms overlapping gunzip 125 ms, parse 462 ms, sort 57 ms, write 1001 ms, index 284 ms: 8 candidates, 39122 repo-hours, 149 releases; waiting 538 ms; commit 776 ms)
2026-11-07T03:50:13Z [load_day 2026-09-26] 2026-09-26 hour 2: 77129 events in 2 files, snapshot 5130004518084415157 (task 2665 ms: download 980 ms overlapping gunzip 129 ms, parse 451 ms, sort 49 ms, write 870 ms, index 316 ms: 5 candidates, 43483 repo-hours, 150 releases; waiting 550 ms; commit 683 ms)
2026-11-07T03:50:14Z [load_day 2026-09-26] 2026-09-26 hour 3: 85888 events in 2 files, snapshot 5685572647365375552 (task 2890 ms: download 1453 ms overlapping gunzip 140 ms, parse 481 ms, sort 58 ms, write 915 ms, index 310 ms: 5 candidates, 45306 repo-hours, 176 releases; waiting 659 ms; commit 526 ms)
2026-11-07T03:50:17Z [load_day 2026-09-26] 2026-09-26 hour 4: 79313 events in 2 files, snapshot 6094643594708817808 (task 2956 ms: download 1107 ms overlapping gunzip 141 ms, parse 479 ms, sort 63 ms, write 960 ms, index 286 ms: 2 candidates, 44851 repo-hours, 189 releases; waiting 520 ms; commit 693 ms)
2026-11-07T03:50:18Z [load_day 2026-09-26] 2026-09-26 hour 5: 82271 events in 2 files, snapshot 412354543726241619 (task 2842 ms: download 1046 ms overlapping gunzip 137 ms, parse 467 ms, sort 52 ms, write 1045 ms, index 339 ms: 5 candidates, 42802 repo-hours, 221 releases; waiting 544 ms; commit 638 ms)
2026-11-07T03:50:20Z [load_day 2026-09-26] 2026-09-26 hour 6: 75673 events in 2 files, snapshot 5123631906958995603 (task 2766 ms: download 985 ms overlapping gunzip 142 ms, parse 479 ms, sort 59 ms, write 999 ms, index 291 ms: 5 candidates, 42338 repo-hours, 159 releases; waiting 537 ms; commit 751 ms)
2026-11-07T03:50:21Z [load_day 2026-09-26] 2026-09-26 hour 7: 74777 events in 2 files, snapshot 8244032246761675782 (task 2630 ms: download 1001 ms overlapping gunzip 124 ms, parse 421 ms, sort 49 ms, write 898 ms, index 276 ms: 6 candidates, 43103 repo-hours, 117 releases; waiting 539 ms; commit 792 ms)
2026-11-07T03:50:23Z [load_day 2026-09-26] 2026-09-26 hour 8: 76782 events in 2 files, snapshot 4906347027284025919 (task 2566 ms: download 942 ms overlapping gunzip 125 ms, parse 423 ms, sort 48 ms, write 852 ms, index 314 ms: 15 candidates, 42389 repo-hours, 98 releases; waiting 532 ms; commit 835 ms)
2026-11-07T03:50:24Z [load_day 2026-09-26] 2026-09-26 hour 9: 79025 events in 2 files, snapshot 4498613473033321156 (task 2765 ms: download 1131 ms overlapping gunzip 138 ms, parse 465 ms, sort 53 ms, write 954 ms, index 293 ms: 11 candidates, 43444 repo-hours, 154 releases; waiting 525 ms; commit 603 ms)
2026-11-07T03:50:26Z [load_day 2026-09-26] 2026-09-26 hour 10: 85442 events in 2 files, snapshot 4342850645445265541 (task 2976 ms: download 1182 ms overlapping gunzip 150 ms, parse 494 ms, sort 58 ms, write 1138 ms, index 291 ms: 3 candidates, 46021 repo-hours, 189 releases; waiting 553 ms; commit 591 ms)
2026-11-07T03:50:27Z [load_day 2026-09-26] 2026-09-26 hour 11: 97029 events in 2 files, snapshot 7806608392085169922 (task 2955 ms: download 1017 ms overlapping gunzip 146 ms, parse 508 ms, sort 66 ms, write 938 ms, index 353 ms: 2 candidates, 52483 repo-hours, 100 releases; waiting 565 ms; commit 549 ms)
2026-11-07T03:50:30Z [load_day 2026-09-26] 2026-09-26 hour 12: 98392 events in 2 files, snapshot 3597952458136886 (task 2851 ms: download 1051 ms overlapping gunzip 150 ms, parse 529 ms, sort 75 ms, write 973 ms, index 315 ms: 6 candidates, 50324 repo-hours, 98 releases; waiting 544 ms; commit 745 ms)
2026-11-07T03:50:31Z [load_day 2026-09-26] 2026-09-26 hour 13: 111085 events in 3 files, snapshot 8441166311075829128 (task 3027 ms: download 1111 ms overlapping gunzip 172 ms, parse 570 ms, sort 69 ms, write 1129 ms, index 339 ms: 6 candidates, 54787 repo-hours, 85 releases; waiting 407 ms; commit 560 ms)
2026-11-07T03:50:34Z [load_day 2026-09-26] 2026-09-26 hour 14: 115761 events in 3 files, snapshot 7766322462179199757 (task 3497 ms: download 1236 ms overlapping gunzip 179 ms, parse 608 ms, sort 72 ms, write 1416 ms, index 381 ms: 37 candidates, 59542 repo-hours, 111 releases; waiting 521 ms; commit 666 ms)
2026-11-07T03:50:35Z [load_day 2026-09-26] 2026-09-26 hour 15: 119150 events in 3 files, snapshot 1488874693905000206 (task 3550 ms: download 1170 ms overlapping gunzip 209 ms, parse 720 ms, sort 79 ms, write 1187 ms, index 442 ms: 41 candidates, 67366 repo-hours, 121 releases; waiting 533 ms; commit 785 ms)
2026-11-07T03:50:39Z [load_day 2026-09-26] 2026-09-26 hour 16: 119550 events in 3 files, snapshot 3472041409655575089 (task 3250 ms: download 1216 ms overlapping gunzip 171 ms, parse 655 ms, sort 83 ms, write 1182 ms, index 395 ms: 13 candidates, 64318 repo-hours, 104 releases; waiting 520 ms; commit 1471 ms)
2026-11-07T03:50:39Z [load_day 2026-09-26] 2026-09-26 hour 17: 121380 events in 3 files, snapshot 3534590258269113180 (task 3477 ms: download 1732 ms overlapping gunzip 185 ms, parse 648 ms, sort 83 ms, write 1297 ms, index 384 ms: 15 candidates, 62233 repo-hours, 116 releases; waiting 560 ms; commit 627 ms)
2026-11-07T03:50:42Z [load_day 2026-09-26] 2026-09-26 hour 18: 120259 events in 3 files, snapshot 4670364585654873184 (task 3314 ms: download 1726 ms overlapping gunzip 170 ms, parse 642 ms, sort 82 ms, write 1193 ms, index 380 ms: 7 candidates, 60381 repo-hours, 79 releases; waiting 553 ms; commit 779 ms)
2026-11-07T03:50:43Z [load_day 2026-09-26] 2026-09-26 hour 19: 123314 events in 3 files, snapshot 7125411459476143604 (task 3291 ms: download 1224 ms overlapping gunzip 169 ms, parse 603 ms, sort 86 ms, write 1222 ms, index 379 ms: 9 candidates, 58162 repo-hours, 87 releases; waiting 546 ms; commit 791 ms)
2026-11-07T03:50:46Z [load_day 2026-09-26] 2026-09-26 hour 20: 116620 events in 3 files, snapshot 8243812011870157007 (task 3211 ms: download 1124 ms overlapping gunzip 163 ms, parse 578 ms, sort 81 ms, write 1224 ms, index 347 ms: 11 candidates, 56586 repo-hours, 66 releases; waiting 543 ms; commit 879 ms)
2026-11-07T03:50:47Z [load_day 2026-09-26] 2026-09-26 hour 21: 114678 events in 3 files, snapshot 2802246881423051418 (task 3295 ms: download 1298 ms overlapping gunzip 173 ms, parse 594 ms, sort 75 ms, write 1252 ms, index 362 ms: 82 candidates, 55376 repo-hours, 101 releases; waiting 542 ms; commit 729 ms)
2026-11-07T03:50:49Z [load_day 2026-09-26] 2026-09-26 hour 22: 114551 events in 3 files, snapshot 1329580445536035735 (task 3157 ms: download 1088 ms overlapping gunzip 165 ms, parse 590 ms, sort 84 ms, write 1163 ms, index 310 ms: 97 candidates, 52030 repo-hours, 79 releases; waiting 536 ms; commit 604 ms)
2026-11-07T03:50:51Z [load_day 2026-09-26] 2026-09-26 hour 23: 114598 events in 3 files, snapshot 570751021188645586 (task 3266 ms: download 1231 ms overlapping gunzip 194 ms, parse 639 ms, sort 83 ms, write 1156 ms, index 300 ms: 7 candidates, 48402 repo-hours, 53 releases; waiting 540 ms; commit 704 ms)
2026-11-07T03:50:56Z [load_day 2026-09-26] 2026-09-26: repo_hour merged from 24 files to 1 (1211821 rows, 5171 ms)
2026-11-07T03:50:57Z [load_day 2026-09-26] 2026-09-26: index committed in 6610 ms (24 + 1 + 24 files)
2026-11-07T03:50:57Z [load_day 2026-09-26] 2026-09-26: 2352987 events in 24 hours
2026-11-07T03:50:57Z [load_day 2026-09-26] attempt 1 succeeded