orcaLog in

Runs · run 569

load_day 2026-05-12, attempt 1 succeeded

Host
4e84322b8c45:126962
Started
2026-11-07T06:32:10Z
Ended
2026-11-07T06:33:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/569/load_day/2026-05-12/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:32:10Z [load_day 2026-05-12] attempt 1 started
2026-11-07T06:32:19Z [load_day 2026-05-12] 2026-05-12 hour 0: 147196 events in 3 files, snapshot 4277379023976257300 (task 6001 ms: download 2003 ms overlapping gunzip 350 ms, parse 1216 ms, sort 141 ms, write 2960 ms, index 482 ms: 1 candidates, 71956 repo-hours, 609 releases; waiting 514 ms; commit 1041 ms)
2026-11-07T06:32:21Z [load_day 2026-05-12] 2026-05-12 hour 1: 143172 events in 3 files, snapshot 267406909795355810 (task 5892 ms: download 1778 ms overlapping gunzip 326 ms, parse 1086 ms, sort 150 ms, write 2959 ms, index 468 ms: 7 candidates, 74435 repo-hours, 488 releases; waiting 622 ms; commit 1239 ms)
2026-11-07T06:32:25Z [load_day 2026-05-12] 2026-05-12 hour 2: 158068 events in 4 files, snapshot 7474819880883580652 (task 4517 ms: download 1806 ms overlapping gunzip 247 ms, parse 852 ms, sort 101 ms, write 1879 ms, index 563 ms: 9 candidates, 89962 repo-hours, 149 releases; waiting 540 ms; commit 1196 ms)
2026-11-07T06:32:26Z [load_day 2026-05-12] 2026-05-12 hour 3: 156262 events in 4 files, snapshot 1022055067051476455 (task 4454 ms: download 1671 ms overlapping gunzip 247 ms, parse 865 ms, sort 109 ms, write 1843 ms, index 544 ms: 7 candidates, 85002 repo-hours, 206 releases; waiting 538 ms; commit 1174 ms)
2026-11-07T06:32:31Z [load_day 2026-05-12] 2026-05-12 hour 4: 152299 events in 4 files, snapshot 8823760251636312289 (task 5248 ms: download 1486 ms overlapping gunzip 303 ms, parse 1011 ms, sort 110 ms, write 2357 ms, index 712 ms: 5 candidates, 70488 repo-hours, 448 releases; waiting 538 ms; commit 1134 ms)
2026-11-07T06:32:32Z [load_day 2026-05-12] 2026-05-12 hour 5: 153139 events in 4 files, snapshot 6516057761999367157 (task 4714 ms: download 1480 ms overlapping gunzip 295 ms, parse 971 ms, sort 115 ms, write 2214 ms, index 511 ms: 9 candidates, 74865 repo-hours, 286 releases; waiting 337 ms; commit 1235 ms)
2026-11-07T06:32:36Z [load_day 2026-05-12] 2026-05-12 hour 6: 150170 events in 4 files, snapshot 6758482277182273229 (task 4433 ms: download 1443 ms overlapping gunzip 248 ms, parse 862 ms, sort 111 ms, write 1823 ms, index 536 ms: 4 candidates, 78830 repo-hours, 158 releases; waiting 525 ms; commit 1217 ms)
2026-11-07T06:32:37Z [load_day 2026-05-12] 2026-05-12 hour 7: 157295 events in 4 files, snapshot 2507516527895169924 (task 4143 ms: download 1534 ms overlapping gunzip 221 ms, parse 772 ms, sort 101 ms, write 1737 ms, index 535 ms: 12 candidates, 82005 repo-hours, 91 releases; waiting 526 ms; commit 1172 ms)
2026-11-07T06:32:41Z [load_day 2026-05-12] 2026-05-12 hour 8: 153629 events in 4 files, snapshot 2304666954902467529 (task 3965 ms: download 1267 ms overlapping gunzip 249 ms, parse 789 ms, sort 105 ms, write 1497 ms, index 528 ms: 15 candidates, 82567 repo-hours, 68 releases; waiting 484 ms; commit 1280 ms)
2026-11-07T06:32:42Z [load_day 2026-05-12] 2026-05-12 hour 9: 152245 events in 4 files, snapshot 2025880149148227256 (task 3924 ms: download 1724 ms overlapping gunzip 222 ms, parse 783 ms, sort 100 ms, write 1367 ms, index 561 ms: 8 candidates, 81005 repo-hours, 82 releases; waiting 541 ms; commit 1188 ms)
2026-11-07T06:32:45Z [load_day 2026-05-12] 2026-05-12 hour 10: 155313 events in 4 files, snapshot 7087176300860205794 (task 3962 ms: download 1540 ms overlapping gunzip 212 ms, parse 760 ms, sort 104 ms, write 1460 ms, index 585 ms: 5 candidates, 83836 repo-hours, 76 releases; waiting 537 ms; commit 1203 ms)
2026-11-07T06:32:47Z [load_day 2026-05-12] 2026-05-12 hour 11: 151663 events in 4 files, snapshot 4732439812078905043 (task 3924 ms: download 1256 ms overlapping gunzip 206 ms, parse 756 ms, sort 117 ms, write 1478 ms, index 541 ms: 6 candidates, 83561 repo-hours, 65 releases; waiting 530 ms; commit 1285 ms)
2026-11-07T06:32:50Z [load_day 2026-05-12] 2026-05-12 hour 12: 149276 events in 3 files, snapshot 8223502430501181724 (task 3887 ms: download 1368 ms overlapping gunzip 206 ms, parse 754 ms, sort 99 ms, write 1443 ms, index 545 ms: 6 candidates, 83042 repo-hours, 84 releases; waiting 529 ms; commit 1071 ms)
2026-11-07T06:32:51Z [load_day 2026-05-12] 2026-05-12 hour 13: 146822 events in 3 files, snapshot 3781074771661097365 (task 3716 ms: download 1277 ms overlapping gunzip 202 ms, parse 740 ms, sort 99 ms, write 1329 ms, index 546 ms: 5 candidates, 84186 repo-hours, 69 releases; waiting 523 ms; commit 1000 ms)
2026-11-07T06:32:55Z [load_day 2026-05-12] 2026-05-12 hour 14: 147395 events in 3 files, snapshot 3365552406611257266 (task 4068 ms: download 1148 ms overlapping gunzip 197 ms, parse 693 ms, sort 98 ms, write 1616 ms, index 592 ms: 6 candidates, 91441 repo-hours, 30 releases; waiting 532 ms; commit 1210 ms)
2026-11-07T06:32:56Z [load_day 2026-05-12] 2026-05-12 hour 15: 142783 events in 3 files, snapshot 279242750802930486 (task 3802 ms: download 1297 ms overlapping gunzip 195 ms, parse 701 ms, sort 102 ms, write 1418 ms, index 557 ms: 9 candidates, 80123 repo-hours, 67 releases; waiting 531 ms; commit 1178 ms)
2026-11-07T06:32:59Z [load_day 2026-05-12] 2026-05-12 hour 16: 144540 events in 3 files, snapshot 5211188661995506465 (task 3606 ms: download 1052 ms overlapping gunzip 196 ms, parse 705 ms, sort 97 ms, write 1461 ms, index 567 ms: 9 candidates, 80962 repo-hours, 94 releases; waiting 313 ms; commit 1177 ms)
2026-11-07T06:33:00Z [load_day 2026-05-12] 2026-05-12 hour 17: 142655 events in 3 files, snapshot 7235832538242977280 (task 3781 ms: download 1908 ms overlapping gunzip 191 ms, parse 694 ms, sort 87 ms, write 1411 ms, index 556 ms: 6 candidates, 78758 repo-hours, 82 releases; waiting 529 ms; commit 1069 ms)
2026-11-07T06:33:03Z [load_day 2026-05-12] 2026-05-12 hour 18: 144544 events in 3 files, snapshot 6755947232557012398 (task 3933 ms: download 1206 ms overlapping gunzip 204 ms, parse 749 ms, sort 112 ms, write 1571 ms, index 550 ms: 12 candidates, 76494 repo-hours, 115 releases; waiting 524 ms; commit 1157 ms)
2026-11-07T06:33:05Z [load_day 2026-05-12] 2026-05-12 hour 19: 143546 events in 3 files, snapshot 8005645062926044548 (task 3950 ms: download 1363 ms overlapping gunzip 199 ms, parse 721 ms, sort 107 ms, write 1554 ms, index 536 ms: 6 candidates, 77552 repo-hours, 97 releases; waiting 531 ms; commit 1332 ms)
2026-11-07T06:33:08Z [load_day 2026-05-12] 2026-05-12 hour 20: 138983 events in 3 files, snapshot 752800254342210949 (task 3720 ms: download 1164 ms overlapping gunzip 205 ms, parse 716 ms, sort 106 ms, write 1463 ms, index 502 ms: 8 candidates, 74330 repo-hours, 106 releases; waiting 399 ms; commit 1082 ms)
2026-11-07T06:33:09Z [load_day 2026-05-12] 2026-05-12 hour 21: 127866 events in 3 files, snapshot 8608451633104669811 (task 3049 ms: download 755 ms overlapping gunzip 192 ms, parse 649 ms, sort 82 ms, write 1195 ms, index 469 ms: 3 candidates, 66913 repo-hours, 42 releases; waiting 185 ms; commit 981 ms)
2026-11-07T06:33:12Z [load_day 2026-05-12] 2026-05-12 hour 22: 137258 events in 3 files, snapshot 903988983717260224 (task 3715 ms: download 1368 ms overlapping gunzip 203 ms, parse 743 ms, sort 115 ms, write 1421 ms, index 403 ms: 3 candidates, 65435 repo-hours, 133 releases; waiting 537 ms; commit 1236 ms)
2026-11-07T06:33:15Z [load_day 2026-05-12] 2026-05-12 hour 23: 150276 events in 4 files, snapshot 965467225586745009 (task 4935 ms: download 1768 ms overlapping gunzip 304 ms, parse 1067 ms, sort 130 ms, write 2119 ms, index 460 ms: 5 candidates, 71600 repo-hours, 518 releases; waiting 523 ms; commit 1240 ms)
2026-11-07T06:33:22Z [load_day 2026-05-12] 2026-05-12: repo_hour merged from 24 files to 1 (1889348 rows, 7681 ms)
2026-11-07T06:33:24Z [load_day 2026-05-12] 2026-05-12: index committed in 9348 ms (24 + 1 + 24 files)
2026-11-07T06:33:24Z [load_day 2026-05-12] 2026-05-12: 3546395 events in 24 hours
2026-11-07T06:33:24Z [load_day 2026-05-12] attempt 1 succeeded