orcaLog in

Runs · run 350

load_day 2026-07-24, attempt 1 succeeded

Host
4e84322b8c45:65595
Started
2026-11-07T04:57:12Z
Ended
2026-11-07T04:58:15Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/350/load_day/2026-07-24/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:57:12Z [load_day 2026-07-24] attempt 1 started
2026-11-07T04:57:19Z [load_day 2026-07-24] 2026-07-24 hour 0: 173520 events in 4 files, snapshot 3810186268187459557 (task 4052 ms: download 1636 ms overlapping gunzip 223 ms, parse 870 ms, sort 127 ms, write 1672 ms, index 351 ms: 2 candidates, 53859 repo-hours, 24 releases; waiting 501 ms; commit 781 ms)
2026-11-07T04:57:20Z [load_day 2026-07-24] 2026-07-24 hour 1: 166488 events in 4 files, snapshot 4190404129867494488 (task 3948 ms: download 1583 ms overlapping gunzip 200 ms, parse 780 ms, sort 112 ms, write 1584 ms, index 401 ms: 5 candidates, 62791 repo-hours, 26 releases; waiting 522 ms; commit 755 ms)
2026-11-07T04:57:24Z [load_day 2026-07-24] 2026-07-24 hour 2: 166746 events in 4 files, snapshot 9106921897313760759 (task 3921 ms: download 1356 ms overlapping gunzip 203 ms, parse 776 ms, sort 104 ms, write 1667 ms, index 362 ms: 8 candidates, 56887 repo-hours, 35 releases; waiting 513 ms; commit 806 ms)
2026-11-07T04:57:25Z [load_day 2026-07-24] 2026-07-24 hour 3: 167593 events in 4 files, snapshot 272421349669845449 (task 3962 ms: download 1829 ms overlapping gunzip 197 ms, parse 762 ms, sort 106 ms, write 1606 ms, index 473 ms: 2 candidates, 37888 repo-hours, 33 releases; waiting 526 ms; commit 889 ms)
2026-11-07T04:57:28Z [load_day 2026-07-24] 2026-07-24 hour 4: 167394 events in 4 files, snapshot 6697768976147007147 (task 3697 ms: download 1644 ms overlapping gunzip 203 ms, parse 789 ms, sort 113 ms, write 1520 ms, index 238 ms: 2 candidates, 34507 repo-hours, 16 releases; waiting 529 ms; commit 977 ms)
2026-11-07T04:57:29Z [load_day 2026-07-24] 2026-07-24 hour 5: 167368 events in 4 files, snapshot 1341340714556961099 (task 3625 ms: download 1310 ms overlapping gunzip 199 ms, parse 750 ms, sort 101 ms, write 1429 ms, index 229 ms: 4 candidates, 33542 repo-hours, 17 releases; waiting 536 ms; commit 1085 ms)
2026-11-07T04:57:32Z [load_day 2026-07-24] 2026-07-24 hour 6: 168558 events in 4 files, snapshot 6652132632406989731 (task 3600 ms: download 1324 ms overlapping gunzip 205 ms, parse 784 ms, sort 102 ms, write 1478 ms, index 222 ms: 0 candidates, 35552 repo-hours, 26 releases; waiting 511 ms; commit 843 ms)
2026-11-07T04:57:33Z [load_day 2026-07-24] 2026-07-24 hour 7: 168870 events in 4 files, snapshot 2135902734793593197 (task 3582 ms: download 1391 ms overlapping gunzip 194 ms, parse 754 ms, sort 99 ms, write 1424 ms, index 278 ms: 4 candidates, 34001 repo-hours, 12 releases; waiting 535 ms; commit 718 ms)
2026-11-07T04:57:37Z [load_day 2026-07-24] 2026-07-24 hour 8: 169075 events in 4 files, snapshot 5898255870481795113 (task 3820 ms: download 1313 ms overlapping gunzip 202 ms, parse 820 ms, sort 105 ms, write 1539 ms, index 244 ms: 5 candidates, 34057 repo-hours, 17 releases; waiting 538 ms; commit 948 ms)
2026-11-07T04:57:38Z [load_day 2026-07-24] 2026-07-24 hour 9: 168188 events in 4 files, snapshot 5262397566226855556 (task 3637 ms: download 1439 ms overlapping gunzip 215 ms, parse 776 ms, sort 108 ms, write 1477 ms, index 214 ms: 3 candidates, 32078 repo-hours, 8 releases; waiting 521 ms; commit 993 ms)
2026-11-07T04:57:41Z [load_day 2026-07-24] 2026-07-24 hour 10: 170981 events in 4 files, snapshot 920621182897292719 (task 3635 ms: download 1142 ms overlapping gunzip 205 ms, parse 764 ms, sort 108 ms, write 1562 ms, index 254 ms: 3 candidates, 35972 repo-hours, 14 releases; waiting 530 ms; commit 961 ms)
2026-11-07T04:57:42Z [load_day 2026-07-24] 2026-07-24 hour 11: 168160 events in 4 files, snapshot 5879955761919045358 (task 3528 ms: download 1339 ms overlapping gunzip 195 ms, parse 765 ms, sort 110 ms, write 1413 ms, index 246 ms: 4 candidates, 37346 repo-hours, 23 releases; waiting 506 ms; commit 955 ms)
2026-11-07T04:57:46Z [load_day 2026-07-24] 2026-07-24 hour 12: 170861 events in 4 files, snapshot 3177331810862481593 (task 3814 ms: download 1403 ms overlapping gunzip 200 ms, parse 775 ms, sort 110 ms, write 1596 ms, index 263 ms: 6 candidates, 35586 repo-hours, 16 releases; waiting 534 ms; commit 980 ms)
2026-11-07T04:57:47Z [load_day 2026-07-24] 2026-07-24 hour 13: 166785 events in 4 files, snapshot 1112728979498923688 (task 3613 ms: download 1358 ms overlapping gunzip 191 ms, parse 744 ms, sort 103 ms, write 1452 ms, index 275 ms: 4 candidates, 40132 repo-hours, 13 releases; waiting 519 ms; commit 1046 ms)
2026-11-07T04:57:50Z [load_day 2026-07-24] 2026-07-24 hour 14: 164277 events in 4 files, snapshot 128891310624468017 (task 3334 ms: download 1034 ms overlapping gunzip 190 ms, parse 724 ms, sort 101 ms, write 1449 ms, index 290 ms: 4 candidates, 39576 repo-hours, 15 releases; waiting 359 ms; commit 1041 ms)
2026-11-07T04:57:51Z [load_day 2026-07-24] 2026-07-24 hour 15: 165904 events in 4 files, snapshot 108593710723289594 (task 3584 ms: download 1225 ms overlapping gunzip 191 ms, parse 748 ms, sort 103 ms, write 1456 ms, index 316 ms: 6 candidates, 43218 repo-hours, 16 releases; waiting 539 ms; commit 795 ms)
2026-11-07T04:57:54Z [load_day 2026-07-24] 2026-07-24 hour 16: 150867 events in 4 files, snapshot 5277656785378093073 (task 3427 ms: download 1259 ms overlapping gunzip 198 ms, parse 726 ms, sort 100 ms, write 1284 ms, index 301 ms: 7 candidates, 43311 repo-hours, 30 releases; waiting 541 ms; commit 998 ms)
2026-11-07T04:57:55Z [load_day 2026-07-24] 2026-07-24 hour 17: 139191 events in 3 files, snapshot 6950294632969748400 (task 2932 ms: download 918 ms overlapping gunzip 164 ms, parse 625 ms, sort 85 ms, write 1146 ms, index 309 ms: 3 candidates, 43270 repo-hours, 24 releases; waiting 254 ms; commit 992 ms)
2026-11-07T04:57:58Z [load_day 2026-07-24] 2026-07-24 hour 18: 166479 events in 4 files, snapshot 4875645748195069746 (task 3323 ms: download 727 ms overlapping gunzip 189 ms, parse 702 ms, sort 97 ms, write 1598 ms, index 355 ms: 2 candidates, 49507 repo-hours, 15 releases; waiting 187 ms; commit 978 ms)
2026-11-07T04:57:59Z [load_day 2026-07-24] 2026-07-24 hour 19: 168343 events in 4 files, snapshot 8523235446011500548 (task 3873 ms: download 1272 ms overlapping gunzip 203 ms, parse 762 ms, sort 103 ms, write 1596 ms, index 367 ms: 6 candidates, 54689 repo-hours, 27 releases; waiting 610 ms; commit 853 ms)
2026-11-07T04:58:02Z [load_day 2026-07-24] 2026-07-24 hour 20: 170656 events in 4 files, snapshot 9219838082808649033 (task 4030 ms: download 1442 ms overlapping gunzip 207 ms, parse 773 ms, sort 111 ms, write 1679 ms, index 369 ms: 5 candidates, 55561 repo-hours, 12 releases; waiting 536 ms; commit 1105 ms)
2026-11-07T04:58:04Z [load_day 2026-07-24] 2026-07-24 hour 21: 165260 events in 4 files, snapshot 6708309199600919379 (task 4023 ms: download 1516 ms overlapping gunzip 201 ms, parse 753 ms, sort 112 ms, write 1628 ms, index 399 ms: 1 candidates, 54523 repo-hours, 24 releases; waiting 544 ms; commit 854 ms)
2026-11-07T04:58:07Z [load_day 2026-07-24] 2026-07-24 hour 22: 166160 events in 4 files, snapshot 644853988058281231 (task 3768 ms: download 1221 ms overlapping gunzip 202 ms, parse 756 ms, sort 102 ms, write 1629 ms, index 340 ms: 2 candidates, 52926 repo-hours, 36 releases; waiting 524 ms; commit 823 ms)
2026-11-07T04:58:08Z [load_day 2026-07-24] 2026-07-24 hour 23: 166258 events in 4 files, snapshot 4086905060360732405 (task 3710 ms: download 1310 ms overlapping gunzip 198 ms, parse 764 ms, sort 107 ms, write 1490 ms, index 326 ms: 1 candidates, 51340 repo-hours, 19 releases; waiting 525 ms; commit 1068 ms)
2026-11-07T04:58:13Z [load_day 2026-07-24] 2026-07-24: repo_hour merged from 24 files to 1 (1052119 rows, 4838 ms)
2026-11-07T04:58:15Z [load_day 2026-07-24] 2026-07-24: index committed in 6753 ms (23 + 1 + 24 files)
2026-11-07T04:58:15Z [load_day 2026-07-24] 2026-07-24: 3983982 events in 24 hours
2026-11-07T04:58:15Z [load_day 2026-07-24] attempt 1 succeeded