orcaLog in

Runs · run 110

load_day 2026-10-12, attempt 1 succeeded

Host
4e84322b8c45:20393
Started
2026-11-07T03:36:14Z
Ended
2026-11-07T03:37:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/110/load_day/2026-10-12/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:36:14Z [load_day 2026-10-12] attempt 1 started
2026-11-07T03:36:23Z [load_day 2026-10-12] 2026-10-12 hour 0: 72794 events in 2 files, snapshot 8397141269682056068 (task 3495 ms: download 997 ms overlapping gunzip 138 ms, parse 458 ms, sort 61 ms, write 1666 ms, index 327 ms: 6 candidates, 42424 repo-hours, 262 releases; waiting 529 ms; commit 3703 ms)
2026-11-07T03:36:24Z [load_day 2026-10-12] 2026-10-12 hour 1: 73813 events in 2 files, snapshot 6261458643435539883 (task 3400 ms: download 1095 ms overlapping gunzip 147 ms, parse 508 ms, sort 66 ms, write 1601 ms, index 296 ms: 10 candidates, 42584 repo-hours, 302 releases; waiting 533 ms; commit 741 ms)
2026-11-07T03:36:27Z [load_day 2026-10-12] 2026-10-12 hour 2: 77588 events in 2 files, snapshot 273635378054693487 (task 2956 ms: download 1099 ms overlapping gunzip 150 ms, parse 496 ms, sort 67 ms, write 1147 ms, index 324 ms: 7 candidates, 46570 repo-hours, 312 releases; waiting 540 ms; commit 877 ms)
2026-11-07T03:36:27Z [load_day 2026-10-12] 2026-10-12 hour 3: 79639 events in 2 files, snapshot 4509274484204996245 (task 3106 ms: download 1154 ms overlapping gunzip 171 ms, parse 566 ms, sort 79 ms, write 1118 ms, index 326 ms: 7 candidates, 49771 repo-hours, 367 releases; waiting 551 ms; commit 652 ms)
2026-11-07T03:36:31Z [load_day 2026-10-12] 2026-10-12 hour 4: 81328 events in 2 files, snapshot 3189547191839316841 (task 3160 ms: download 1323 ms overlapping gunzip 167 ms, parse 525 ms, sort 57 ms, write 1181 ms, index 330 ms: 6 candidates, 51115 repo-hours, 349 releases; waiting 569 ms; commit 1499 ms)
2026-11-07T03:36:32Z [load_day 2026-10-12] 2026-10-12 hour 5: 80991 events in 2 files, snapshot 2417999275353321990 (task 3158 ms: download 1385 ms overlapping gunzip 167 ms, parse 548 ms, sort 54 ms, write 1205 ms, index 329 ms: 4 candidates, 50840 repo-hours, 502 releases; waiting 540 ms; commit 544 ms)
2026-11-07T03:36:34Z [load_day 2026-10-12] 2026-10-12 hour 6: 77800 events in 2 files, snapshot 6772752207224639480 (task 3391 ms: download 1612 ms overlapping gunzip 174 ms, parse 551 ms, sort 57 ms, write 1169 ms, index 324 ms: 11 candidates, 47899 repo-hours, 386 releases; waiting 818 ms; commit 626 ms)
2026-11-07T03:36:35Z [load_day 2026-10-12] 2026-10-12 hour 7: 83579 events in 2 files, snapshot 7364717806443685726 (task 3204 ms: download 1364 ms overlapping gunzip 185 ms, parse 591 ms, sort 71 ms, write 1118 ms, index 353 ms: 20 candidates, 51640 repo-hours, 225 releases; waiting 537 ms; commit 466 ms)
2026-11-07T03:36:38Z [load_day 2026-10-12] 2026-10-12 hour 8: 82825 events in 2 files, snapshot 2789339288644545482 (task 2886 ms: download 1448 ms overlapping gunzip 149 ms, parse 484 ms, sort 55 ms, write 1031 ms, index 331 ms: 17 candidates, 51122 repo-hours, 203 releases; waiting 540 ms; commit 750 ms)
2026-11-07T03:36:39Z [load_day 2026-10-12] 2026-10-12 hour 9: 85187 events in 2 files, snapshot 8999240795129648031 (task 2886 ms: download 1172 ms overlapping gunzip 147 ms, parse 499 ms, sort 60 ms, write 999 ms, index 375 ms: 14 candidates, 52785 repo-hours, 201 releases; waiting 539 ms; commit 1076 ms)
2026-11-07T03:36:40Z [load_day 2026-10-12] 2026-10-12 hour 10: 82330 events in 2 files, snapshot 737874792210560170 (task 2246 ms: download 248 ms overlapping gunzip 162 ms, parse 500 ms, sort 68 ms, write 969 ms, index 341 ms: 17 candidates, 51003 repo-hours, 140 releases; waiting 16 ms; commit 618 ms)
2026-11-07T03:36:42Z [load_day 2026-10-12] 2026-10-12 hour 11: 84003 events in 2 files, snapshot 5511704580271934120 (task 2416 ms: download 240 ms overlapping gunzip 142 ms, parse 453 ms, sort 64 ms, write 1181 ms, index 375 ms: 17 candidates, 52223 repo-hours, 111 releases; waiting 18 ms; commit 520 ms)
2026-11-07T03:36:43Z [load_day 2026-10-12] 2026-10-12 hour 12: 85650 events in 2 files, snapshot 8109342196643525221 (task 2314 ms: download 286 ms overlapping gunzip 140 ms, parse 444 ms, sort 62 ms, write 1092 ms, index 352 ms: 8 candidates, 52919 repo-hours, 80 releases; waiting 18 ms; commit 625 ms)
2026-11-07T03:36:45Z [load_day 2026-10-12] 2026-10-12 hour 13: 86200 events in 2 files, snapshot 5681380546996838328 (task 2261 ms: download 274 ms overlapping gunzip 129 ms, parse 424 ms, sort 63 ms, write 1056 ms, index 396 ms: 6 candidates, 54989 repo-hours, 112 releases; waiting 20 ms; commit 637 ms)
2026-11-07T03:36:46Z [load_day 2026-10-12] 2026-10-12 hour 14: 87872 events in 2 files, snapshot 2398705339510504889 (task 2338 ms: download 262 ms overlapping gunzip 127 ms, parse 422 ms, sort 67 ms, write 1124 ms, index 370 ms: 12 candidates, 56866 repo-hours, 125 releases; waiting 20 ms; commit 781 ms)
2026-11-07T03:36:48Z [load_day 2026-10-12] 2026-10-12 hour 15: 87694 events in 2 files, snapshot 3894735066591417755 (task 2188 ms: download 239 ms overlapping gunzip 137 ms, parse 454 ms, sort 64 ms, write 952 ms, index 379 ms: 11 candidates, 55877 repo-hours, 103 releases; waiting 18 ms; commit 731 ms)
2026-11-07T03:36:49Z [load_day 2026-10-12] 2026-10-12 hour 16: 85918 events in 2 files, snapshot 6860479754164236143 (task 2798 ms: download 1154 ms overlapping gunzip 132 ms, parse 451 ms, sort 60 ms, write 959 ms, index 351 ms: 7 candidates, 53538 repo-hours, 74 releases; waiting 530 ms; commit 515 ms)
2026-11-07T03:36:52Z [load_day 2026-10-12] 2026-10-12 hour 17: 85092 events in 2 files, snapshot 2950803079572458222 (task 2747 ms: download 1131 ms overlapping gunzip 130 ms, parse 452 ms, sort 61 ms, write 920 ms, index 371 ms: 9 candidates, 53442 repo-hours, 68 releases; waiting 538 ms; commit 743 ms)
2026-11-07T03:36:53Z [load_day 2026-10-12] 2026-10-12 hour 18: 86423 events in 2 files, snapshot 4076922211346632805 (task 2865 ms: download 999 ms overlapping gunzip 145 ms, parse 497 ms, sort 73 ms, write 947 ms, index 401 ms: 13 candidates, 53664 repo-hours, 74 releases; waiting 525 ms; commit 562 ms)
2026-11-07T03:36:55Z [load_day 2026-10-12] 2026-10-12 hour 19: 85721 events in 2 files, snapshot 2616236449263377184 (task 3076 ms: download 1132 ms overlapping gunzip 141 ms, parse 475 ms, sort 70 ms, write 1059 ms, index 481 ms: 7 candidates, 52044 repo-hours, 114 releases; waiting 535 ms; commit 693 ms)
2026-11-07T03:36:56Z [load_day 2026-10-12] 2026-10-12 hour 20: 84490 events in 2 files, snapshot 4556729620369827892 (task 2949 ms: download 1042 ms overlapping gunzip 146 ms, parse 461 ms, sort 64 ms, write 1027 ms, index 375 ms: 7 candidates, 54822 repo-hours, 107 releases; waiting 557 ms; commit 445 ms)
2026-11-07T03:36:59Z [load_day 2026-10-12] 2026-10-12 hour 21: 84744 events in 2 files, snapshot 1443911368645363771 (task 3174 ms: download 1223 ms overlapping gunzip 147 ms, parse 487 ms, sort 64 ms, write 1318 ms, index 339 ms: 9 candidates, 51164 repo-hours, 99 releases; waiting 533 ms; commit 762 ms)
2026-11-07T03:37:00Z [load_day 2026-10-12] 2026-10-12 hour 22: 80857 events in 2 files, snapshot 7239410923445748829 (task 3037 ms: download 1032 ms overlapping gunzip 166 ms, parse 537 ms, sort 87 ms, write 1109 ms, index 310 ms: 9 candidates, 46430 repo-hours, 120 releases; waiting 555 ms; commit 808 ms)
2026-11-07T03:37:02Z [load_day 2026-10-12] 2026-10-12 hour 23: 79440 events in 2 files, snapshot 6626681784829214046 (task 2143 ms: download 240 ms overlapping gunzip 137 ms, parse 428 ms, sort 61 ms, write 984 ms, index 323 ms: 9 candidates, 45340 repo-hours, 143 releases; waiting 15 ms; commit 673 ms)
2026-11-07T03:37:07Z [load_day 2026-10-12] 2026-10-12: repo_hour merged from 24 files to 1 (1221071 rows, 5470 ms)
2026-11-07T03:37:09Z [load_day 2026-10-12] 2026-10-12: index committed in 6895 ms (24 + 1 + 24 files)
2026-11-07T03:37:09Z [load_day 2026-10-12] 2026-10-12: 1981978 events in 24 hours
2026-11-07T03:37:09Z [load_day 2026-10-12] attempt 1 succeeded