orcaLog in

Runs · run 137

load_day 2026-10-03, attempt 1 succeeded

Host
4e84322b8c45:23703
Started
2026-11-07T03:43:06Z
Ended
2026-11-07T03:44:07Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/137/load_day/2026-10-03/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:43:06Z [load_day 2026-10-03] attempt 1 started
2026-11-07T03:43:13Z [load_day 2026-10-03] 2026-10-03 hour 0: 79464 events in 2 files, snapshot 8419696235295886952 (task 4706 ms: download 1415 ms overlapping gunzip 286 ms, parse 851 ms, sort 110 ms, write 2299 ms, index 265 ms: 7 candidates, 43986 repo-hours, 441 releases; waiting 545 ms; commit 749 ms)
2026-11-07T03:43:14Z [load_day 2026-10-03] 2026-10-03 hour 1: 80220 events in 2 files, snapshot 4317484521043321088 (task 4651 ms: download 1714 ms overlapping gunzip 254 ms, parse 811 ms, sort 85 ms, write 2355 ms, index 278 ms: 3 candidates, 43671 repo-hours, 803 releases; waiting 552 ms; commit 540 ms)
2026-11-07T03:43:18Z [load_day 2026-10-03] 2026-10-03 hour 2: 84015 events in 2 files, snapshot 8334572008714981973 (task 4195 ms: download 1439 ms overlapping gunzip 282 ms, parse 830 ms, sort 74 ms, write 1926 ms, index 315 ms: 7 candidates, 48038 repo-hours, 857 releases; waiting 561 ms; commit 665 ms)
2026-11-07T03:43:19Z [load_day 2026-10-03] 2026-10-03 hour 3: 88100 events in 2 files, snapshot 238931034998358135 (task 4208 ms: download 1710 ms overlapping gunzip 288 ms, parse 813 ms, sort 67 ms, write 1824 ms, index 305 ms: 10 candidates, 52456 repo-hours, 915 releases; waiting 612 ms; commit 664 ms)
2026-11-07T03:43:23Z [load_day 2026-10-03] 2026-10-03 hour 4: 86500 events in 2 files, snapshot 4670218302981604074 (task 4359 ms: download 1432 ms overlapping gunzip 259 ms, parse 781 ms, sort 85 ms, write 1954 ms, index 367 ms: 10 candidates, 51305 repo-hours, 867 releases; waiting 561 ms; commit 796 ms)
2026-11-07T03:43:24Z [load_day 2026-10-03] 2026-10-03 hour 5: 84560 events in 2 files, snapshot 827782050767198422 (task 4217 ms: download 1898 ms overlapping gunzip 306 ms, parse 838 ms, sort 80 ms, write 1660 ms, index 325 ms: 7 candidates, 48296 repo-hours, 826 releases; waiting 728 ms; commit 661 ms)
2026-11-07T03:43:28Z [load_day 2026-10-03] 2026-10-03 hour 6: 84533 events in 2 files, snapshot 2941734011933125189 (task 4256 ms: download 1472 ms overlapping gunzip 275 ms, parse 817 ms, sort 101 ms, write 1865 ms, index 347 ms: 12 candidates, 47998 repo-hours, 783 releases; waiting 542 ms; commit 711 ms)
2026-11-07T03:43:29Z [load_day 2026-10-03] 2026-10-03 hour 7: 84975 events in 2 files, snapshot 1523653674335534751 (task 4105 ms: download 1350 ms overlapping gunzip 306 ms, parse 902 ms, sort 87 ms, write 1636 ms, index 321 ms: 9 candidates, 49775 repo-hours, 791 releases; waiting 548 ms; commit 810 ms)
2026-11-07T03:43:33Z [load_day 2026-10-03] 2026-10-03 hour 8: 84947 events in 2 files, snapshot 866752714104123942 (task 4510 ms: download 1756 ms overlapping gunzip 243 ms, parse 725 ms, sort 87 ms, write 2100 ms, index 322 ms: 7 candidates, 49928 repo-hours, 748 releases; waiting 734 ms; commit 455 ms)
2026-11-07T03:43:34Z [load_day 2026-10-03] 2026-10-03 hour 9: 88597 events in 2 files, snapshot 2731606418905481573 (task 4114 ms: download 1472 ms overlapping gunzip 247 ms, parse 759 ms, sort 131 ms, write 1771 ms, index 309 ms: 6 candidates, 50402 repo-hours, 634 releases; waiting 566 ms; commit 586 ms)
2026-11-07T03:43:37Z [load_day 2026-10-03] 2026-10-03 hour 10: 86631 events in 2 files, snapshot 7073315406858440869 (task 3113 ms: download 451 ms overlapping gunzip 221 ms, parse 650 ms, sort 65 ms, write 1655 ms, index 315 ms: 7 candidates, 50919 repo-hours, 512 releases; waiting 16 ms; commit 796 ms)
2026-11-07T03:43:38Z [load_day 2026-10-03] 2026-10-03 hour 11: 84538 events in 2 files, snapshot 7076383377267499809 (task 3755 ms: download 1391 ms overlapping gunzip 201 ms, parse 611 ms, sort 59 ms, write 1651 ms, index 326 ms: 9 candidates, 51506 repo-hours, 393 releases; waiting 544 ms; commit 932 ms)
2026-11-07T03:43:41Z [load_day 2026-10-03] 2026-10-03 hour 12: 89648 events in 2 files, snapshot 7756951262337845656 (task 3149 ms: download 902 ms overlapping gunzip 188 ms, parse 564 ms, sort 61 ms, write 1478 ms, index 359 ms: 2 candidates, 53164 repo-hours, 322 releases; waiting 210 ms; commit 604 ms)
2026-11-07T03:43:42Z [load_day 2026-10-03] 2026-10-03 hour 13: 88324 events in 2 files, snapshot 3975794610521774128 (task 3718 ms: download 1762 ms overlapping gunzip 227 ms, parse 690 ms, sort 72 ms, write 1574 ms, index 339 ms: 9 candidates, 50304 repo-hours, 341 releases; waiting 536 ms; commit 610 ms)
2026-11-07T03:43:45Z [load_day 2026-10-03] 2026-10-03 hour 14: 84018 events in 2 files, snapshot 386381042631096851 (task 3447 ms: download 1419 ms overlapping gunzip 187 ms, parse 568 ms, sort 56 ms, write 1354 ms, index 418 ms: 10 candidates, 50397 repo-hours, 309 releases; waiting 566 ms; commit 715 ms)
2026-11-07T03:43:46Z [load_day 2026-10-03] 2026-10-03 hour 15: 86229 events in 2 files, snapshot 1454765431847914226 (task 3231 ms: download 1254 ms overlapping gunzip 184 ms, parse 578 ms, sort 59 ms, write 1293 ms, index 330 ms: 11 candidates, 54146 repo-hours, 265 releases; waiting 536 ms; commit 811 ms)
2026-11-07T03:43:49Z [load_day 2026-10-03] 2026-10-03 hour 16: 81286 events in 2 files, snapshot 7432306457035368702 (task 3729 ms: download 1543 ms overlapping gunzip 208 ms, parse 603 ms, sort 65 ms, write 1436 ms, index 321 ms: 12 candidates, 50268 repo-hours, 322 releases; waiting 879 ms; commit 574 ms)
2026-11-07T03:43:50Z [load_day 2026-10-03] 2026-10-03 hour 17: 79304 events in 2 files, snapshot 3053282134956765253 (task 3283 ms: download 1207 ms overlapping gunzip 166 ms, parse 503 ms, sort 61 ms, write 1286 ms, index 319 ms: 7 candidates, 48460 repo-hours, 191 releases; waiting 621 ms; commit 742 ms)
2026-11-07T03:43:53Z [load_day 2026-10-03] 2026-10-03 hour 18: 77961 events in 2 files, snapshot 1969858147501015409 (task 3192 ms: download 1224 ms overlapping gunzip 196 ms, parse 597 ms, sort 69 ms, write 1237 ms, index 302 ms: 10 candidates, 46859 repo-hours, 261 releases; waiting 557 ms; commit 552 ms)
2026-11-07T03:43:53Z [load_day 2026-10-03] 2026-10-03 hour 19: 73524 events in 2 files, snapshot 6655779272781330190 (task 2920 ms: download 1028 ms overlapping gunzip 166 ms, parse 538 ms, sort 47 ms, write 1072 ms, index 269 ms: 9 candidates, 43129 repo-hours, 153 releases; waiting 530 ms; commit 643 ms)
2026-11-07T03:43:56Z [load_day 2026-10-03] 2026-10-03 hour 20: 76190 events in 2 files, snapshot 4693669727923520435 (task 2999 ms: download 1185 ms overlapping gunzip 158 ms, parse 487 ms, sort 50 ms, write 1192 ms, index 312 ms: 11 candidates, 44983 repo-hours, 187 releases; waiting 546 ms; commit 598 ms)
2026-11-07T03:43:57Z [load_day 2026-10-03] 2026-10-03 hour 21: 61029 events in 2 files, snapshot 3382338032430328589 (task 2716 ms: download 1032 ms overlapping gunzip 135 ms, parse 437 ms, sort 38 ms, write 1047 ms, index 249 ms: 9 candidates, 35944 repo-hours, 157 releases; waiting 538 ms; commit 655 ms)
2026-11-07T03:44:00Z [load_day 2026-10-03] 2026-10-03 hour 22: 70117 events in 2 files, snapshot 3038288659081640851 (task 3196 ms: download 1357 ms overlapping gunzip 181 ms, parse 529 ms, sort 50 ms, write 1263 ms, index 288 ms: 9 candidates, 39735 repo-hours, 235 releases; waiting 578 ms; commit 771 ms)
2026-11-07T03:44:01Z [load_day 2026-10-03] 2026-10-03 hour 23: 70012 events in 2 files, snapshot 1391151132473401036 (task 3538 ms: download 1556 ms overlapping gunzip 210 ms, parse 654 ms, sort 66 ms, write 1492 ms, index 272 ms: 10 candidates, 37535 repo-hours, 289 releases; waiting 546 ms; commit 688 ms)
2026-11-07T03:44:06Z [load_day 2026-10-03] 2026-10-03: repo_hour merged from 24 files to 1 (1143204 rows, 4905 ms)
2026-11-07T03:44:07Z [load_day 2026-10-03] 2026-10-03: index committed in 6207 ms (24 + 1 + 24 files)
2026-11-07T03:44:07Z [load_day 2026-10-03] 2026-10-03: 1954722 events in 24 hours
2026-11-07T03:44:07Z [load_day 2026-10-03] attempt 1 succeeded