orcaLog in

Runs · run 443

load_day 2026-06-23, attempt 1 succeeded

Host
4e84322b8c45:92297
Started
2026-11-07T05:37:01Z
Ended
2026-11-07T05:38:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/443/load_day/2026-06-23/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:37:01Z [load_day 2026-06-23] attempt 1 started
2026-11-07T05:37:08Z [load_day 2026-06-23] 2026-06-23 hour 0: 151260 events in 4 files, snapshot 8964886076593722511 (task 3646 ms: download 1129 ms overlapping gunzip 188 ms, parse 732 ms, sort 106 ms, write 1364 ms, index 402 ms: 8 candidates, 65230 repo-hours, 0 releases; waiting 500 ms; commit 1142 ms)
2026-11-07T05:37:09Z [load_day 2026-06-23] 2026-06-23 hour 1: 152385 events in 4 files, snapshot 3212855717263172428 (task 3783 ms: download 1411 ms overlapping gunzip 224 ms, parse 868 ms, sort 136 ms, write 1319 ms, index 426 ms: 11 candidates, 66649 repo-hours, 0 releases; waiting 504 ms; commit 1200 ms)
2026-11-07T05:37:12Z [load_day 2026-06-23] 2026-06-23 hour 2: 151198 events in 4 files, snapshot 8401845802322961081 (task 3686 ms: download 1502 ms overlapping gunzip 203 ms, parse 716 ms, sort 107 ms, write 1301 ms, index 485 ms: 6 candidates, 76709 repo-hours, 0 releases; waiting 528 ms; commit 1009 ms)
2026-11-07T05:37:14Z [load_day 2026-06-23] 2026-06-23 hour 3: 154387 events in 4 files, snapshot 5369983943933759721 (task 3736 ms: download 1584 ms overlapping gunzip 199 ms, parse 747 ms, sort 97 ms, write 1380 ms, index 483 ms: 6 candidates, 75947 repo-hours, 0 releases; waiting 515 ms; commit 1009 ms)
2026-11-07T05:37:17Z [load_day 2026-06-23] 2026-06-23 hour 4: 147019 events in 3 files, snapshot 5674762775540410560 (task 3632 ms: download 1167 ms overlapping gunzip 194 ms, parse 731 ms, sort 116 ms, write 1306 ms, index 500 ms: 4 candidates, 74023 repo-hours, 0 releases; waiting 510 ms; commit 1233 ms)
2026-11-07T05:37:18Z [load_day 2026-06-23] 2026-06-23 hour 5: 147739 events in 3 files, snapshot 4512797824105657480 (task 3551 ms: download 1144 ms overlapping gunzip 183 ms, parse 698 ms, sort 101 ms, write 1370 ms, index 452 ms: 3 candidates, 69389 repo-hours, 0 releases; waiting 520 ms; commit 1117 ms)
2026-11-07T05:37:21Z [load_day 2026-06-23] 2026-06-23 hour 6: 154406 events in 4 files, snapshot 9195180091535130904 (task 3623 ms: download 1166 ms overlapping gunzip 192 ms, parse 740 ms, sort 108 ms, write 1310 ms, index 525 ms: 4 candidates, 76131 repo-hours, 0 releases; waiting 528 ms; commit 1084 ms)
2026-11-07T05:37:22Z [load_day 2026-06-23] 2026-06-23 hour 7: 151465 events in 4 files, snapshot 1597838673594612760 (task 3641 ms: download 1606 ms overlapping gunzip 200 ms, parse 706 ms, sort 95 ms, write 1319 ms, index 484 ms: 5 candidates, 75762 repo-hours, 0 releases; waiting 511 ms; commit 1053 ms)
2026-11-07T05:37:26Z [load_day 2026-06-23] 2026-06-23 hour 8: 151123 events in 4 files, snapshot 6082802286264240780 (task 3954 ms: download 1540 ms overlapping gunzip 207 ms, parse 770 ms, sort 103 ms, write 1533 ms, index 498 ms: 9 candidates, 79299 repo-hours, 0 releases; waiting 534 ms; commit 1051 ms)
2026-11-07T05:37:27Z [load_day 2026-06-23] 2026-06-23 hour 9: 155791 events in 4 files, snapshot 1708663407490887339 (task 3836 ms: download 1525 ms overlapping gunzip 186 ms, parse 718 ms, sort 100 ms, write 1451 ms, index 537 ms: 8 candidates, 82154 repo-hours, 0 releases; waiting 536 ms; commit 1197 ms)
2026-11-07T05:37:30Z [load_day 2026-06-23] 2026-06-23 hour 10: 155106 events in 4 files, snapshot 6122690580850826066 (task 3738 ms: download 1583 ms overlapping gunzip 187 ms, parse 711 ms, sort 101 ms, write 1356 ms, index 535 ms: 5 candidates, 78499 repo-hours, 0 releases; waiting 531 ms; commit 1102 ms)
2026-11-07T05:37:31Z [load_day 2026-06-23] 2026-06-23 hour 11: 151427 events in 4 files, snapshot 2955425051239932309 (task 3589 ms: download 1271 ms overlapping gunzip 183 ms, parse 681 ms, sort 99 ms, write 1351 ms, index 530 ms: 4 candidates, 79620 repo-hours, 0 releases; waiting 533 ms; commit 1053 ms)
2026-11-07T05:37:34Z [load_day 2026-06-23] 2026-06-23 hour 12: 156908 events in 4 files, snapshot 5938771722151125633 (task 3805 ms: download 1185 ms overlapping gunzip 189 ms, parse 712 ms, sort 103 ms, write 1397 ms, index 550 ms: 11 candidates, 84011 repo-hours, 0 releases; waiting 545 ms; commit 914 ms)
2026-11-07T05:37:37Z [load_day 2026-06-23] 2026-06-23 hour 13: 154822 events in 4 files, snapshot 4217201214014001114 (task 3813 ms: download 1356 ms overlapping gunzip 189 ms, parse 708 ms, sort 101 ms, write 1420 ms, index 551 ms: 9 candidates, 83216 repo-hours, 0 releases; waiting 533 ms; commit 2709 ms)
2026-11-07T05:37:39Z [load_day 2026-06-23] 2026-06-23 hour 14: 156909 events in 4 files, snapshot 6390600552257334505 (task 4138 ms: download 1284 ms overlapping gunzip 202 ms, parse 747 ms, sort 105 ms, write 1654 ms, index 583 ms: 6 candidates, 91439 repo-hours, 0 releases; waiting 523 ms; commit 999 ms)
2026-11-07T05:37:40Z [load_day 2026-06-23] 2026-06-23 hour 15: 155407 events in 4 files, snapshot 8537021166335714120 (task 3697 ms: download 1286 ms overlapping gunzip 191 ms, parse 721 ms, sort 103 ms, write 1601 ms, index 519 ms: 9 candidates, 83039 repo-hours, 0 releases; waiting 298 ms; commit 980 ms)
2026-11-07T05:37:44Z [load_day 2026-06-23] 2026-06-23 hour 16: 159524 events in 4 files, snapshot 6915530088508990720 (task 3983 ms: download 1222 ms overlapping gunzip 201 ms, parse 745 ms, sort 100 ms, write 1621 ms, index 550 ms: 8 candidates, 81685 repo-hours, 0 releases; waiting 533 ms; commit 1025 ms)
2026-11-07T05:37:45Z [load_day 2026-06-23] 2026-06-23 hour 17: 162033 events in 4 files, snapshot 80147672852399434 (task 3960 ms: download 1250 ms overlapping gunzip 197 ms, parse 733 ms, sort 103 ms, write 1615 ms, index 509 ms: 2 candidates, 77922 repo-hours, 0 releases; waiting 524 ms; commit 927 ms)
2026-11-07T05:37:49Z [load_day 2026-06-23] 2026-06-23 hour 18: 162586 events in 4 files, snapshot 5410160694723755030 (task 4133 ms: download 2026 ms overlapping gunzip 201 ms, parse 776 ms, sort 117 ms, write 1669 ms, index 514 ms: 6 candidates, 77715 repo-hours, 0 releases; waiting 514 ms; commit 1054 ms)
2026-11-07T05:37:50Z [load_day 2026-06-23] 2026-06-23 hour 19: 159514 events in 4 files, snapshot 586111446217857824 (task 3843 ms: download 1627 ms overlapping gunzip 202 ms, parse 765 ms, sort 106 ms, write 1414 ms, index 530 ms: 8 candidates, 76160 repo-hours, 0 releases; waiting 508 ms; commit 957 ms)
2026-11-07T05:37:53Z [load_day 2026-06-23] 2026-06-23 hour 20: 161064 events in 4 files, snapshot 5147728354657725991 (task 3906 ms: download 1494 ms overlapping gunzip 204 ms, parse 786 ms, sort 105 ms, write 1494 ms, index 524 ms: 9 candidates, 73361 repo-hours, 0 releases; waiting 514 ms; commit 1057 ms)
2026-11-07T05:37:54Z [load_day 2026-06-23] 2026-06-23 hour 21: 164655 events in 4 files, snapshot 7600611804240528339 (task 3869 ms: download 1381 ms overlapping gunzip 206 ms, parse 780 ms, sort 106 ms, write 1448 ms, index 482 ms: 6 candidates, 68927 repo-hours, 0 releases; waiting 516 ms; commit 1014 ms)
2026-11-07T05:37:58Z [load_day 2026-06-23] 2026-06-23 hour 22: 161125 events in 4 files, snapshot 1672246879261727371 (task 3926 ms: download 1125 ms overlapping gunzip 221 ms, parse 829 ms, sort 118 ms, write 1527 ms, index 467 ms: 4 candidates, 68719 repo-hours, 0 releases; waiting 233 ms; commit 1058 ms)
2026-11-07T05:37:59Z [load_day 2026-06-23] 2026-06-23 hour 23: 162534 events in 4 files, snapshot 7584938508139240700 (task 3699 ms: download 719 ms overlapping gunzip 202 ms, parse 746 ms, sort 113 ms, write 1665 ms, index 517 ms: 8 candidates, 70288 repo-hours, 0 releases; waiting 186 ms; commit 977 ms)
2026-11-07T05:38:06Z [load_day 2026-06-23] 2026-06-23: repo_hour merged from 24 files to 1 (1835894 rows, 7391 ms)
2026-11-07T05:38:08Z [load_day 2026-06-23] 2026-06-23: index committed in 9203 ms (24 + 1 + 1 files)
2026-11-07T05:38:08Z [load_day 2026-06-23] 2026-06-23: 3740387 events in 24 hours
2026-11-07T05:38:08Z [load_day 2026-06-23] attempt 1 succeeded