orcaLog in

Runs · run 423

load_day 2026-06-30, attempt 1 succeeded

Host
4e84322b8c45:86229
Started
2026-11-07T05:27:39Z
Ended
2026-11-07T05:29:51Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/423/load_day/2026-06-30/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:27:39Z [load_day 2026-06-30] attempt 1 started
2026-11-07T05:27:46Z [load_day 2026-06-30] 2026-06-30 hour 0: 162170 events in 4 files, snapshot 371108317909357939 (task 4926 ms: download 1459 ms overlapping gunzip 270 ms, parse 959 ms, sort 124 ms, write 2147 ms, index 461 ms: 3 candidates, 70139 repo-hours, 267 releases; waiting 505 ms; commit 894 ms)
2026-11-07T05:27:47Z [load_day 2026-06-30] 2026-06-30 hour 1: 155239 events in 4 files, snapshot 4171988977279219765 (task 4628 ms: download 1879 ms overlapping gunzip 257 ms, parse 938 ms, sort 121 ms, write 2035 ms, index 448 ms: 12 candidates, 67799 repo-hours, 252 releases; waiting 509 ms; commit 1048 ms)
2026-11-07T05:27:51Z [load_day 2026-06-30] 2026-06-30 hour 2: 160263 events in 4 files, snapshot 2624178527229522410 (task 4453 ms: download 2060 ms overlapping gunzip 227 ms, parse 806 ms, sort 108 ms, write 1875 ms, index 536 ms: 6 candidates, 82706 repo-hours, 120 releases; waiting 518 ms; commit 864 ms)
2026-11-07T05:27:52Z [load_day 2026-06-30] 2026-06-30 hour 3: 160980 events in 4 files, snapshot 5039451466329524906 (task 4210 ms: download 1335 ms overlapping gunzip 225 ms, parse 808 ms, sort 110 ms, write 1826 ms, index 508 ms: 7 candidates, 80573 repo-hours, 136 releases; waiting 522 ms; commit 954 ms)
2026-11-07T05:27:56Z [load_day 2026-06-30] 2026-06-30 hour 4: 161533 events in 4 files, snapshot 4939375348495994293 (task 4079 ms: download 1489 ms overlapping gunzip 209 ms, parse 786 ms, sort 103 ms, write 1649 ms, index 496 ms: 6 candidates, 73425 repo-hours, 95 releases; waiting 548 ms; commit 1043 ms)
2026-11-07T05:27:57Z [load_day 2026-06-30] 2026-06-30 hour 5: 162399 events in 4 files, snapshot 8389796286234152610 (task 4077 ms: download 1288 ms overlapping gunzip 237 ms, parse 891 ms, sort 128 ms, write 1514 ms, index 482 ms: 7 candidates, 70714 repo-hours, 65 releases; waiting 523 ms; commit 966 ms)
2026-11-07T05:28:01Z [load_day 2026-06-30] 2026-06-30 hour 6: 161621 events in 4 files, snapshot 4789982064704049616 (task 4260 ms: download 1542 ms overlapping gunzip 210 ms, parse 809 ms, sort 108 ms, write 1720 ms, index 520 ms: 4 candidates, 75283 repo-hours, 55 releases; waiting 531 ms; commit 1079 ms)
2026-11-07T05:28:02Z [load_day 2026-06-30] 2026-06-30 hour 7: 162993 events in 4 files, snapshot 6863125853076178836 (task 4145 ms: download 1857 ms overlapping gunzip 220 ms, parse 793 ms, sort 111 ms, write 1640 ms, index 531 ms: 4 candidates, 76420 repo-hours, 40 releases; waiting 536 ms; commit 1138 ms)
2026-11-07T05:28:06Z [load_day 2026-06-30] 2026-06-30 hour 8: 160185 events in 4 files, snapshot 9016825614947596861 (task 3749 ms: download 1025 ms overlapping gunzip 209 ms, parse 774 ms, sort 103 ms, write 1526 ms, index 559 ms: 7 candidates, 80386 repo-hours, 62 releases; waiting 361 ms; commit 1106 ms)
2026-11-07T05:28:07Z [load_day 2026-06-30] 2026-06-30 hour 9: 160839 events in 4 files, snapshot 1271255022185398576 (task 4062 ms: download 1345 ms overlapping gunzip 202 ms, parse 748 ms, sort 106 ms, write 1511 ms, index 572 ms: 2 candidates, 82586 repo-hours, 23 releases; waiting 531 ms; commit 1003 ms)
2026-11-07T05:28:10Z [load_day 2026-06-30] 2026-06-30 hour 10: 159300 events in 4 files, snapshot 3282983334888320821 (task 3658 ms: download 1025 ms overlapping gunzip 197 ms, parse 726 ms, sort 112 ms, write 1654 ms, index 568 ms: 7 candidates, 81714 repo-hours, 50 releases; waiting 190 ms; commit 886 ms)
2026-11-07T05:28:12Z [load_day 2026-06-30] 2026-06-30 hour 11: 161322 events in 4 files, snapshot 3097773815959185082 (task 4051 ms: download 1191 ms overlapping gunzip 206 ms, parse 758 ms, sort 107 ms, write 1689 ms, index 576 ms: 7 candidates, 84348 repo-hours, 48 releases; waiting 488 ms; commit 1011 ms)
2026-11-07T05:28:15Z [load_day 2026-06-30] 2026-06-30 hour 12: 162161 events in 4 files, snapshot 9017707309324514829 (task 4260 ms: download 1370 ms overlapping gunzip 230 ms, parse 821 ms, sort 113 ms, write 1700 ms, index 583 ms: 17 candidates, 84118 repo-hours, 124 releases; waiting 538 ms; commit 1140 ms)
2026-11-07T05:28:16Z [load_day 2026-06-30] 2026-06-30 hour 13: 161011 events in 4 files, snapshot 1535930534882549851 (task 4049 ms: download 1156 ms overlapping gunzip 204 ms, parse 759 ms, sort 103 ms, write 1590 ms, index 583 ms: 9 candidates, 86821 repo-hours, 38 releases; waiting 526 ms; commit 857 ms)
2026-11-07T05:29:21Z [load_day 2026-06-30] 2026-06-30 hour 14: 157508 events in 4 files, snapshot 7358691043466348113 (task 65410 ms: download 63810 ms overlapping gunzip 365 ms, parse 1255 ms, sort 99 ms, write 1460 ms, index 591 ms: 8 candidates, 90032 repo-hours, 36 releases; waiting 60755 ms; commit 1222 ms)
2026-11-07T05:29:22Z [load_day 2026-06-30] 2026-06-30 hour 15: 157416 events in 4 files, snapshot 7049206106616789269 (task 3983 ms: download 1423 ms overlapping gunzip 208 ms, parse 756 ms, sort 104 ms, write 1414 ms, index 613 ms: 8 candidates, 81890 repo-hours, 57 releases; waiting 527 ms; commit 882 ms)
2026-11-07T05:29:26Z [load_day 2026-06-30] 2026-06-30 hour 16: 160989 events in 4 files, snapshot 3143105277155281787 (task 4004 ms: download 1217 ms overlapping gunzip 203 ms, parse 764 ms, sort 106 ms, write 1507 ms, index 580 ms: 9 candidates, 79940 repo-hours, 25 releases; waiting 522 ms; commit 1076 ms)
2026-11-07T05:29:27Z [load_day 2026-06-30] 2026-06-30 hour 17: 162077 events in 4 files, snapshot 990613971048789684 (task 4045 ms: download 1448 ms overlapping gunzip 200 ms, parse 758 ms, sort 103 ms, write 1620 ms, index 542 ms: 8 candidates, 78110 repo-hours, 22 releases; waiting 513 ms; commit 959 ms)
2026-11-07T05:29:30Z [load_day 2026-06-30] 2026-06-30 hour 18: 158870 events in 4 files, snapshot 3699683864456307574 (task 3934 ms: download 1334 ms overlapping gunzip 198 ms, parse 742 ms, sort 108 ms, write 1543 ms, index 506 ms: 5 candidates, 73350 repo-hours, 22 releases; waiting 534 ms; commit 941 ms)
2026-11-07T05:29:32Z [load_day 2026-06-30] 2026-06-30 hour 19: 160099 events in 4 files, snapshot 3508635276272359979 (task 4148 ms: download 1868 ms overlapping gunzip 215 ms, parse 803 ms, sort 110 ms, write 1570 ms, index 538 ms: 9 candidates, 76186 repo-hours, 59 releases; waiting 523 ms; commit 1028 ms)
2026-11-07T05:29:35Z [load_day 2026-06-30] 2026-06-30 hour 20: 160360 events in 4 files, snapshot 1220288613181518262 (task 3956 ms: download 1331 ms overlapping gunzip 198 ms, parse 758 ms, sort 101 ms, write 1583 ms, index 514 ms: 9 candidates, 73956 repo-hours, 42 releases; waiting 518 ms; commit 969 ms)
2026-11-07T05:29:36Z [load_day 2026-06-30] 2026-06-30 hour 21: 158511 events in 4 files, snapshot 544941059681045710 (task 4047 ms: download 1455 ms overlapping gunzip 211 ms, parse 776 ms, sort 107 ms, write 1604 ms, index 476 ms: 8 candidates, 70624 repo-hours, 126 releases; waiting 558 ms; commit 891 ms)
2026-11-07T05:29:40Z [load_day 2026-06-30] 2026-06-30 hour 22: 161945 events in 4 files, snapshot 4182154676920093734 (task 4121 ms: download 1442 ms overlapping gunzip 211 ms, parse 794 ms, sort 110 ms, write 1651 ms, index 460 ms: 5 candidates, 68674 repo-hours, 89 releases; waiting 602 ms; commit 964 ms)
2026-11-07T05:29:41Z [load_day 2026-06-30] 2026-06-30 hour 23: 157592 events in 4 files, snapshot 606993965822778790 (task 4274 ms: download 1498 ms overlapping gunzip 240 ms, parse 863 ms, sort 114 ms, write 1728 ms, index 458 ms: 6 candidates, 66327 repo-hours, 241 releases; waiting 520 ms; commit 979 ms)
2026-11-07T05:29:49Z [load_day 2026-06-30] 2026-06-30: repo_hour merged from 24 files to 1 (1856121 rows, 7749 ms)
2026-11-07T05:29:51Z [load_day 2026-06-30] 2026-06-30: index committed in 9635 ms (24 + 1 + 24 files)
2026-11-07T05:29:51Z [load_day 2026-06-30] 2026-06-30: 3847383 events in 24 hours
2026-11-07T05:29:51Z [load_day 2026-06-30] attempt 1 succeeded