orcaLog in

Runs · run 425

load_day 2026-06-29, attempt 1 succeeded

Host
4e84322b8c45:87149
Started
2026-11-07T05:29:52Z
Ended
2026-11-07T05:31:03Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/425/load_day/2026-06-29/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:29:52Z [load_day 2026-06-29] attempt 1 started
2026-11-07T05:30:00Z [load_day 2026-06-29] 2026-06-29 hour 0: 163948 events in 4 files, snapshot 5784137763980045775 (task 4275 ms: download 1267 ms overlapping gunzip 215 ms, parse 813 ms, sort 119 ms, write 1937 ms, index 417 ms: 6 candidates, 65465 repo-hours, 76 releases; waiting 516 ms; commit 1101 ms)
2026-11-07T05:30:01Z [load_day 2026-06-29] 2026-06-29 hour 1: 158031 events in 4 files, snapshot 8101567121436111624 (task 4233 ms: download 1479 ms overlapping gunzip 211 ms, parse 801 ms, sort 117 ms, write 1806 ms, index 470 ms: 8 candidates, 65536 repo-hours, 90 releases; waiting 515 ms; commit 1022 ms)
2026-11-07T05:30:05Z [load_day 2026-06-29] 2026-06-29 hour 2: 166559 events in 4 files, snapshot 1842932058189508426 (task 4196 ms: download 1339 ms overlapping gunzip 210 ms, parse 801 ms, sort 111 ms, write 1702 ms, index 548 ms: 6 candidates, 80999 repo-hours, 39 releases; waiting 527 ms; commit 1174 ms)
2026-11-07T05:30:06Z [load_day 2026-06-29] 2026-06-29 hour 3: 165111 events in 4 files, snapshot 66896176426909814 (task 4298 ms: download 1720 ms overlapping gunzip 222 ms, parse 816 ms, sort 115 ms, write 1718 ms, index 534 ms: 9 candidates, 77377 repo-hours, 90 releases; waiting 535 ms; commit 1074 ms)
2026-11-07T05:30:09Z [load_day 2026-06-29] 2026-06-29 hour 4: 163492 events in 4 files, snapshot 8310575063004772528 (task 4136 ms: download 1538 ms overlapping gunzip 213 ms, parse 796 ms, sort 105 ms, write 1598 ms, index 531 ms: 5 candidates, 80493 repo-hours, 61 releases; waiting 575 ms; commit 1140 ms)
2026-11-07T05:30:11Z [load_day 2026-06-29] 2026-06-29 hour 5: 161400 events in 4 files, snapshot 1808572579011927271 (task 4239 ms: download 1489 ms overlapping gunzip 219 ms, parse 797 ms, sort 108 ms, write 1693 ms, index 535 ms: 5 candidates, 72295 repo-hours, 100 releases; waiting 534 ms; commit 1089 ms)
2026-11-07T05:30:14Z [load_day 2026-06-29] 2026-06-29 hour 6: 158555 events in 4 files, snapshot 41229793191773198 (task 3922 ms: download 1212 ms overlapping gunzip 208 ms, parse 780 ms, sort 118 ms, write 1523 ms, index 485 ms: 5 candidates, 68378 repo-hours, 31 releases; waiting 519 ms; commit 1046 ms)
2026-11-07T05:30:15Z [load_day 2026-06-29] 2026-06-29 hour 7: 157308 events in 4 files, snapshot 216732057576139767 (task 3796 ms: download 995 ms overlapping gunzip 198 ms, parse 700 ms, sort 104 ms, write 1526 ms, index 558 ms: 7 candidates, 76406 repo-hours, 42 releases; waiting 211 ms; commit 1123 ms)
2026-11-07T05:30:18Z [load_day 2026-06-29] 2026-06-29 hour 8: 161420 events in 4 files, snapshot 5924183523647640986 (task 3913 ms: download 1293 ms overlapping gunzip 207 ms, parse 760 ms, sort 114 ms, write 1469 ms, index 523 ms: 10 candidates, 76630 repo-hours, 38 releases; waiting 522 ms; commit 1012 ms)
2026-11-07T05:30:20Z [load_day 2026-06-29] 2026-06-29 hour 9: 153636 events in 4 files, snapshot 6500500693780566775 (task 3787 ms: download 1549 ms overlapping gunzip 196 ms, parse 723 ms, sort 101 ms, write 1411 ms, index 531 ms: 11 candidates, 76485 repo-hours, 36 releases; waiting 528 ms; commit 1076 ms)
2026-11-07T05:30:23Z [load_day 2026-06-29] 2026-06-29 hour 10: 165431 events in 4 files, snapshot 4402436248124821134 (task 4231 ms: download 1239 ms overlapping gunzip 227 ms, parse 875 ms, sort 160 ms, write 1634 ms, index 552 ms: 6 candidates, 83197 repo-hours, 39 releases; waiting 572 ms; commit 909 ms)
2026-11-07T05:30:24Z [load_day 2026-06-29] 2026-06-29 hour 11: 159641 events in 4 files, snapshot 1159927303986806138 (task 3929 ms: download 1711 ms overlapping gunzip 205 ms, parse 756 ms, sort 105 ms, write 1475 ms, index 549 ms: 9 candidates, 81262 repo-hours, 37 releases; waiting 534 ms; commit 977 ms)
2026-11-07T05:30:27Z [load_day 2026-06-29] 2026-06-29 hour 12: 158624 events in 4 files, snapshot 8323016650156842666 (task 3984 ms: download 1150 ms overlapping gunzip 207 ms, parse 757 ms, sort 101 ms, write 1519 ms, index 575 ms: 11 candidates, 81180 repo-hours, 24 releases; waiting 522 ms; commit 954 ms)
2026-11-07T05:30:29Z [load_day 2026-06-29] 2026-06-29 hour 13: 157959 events in 4 files, snapshot 2230395060772722094 (task 3942 ms: download 1312 ms overlapping gunzip 206 ms, parse 745 ms, sort 112 ms, write 1549 ms, index 511 ms: 8 candidates, 77968 repo-hours, 17 releases; waiting 528 ms; commit 1059 ms)
2026-11-07T05:30:32Z [load_day 2026-06-29] 2026-06-29 hour 14: 159251 events in 4 files, snapshot 6426526639773854595 (task 4050 ms: download 1406 ms overlapping gunzip 214 ms, parse 756 ms, sort 108 ms, write 1586 ms, index 544 ms: 10 candidates, 78592 repo-hours, 42 releases; waiting 527 ms; commit 1061 ms)
2026-11-07T05:30:33Z [load_day 2026-06-29] 2026-06-29 hour 15: 157943 events in 4 files, snapshot 188689325899083027 (task 3924 ms: download 1390 ms overlapping gunzip 195 ms, parse 727 ms, sort 116 ms, write 1495 ms, index 568 ms: 6 candidates, 86247 repo-hours, 16 releases; waiting 539 ms; commit 911 ms)
2026-11-07T05:30:37Z [load_day 2026-06-29] 2026-06-29 hour 16: 158044 events in 4 files, snapshot 2916907005647403282 (task 4033 ms: download 1800 ms overlapping gunzip 200 ms, parse 755 ms, sort 107 ms, write 1424 ms, index 548 ms: 7 candidates, 76843 repo-hours, 25 releases; waiting 527 ms; commit 1062 ms)
2026-11-07T05:30:38Z [load_day 2026-06-29] 2026-06-29 hour 17: 163122 events in 4 files, snapshot 2577959622836091457 (task 4020 ms: download 1698 ms overlapping gunzip 207 ms, parse 773 ms, sort 102 ms, write 1554 ms, index 538 ms: 5 candidates, 79762 repo-hours, 21 releases; waiting 544 ms; commit 916 ms)
2026-11-07T05:30:41Z [load_day 2026-06-29] 2026-06-29 hour 18: 161504 events in 4 files, snapshot 508267666870727560 (task 3640 ms: download 1032 ms overlapping gunzip 217 ms, parse 774 ms, sort 100 ms, write 1493 ms, index 525 ms: 5 candidates, 76164 repo-hours, 38 releases; waiting 240 ms; commit 1088 ms)
2026-11-07T05:30:43Z [load_day 2026-06-29] 2026-06-29 hour 19: 161245 events in 4 files, snapshot 8167995292362060514 (task 3898 ms: download 1444 ms overlapping gunzip 205 ms, parse 758 ms, sort 99 ms, write 1469 ms, index 540 ms: 6 candidates, 74710 repo-hours, 52 releases; waiting 535 ms; commit 1104 ms)
2026-11-07T05:30:46Z [load_day 2026-06-29] 2026-06-29 hour 20: 163198 events in 4 files, snapshot 1284037018827757418 (task 4081 ms: download 1723 ms overlapping gunzip 211 ms, parse 770 ms, sort 112 ms, write 1585 ms, index 509 ms: 6 candidates, 76259 repo-hours, 41 releases; waiting 538 ms; commit 919 ms)
2026-11-07T05:30:48Z [load_day 2026-06-29] 2026-06-29 hour 21: 159794 events in 4 files, snapshot 2876511859617226071 (task 4016 ms: download 1427 ms overlapping gunzip 214 ms, parse 799 ms, sort 119 ms, write 1528 ms, index 532 ms: 11 candidates, 74665 repo-hours, 76 releases; waiting 513 ms; commit 985 ms)
2026-11-07T05:30:51Z [load_day 2026-06-29] 2026-06-29 hour 22: 160972 events in 4 files, snapshot 8809012184395928123 (task 4103 ms: download 1521 ms overlapping gunzip 212 ms, parse 804 ms, sort 112 ms, write 1631 ms, index 492 ms: 3 candidates, 70497 repo-hours, 68 releases; waiting 519 ms; commit 921 ms)
2026-11-07T05:30:53Z [load_day 2026-06-29] 2026-06-29 hour 23: 157625 events in 4 files, snapshot 8124010468690496371 (task 4470 ms: download 1413 ms overlapping gunzip 269 ms, parse 944 ms, sort 109 ms, write 1841 ms, index 448 ms: 6 candidates, 66850 repo-hours, 288 releases; waiting 534 ms; commit 1074 ms)
2026-11-07T05:31:01Z [load_day 2026-06-29] 2026-06-29: repo_hour merged from 24 files to 1 (1824260 rows, 7479 ms)
2026-11-07T05:31:03Z [load_day 2026-06-29] 2026-06-29: index committed in 9500 ms (24 + 1 + 24 files)
2026-11-07T05:31:03Z [load_day 2026-06-29] 2026-06-29: 3853813 events in 24 hours
2026-11-07T05:31:03Z [load_day 2026-06-29] attempt 1 succeeded