orcaLog in

Runs · run 503

load_day 2026-06-03, attempt 1 succeeded

Host
4e84322b8c45:109313
Started
2026-11-07T06:04:14Z
Ended
2026-11-07T06:05:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/503/load_day/2026-06-03/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:04:14Z [load_day 2026-06-03] attempt 1 started
2026-11-07T06:04:20Z [load_day 2026-06-03] 2026-06-03 hour 0: 86155 events in 2 files, snapshot 4682358908029735574 (task 3035 ms: download 1136 ms overlapping gunzip 137 ms, parse 502 ms, sort 73 ms, write 1219 ms, index 288 ms: 3 candidates, 43822 repo-hours, 115 releases; waiting 530 ms; commit 970 ms)
2026-11-07T06:04:22Z [load_day 2026-06-03] 2026-06-03 hour 1: 150485 events in 4 files, snapshot 2699757908664033938 (task 4626 ms: download 1845 ms overlapping gunzip 272 ms, parse 970 ms, sort 121 ms, write 1943 ms, index 443 ms: 9 candidates, 70183 repo-hours, 343 releases; waiting 550 ms; commit 946 ms)
2026-11-07T06:04:25Z [load_day 2026-06-03] 2026-06-03 hour 2: 159184 events in 4 files, snapshot 8902215642891358824 (task 4272 ms: download 1232 ms overlapping gunzip 255 ms, parse 906 ms, sort 111 ms, write 1645 ms, index 494 ms: 7 candidates, 81101 repo-hours, 148 releases; waiting 523 ms; commit 982 ms)
2026-11-07T06:04:27Z [load_day 2026-06-03] 2026-06-03 hour 3: 162583 events in 4 files, snapshot 4101574952905766930 (task 4095 ms: download 1267 ms overlapping gunzip 240 ms, parse 862 ms, sort 109 ms, write 1640 ms, index 495 ms: 3 candidates, 78009 repo-hours, 124 releases; waiting 519 ms; commit 984 ms)
2026-11-07T06:04:30Z [load_day 2026-06-03] 2026-06-03 hour 4: 160710 events in 4 files, snapshot 8203738594321295364 (task 4237 ms: download 1514 ms overlapping gunzip 225 ms, parse 825 ms, sort 113 ms, write 1714 ms, index 544 ms: 6 candidates, 81085 repo-hours, 150 releases; waiting 526 ms; commit 1018 ms)
2026-11-07T06:04:32Z [load_day 2026-06-03] 2026-06-03 hour 5: 153385 events in 4 files, snapshot 1273322645189956484 (task 4162 ms: download 1494 ms overlapping gunzip 250 ms, parse 843 ms, sort 112 ms, write 1571 ms, index 556 ms: 7 candidates, 75334 repo-hours, 205 releases; waiting 527 ms; commit 1139 ms)
2026-11-07T06:04:36Z [load_day 2026-06-03] 2026-06-03 hour 6: 156191 events in 4 files, snapshot 7722805797796021332 (task 4434 ms: download 1403 ms overlapping gunzip 225 ms, parse 835 ms, sort 114 ms, write 1860 ms, index 524 ms: 7 candidates, 76688 repo-hours, 118 releases; waiting 552 ms; commit 1010 ms)
2026-11-07T06:04:37Z [load_day 2026-06-03] 2026-06-03 hour 7: 159249 events in 4 files, snapshot 1001389039436253076 (task 4354 ms: download 1296 ms overlapping gunzip 212 ms, parse 772 ms, sort 106 ms, write 1843 ms, index 621 ms: 6 candidates, 79324 repo-hours, 60 releases; waiting 516 ms; commit 1138 ms)
2026-11-07T06:04:40Z [load_day 2026-06-03] 2026-06-03 hour 8: 157577 events in 4 files, snapshot 8582309651870102370 (task 4145 ms: download 1257 ms overlapping gunzip 220 ms, parse 795 ms, sort 111 ms, write 1706 ms, index 523 ms: 6 candidates, 77780 repo-hours, 52 releases; waiting 528 ms; commit 977 ms)
2026-11-07T06:04:41Z [load_day 2026-06-03] 2026-06-03 hour 9: 151811 events in 4 files, snapshot 2996004036946669454 (task 3987 ms: download 1517 ms overlapping gunzip 196 ms, parse 721 ms, sort 94 ms, write 1632 ms, index 523 ms: 7 candidates, 76375 repo-hours, 19 releases; waiting 537 ms; commit 1024 ms)
2026-11-07T06:04:45Z [load_day 2026-06-03] 2026-06-03 hour 10: 158128 events in 4 files, snapshot 2493752578826577366 (task 4044 ms: download 1397 ms overlapping gunzip 217 ms, parse 811 ms, sort 107 ms, write 1520 ms, index 587 ms: 9 candidates, 81341 repo-hours, 37 releases; waiting 516 ms; commit 943 ms)
2026-11-07T06:04:46Z [load_day 2026-06-03] 2026-06-03 hour 11: 153958 events in 4 files, snapshot 218683773590462358 (task 3842 ms: download 1363 ms overlapping gunzip 210 ms, parse 758 ms, sort 101 ms, write 1352 ms, index 567 ms: 11 candidates, 80115 repo-hours, 33 releases; waiting 547 ms; commit 939 ms)
2026-11-07T06:04:50Z [load_day 2026-06-03] 2026-06-03 hour 12: 153882 events in 4 files, snapshot 8920421172881868822 (task 3610 ms: download 763 ms overlapping gunzip 216 ms, parse 778 ms, sort 121 ms, write 1506 ms, index 544 ms: 5 candidates, 79150 repo-hours, 57 releases; waiting 177 ms; commit 1055 ms)
2026-11-07T06:04:51Z [load_day 2026-06-03] 2026-06-03 hour 13: 149110 events in 3 files, snapshot 5535687568708680698 (task 3735 ms: download 1295 ms overlapping gunzip 223 ms, parse 767 ms, sort 103 ms, write 1311 ms, index 526 ms: 9 candidates, 79078 repo-hours, 65 releases; waiting 509 ms; commit 1105 ms)
2026-11-07T06:04:54Z [load_day 2026-06-03] 2026-06-03 hour 14: 148266 events in 3 files, snapshot 640229518775986080 (task 3724 ms: download 1318 ms overlapping gunzip 189 ms, parse 709 ms, sort 102 ms, write 1392 ms, index 558 ms: 8 candidates, 81611 repo-hours, 53 releases; waiting 525 ms; commit 1107 ms)
2026-11-07T06:04:55Z [load_day 2026-06-03] 2026-06-03 hour 15: 111549 events in 3 files, snapshot 1340112836405516761 (task 3356 ms: download 1076 ms overlapping gunzip 158 ms, parse 591 ms, sort 92 ms, write 1164 ms, index 507 ms: 6 candidates, 62336 repo-hours, 34 releases; waiting 507 ms; commit 1021 ms)
2026-11-07T06:04:56Z [load_day 2026-06-03] 2026-06-03 hour 16: 578 events in 1 files, snapshot 4678147559270069575 (task 819 ms: download 444 ms overlapping gunzip 7 ms, parse 22 ms, sort 0 ms, write 85 ms, index 11 ms: 0 candidates, 412 repo-hours, 0 releases; waiting 426 ms; commit 1074 ms)
2026-11-07T06:04:57Z [load_day 2026-06-03] 2026-06-03 hour 17: 26653 events in 1 files, snapshot 8368600729941341320 (task 1566 ms: download 744 ms overlapping gunzip 49 ms, parse 171 ms, sort 14 ms, write 373 ms, index 136 ms: 3 candidates, 19457 repo-hours, 63 releases; waiting 550 ms; commit 1036 ms)
2026-11-07T06:05:00Z [load_day 2026-06-03] 2026-06-03 hour 18: 99656 events in 2 files, snapshot 7424810944645752295 (task 3018 ms: download 1120 ms overlapping gunzip 139 ms, parse 500 ms, sort 77 ms, write 983 ms, index 475 ms: 5 candidates, 56711 repo-hours, 43 releases; waiting 538 ms; commit 957 ms)
2026-11-07T06:05:02Z [load_day 2026-06-03] 2026-06-03 hour 19: 153878 events in 4 files, snapshot 2234284582960659781 (task 3893 ms: download 1143 ms overlapping gunzip 198 ms, parse 754 ms, sort 106 ms, write 1409 ms, index 632 ms: 6 candidates, 74798 repo-hours, 44 releases; waiting 515 ms; commit 1190 ms)
2026-11-07T06:05:05Z [load_day 2026-06-03] 2026-06-03 hour 20: 152808 events in 4 files, snapshot 2214772149111628436 (task 4119 ms: download 1481 ms overlapping gunzip 200 ms, parse 761 ms, sort 108 ms, write 1487 ms, index 732 ms: 7 candidates, 77788 repo-hours, 92 releases; waiting 528 ms; commit 1737 ms)
2026-11-07T06:05:07Z [load_day 2026-06-03] 2026-06-03 hour 21: 152091 events in 4 files, snapshot 1570155855157929597 (task 4183 ms: download 1744 ms overlapping gunzip 230 ms, parse 824 ms, sort 108 ms, write 1668 ms, index 493 ms: 10 candidates, 75513 repo-hours, 190 releases; waiting 529 ms; commit 1144 ms)
2026-11-07T06:05:11Z [load_day 2026-06-03] 2026-06-03 hour 22: 150259 events in 4 files, snapshot 1966512121862989726 (task 4817 ms: download 1435 ms overlapping gunzip 315 ms, parse 1106 ms, sort 124 ms, write 1833 ms, index 552 ms: 10 candidates, 71028 repo-hours, 334 releases; waiting 526 ms; commit 994 ms)
2026-11-07T06:05:12Z [load_day 2026-06-03] 2026-06-03 hour 23: 109475 events in 3 files, snapshot 2106150339107081719 (task 3868 ms: download 1315 ms overlapping gunzip 231 ms, parse 813 ms, sort 85 ms, write 1424 ms, index 343 ms: 6 candidates, 55091 repo-hours, 233 releases; waiting 517 ms; commit 1189 ms)
2026-11-07T06:05:19Z [load_day 2026-06-03] 2026-06-03: repo_hour merged from 24 files to 1 (1634130 rows, 7026 ms)
2026-11-07T06:05:21Z [load_day 2026-06-03] 2026-06-03: index committed in 8719 ms (23 + 1 + 23 files)
2026-11-07T06:05:21Z [load_day 2026-06-03] 2026-06-03: 3217621 events in 24 hours
2026-11-07T06:05:21Z [load_day 2026-06-03] attempt 1 succeeded