orcaLog in

Runs · run 419

load_day 2026-07-01, attempt 1 succeeded

Host
4e84322b8c45:85277
Started
2026-11-07T05:22:51Z
Ended
2026-11-07T05:27:37Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/419/load_day/2026-07-01/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:22:51Z [load_day 2026-07-01] attempt 1 started
2026-11-07T05:22:59Z [load_day 2026-07-01] 2026-07-01 hour 0: 161098 events in 4 files, snapshot 2685821853965218005 (task 4266 ms: download 1454 ms overlapping gunzip 221 ms, parse 816 ms, sort 111 ms, write 1863 ms, index 437 ms: 6 candidates, 66449 repo-hours, 106 releases; waiting 480 ms; commit 976 ms)
2026-11-07T05:23:00Z [load_day 2026-07-01] 2026-07-01 hour 1: 158662 events in 4 files, snapshot 1310967998861936131 (task 4269 ms: download 1481 ms overlapping gunzip 214 ms, parse 796 ms, sort 104 ms, write 1764 ms, index 483 ms: 8 candidates, 66450 repo-hours, 79 releases; waiting 543 ms; commit 936 ms)
2026-11-07T05:23:03Z [load_day 2026-07-01] 2026-07-01 hour 2: 160833 events in 4 files, snapshot 330407586779178876 (task 4257 ms: download 1338 ms overlapping gunzip 224 ms, parse 832 ms, sort 106 ms, write 1734 ms, index 529 ms: 8 candidates, 83251 repo-hours, 101 releases; waiting 529 ms; commit 858 ms)
2026-11-07T05:23:05Z [load_day 2026-07-01] 2026-07-01 hour 3: 160862 events in 4 files, snapshot 7770291010745476060 (task 4303 ms: download 1333 ms overlapping gunzip 238 ms, parse 874 ms, sort 109 ms, write 1624 ms, index 534 ms: 6 candidates, 78534 repo-hours, 150 releases; waiting 538 ms; commit 1020 ms)
2026-11-07T05:23:08Z [load_day 2026-07-01] 2026-07-01 hour 4: 162953 events in 4 files, snapshot 5626621723155390753 (task 4345 ms: download 1441 ms overlapping gunzip 226 ms, parse 876 ms, sort 119 ms, write 1739 ms, index 515 ms: 7 candidates, 82942 repo-hours, 132 releases; waiting 542 ms; commit 846 ms)
2026-11-07T05:23:10Z [load_day 2026-07-01] 2026-07-01 hour 5: 161213 events in 4 files, snapshot 2029572715700128317 (task 4285 ms: download 1589 ms overlapping gunzip 221 ms, parse 801 ms, sort 99 ms, write 1830 ms, index 502 ms: 5 candidates, 71132 repo-hours, 113 releases; waiting 520 ms; commit 1101 ms)
2026-11-07T05:23:13Z [load_day 2026-07-01] 2026-07-01 hour 6: 158706 events in 4 files, snapshot 845290335129837114 (task 3973 ms: download 1522 ms overlapping gunzip 208 ms, parse 795 ms, sort 101 ms, write 1497 ms, index 518 ms: 3 candidates, 74219 repo-hours, 46 releases; waiting 526 ms; commit 937 ms)
2026-11-07T05:23:15Z [load_day 2026-07-01] 2026-07-01 hour 7: 155024 events in 4 files, snapshot 1130629225441954707 (task 3836 ms: download 1311 ms overlapping gunzip 197 ms, parse 742 ms, sort 105 ms, write 1347 ms, index 526 ms: 4 candidates, 74706 repo-hours, 43 releases; waiting 537 ms; commit 2455 ms)
2026-11-07T05:23:18Z [load_day 2026-07-01] 2026-07-01 hour 8: 158724 events in 4 files, snapshot 1454196255988792990 (task 3924 ms: download 1487 ms overlapping gunzip 228 ms, parse 789 ms, sort 113 ms, write 1414 ms, index 511 ms: 4 candidates, 73924 repo-hours, 26 releases; waiting 531 ms; commit 1152 ms)
2026-11-07T05:23:19Z [load_day 2026-07-01] 2026-07-01 hour 9: 160755 events in 4 files, snapshot 2010041575842992120 (task 4080 ms: download 1587 ms overlapping gunzip 218 ms, parse 815 ms, sort 97 ms, write 1411 ms, index 700 ms: 9 candidates, 71391 repo-hours, 21 releases; waiting 516 ms; commit 989 ms)
2026-11-07T05:23:22Z [load_day 2026-07-01] 2026-07-01 hour 10: 158026 events in 4 files, snapshot 1967698494851803689 (task 3750 ms: download 1203 ms overlapping gunzip 193 ms, parse 728 ms, sort 98 ms, write 1482 ms, index 477 ms: 5 candidates, 68367 repo-hours, 18 releases; waiting 522 ms; commit 1074 ms)
2026-11-07T05:23:24Z [load_day 2026-07-01] 2026-07-01 hour 11: 163830 events in 4 files, snapshot 1277768755816615201 (task 4027 ms: download 1366 ms overlapping gunzip 208 ms, parse 763 ms, sort 108 ms, write 1526 ms, index 598 ms: 9 candidates, 78549 repo-hours, 31 releases; waiting 531 ms; commit 1035 ms)
2026-11-07T05:23:26Z [load_day 2026-07-01] 2026-07-01 hour 12: 161121 events in 4 files, snapshot 3689780440683686378 (task 3369 ms: download 355 ms overlapping gunzip 204 ms, parse 789 ms, sort 115 ms, write 1484 ms, index 564 ms: 6 candidates, 79292 repo-hours, 34 releases; waiting 12 ms; commit 895 ms)
2026-11-07T05:23:28Z [load_day 2026-07-01] 2026-07-01 hour 13: 158989 events in 4 files, snapshot 3290036558446672761 (task 3999 ms: download 1297 ms overlapping gunzip 205 ms, parse 762 ms, sort 126 ms, write 1444 ms, index 641 ms: 6 candidates, 79470 repo-hours, 37 releases; waiting 508 ms; commit 934 ms)
2026-11-07T05:23:31Z [load_day 2026-07-01] 2026-07-01 hour 14: 158045 events in 4 files, snapshot 1498612347518268269 (task 4124 ms: download 1300 ms overlapping gunzip 202 ms, parse 767 ms, sort 107 ms, write 1506 ms, index 612 ms: 4 candidates, 89812 repo-hours, 76 releases; waiting 533 ms; commit 1056 ms)
2026-11-07T05:23:33Z [load_day 2026-07-01] 2026-07-01 hour 15: 160056 events in 4 files, snapshot 6253382331029934118 (task 3950 ms: download 1355 ms overlapping gunzip 204 ms, parse 758 ms, sort 101 ms, write 1506 ms, index 654 ms: 6 candidates, 82737 repo-hours, 75 releases; waiting 378 ms; commit 1159 ms)
2026-11-07T05:23:35Z [load_day 2026-07-01] 2026-07-01 hour 16: 156475 events in 4 files, snapshot 8773889684307361879 (task 4167 ms: download 1248 ms overlapping gunzip 218 ms, parse 780 ms, sort 111 ms, write 1655 ms, index 534 ms: 9 candidates, 79123 repo-hours, 111 releases; waiting 533 ms; commit 1128 ms)
2026-11-07T05:23:38Z [load_day 2026-07-01] 2026-07-01 hour 17: 162669 events in 4 files, snapshot 5477108994857257822 (task 3873 ms: download 1076 ms overlapping gunzip 216 ms, parse 778 ms, sort 102 ms, write 1570 ms, index 583 ms: 7 candidates, 77351 repo-hours, 71 releases; waiting 355 ms; commit 1193 ms)
2026-11-07T05:23:40Z [load_day 2026-07-01] 2026-07-01 hour 18: 156861 events in 4 files, snapshot 5162956378611737241 (task 3930 ms: download 1309 ms overlapping gunzip 211 ms, parse 755 ms, sort 101 ms, write 1470 ms, index 553 ms: 9 candidates, 75104 repo-hours, 92 releases; waiting 554 ms; commit 1051 ms)
2026-11-07T05:23:43Z [load_day 2026-07-01] 2026-07-01 hour 19: 163315 events in 4 files, snapshot 5670263866508910709 (task 4423 ms: download 1848 ms overlapping gunzip 238 ms, parse 827 ms, sort 111 ms, write 1811 ms, index 581 ms: 6 candidates, 82339 repo-hours, 150 releases; waiting 542 ms; commit 1041 ms)
2026-11-07T05:23:45Z [load_day 2026-07-01] 2026-07-01 hour 20: 159021 events in 4 files, snapshot 3108279294751749592 (task 4100 ms: download 1327 ms overlapping gunzip 250 ms, parse 853 ms, sort 113 ms, write 1618 ms, index 517 ms: 8 candidates, 77188 repo-hours, 148 releases; waiting 514 ms; commit 1083 ms)
2026-11-07T05:23:47Z [load_day 2026-07-01] 2026-07-01 hour 21: 160939 events in 4 files, snapshot 3021183005897608100 (task 3900 ms: download 1136 ms overlapping gunzip 239 ms, parse 833 ms, sort 122 ms, write 1685 ms, index 496 ms: 11 candidates, 77537 repo-hours, 226 releases; waiting 236 ms; commit 1066 ms)
2026-11-07T05:27:26Z [load_day 2026-07-01] 2026-07-01 hour 22: 158936 events in 4 files, snapshot 6837306540932422249 (task 221137 ms: download 218954 ms overlapping gunzip 496 ms, parse 1941 ms, sort 137 ms, write 1712 ms, index 515 ms: 4 candidates, 73642 repo-hours, 166 releases; waiting 214870 ms; commit 984 ms)
2026-11-07T05:27:27Z [load_day 2026-07-01] 2026-07-01 hour 23: 155466 events in 4 files, snapshot 3980556107567690924 (task 4417 ms: download 1492 ms overlapping gunzip 244 ms, parse 863 ms, sort 137 ms, write 1771 ms, index 519 ms: 4 candidates, 71739 repo-hours, 274 releases; waiting 565 ms; commit 939 ms)
2026-11-07T05:27:35Z [load_day 2026-07-01] 2026-07-01: repo_hour merged from 24 files to 1 (1835248 rows, 7935 ms)
2026-11-07T05:27:37Z [load_day 2026-07-01] 2026-07-01: index committed in 10102 ms (24 + 1 + 24 files)
2026-11-07T05:27:37Z [load_day 2026-07-01] 2026-07-01: 3832579 events in 24 hours
2026-11-07T05:27:37Z [load_day 2026-07-01] attempt 1 succeeded