orcaLog in

Runs · run 611

load_day 2026-04-28, attempt 1 succeeded

Host
4e84322b8c45:137887
Started
2026-11-07T06:55:06Z
Ended
2026-11-07T06:56:28Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/611/load_day/2026-04-28/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:55:06Z [load_day 2026-04-28] attempt 1 started
2026-11-07T06:55:15Z [load_day 2026-04-28] 2026-04-28 hour 0: 151406 events in 4 files, snapshot 3221727618364504131 (task 5967 ms: download 1913 ms overlapping gunzip 351 ms, parse 1172 ms, sort 158 ms, write 2995 ms, index 464 ms: 5 candidates, 71095 repo-hours, 646 releases; waiting 510 ms; commit 1179 ms)
2026-11-07T06:55:16Z [load_day 2026-04-28] 2026-04-28 hour 1: 151108 events in 4 files, snapshot 6181513078896673654 (task 5599 ms: download 1792 ms overlapping gunzip 302 ms, parse 1057 ms, sort 177 ms, write 2764 ms, index 486 ms: 9 candidates, 75242 repo-hours, 453 releases; waiting 519 ms; commit 1150 ms)
2026-11-07T06:55:20Z [load_day 2026-04-28] 2026-04-28 hour 2: 156472 events in 4 files, snapshot 663603213754226968 (task 4539 ms: download 1735 ms overlapping gunzip 273 ms, parse 900 ms, sort 113 ms, write 1817 ms, index 572 ms: 9 candidates, 88597 repo-hours, 253 releases; waiting 529 ms; commit 1265 ms)
2026-11-07T06:55:22Z [load_day 2026-04-28] 2026-04-28 hour 3: 152520 events in 4 files, snapshot 6943143892323771305 (task 4699 ms: download 1711 ms overlapping gunzip 310 ms, parse 1026 ms, sort 140 ms, write 1916 ms, index 541 ms: 9 candidates, 84018 repo-hours, 340 releases; waiting 443 ms; commit 1925 ms)
2026-11-07T06:55:26Z [load_day 2026-04-28] 2026-04-28 hour 4: 148819 events in 3 files, snapshot 6531724688782569912 (task 5371 ms: download 1980 ms overlapping gunzip 342 ms, parse 1114 ms, sort 136 ms, write 2435 ms, index 502 ms: 4 candidates, 71133 repo-hours, 630 releases; waiting 556 ms; commit 1192 ms)
2026-11-07T06:55:28Z [load_day 2026-04-28] 2026-04-28 hour 5: 146665 events in 3 files, snapshot 8731263707145541848 (task 5248 ms: download 1913 ms overlapping gunzip 339 ms, parse 1141 ms, sort 144 ms, write 2135 ms, index 511 ms: 8 candidates, 74607 repo-hours, 518 releases; waiting 660 ms; commit 1478 ms)
2026-11-07T06:55:32Z [load_day 2026-04-28] 2026-04-28 hour 6: 148718 events in 3 files, snapshot 5574133663570174832 (task 4718 ms: download 2508 ms overlapping gunzip 261 ms, parse 880 ms, sort 110 ms, write 2011 ms, index 532 ms: 9 candidates, 79239 repo-hours, 322 releases; waiting 651 ms; commit 1266 ms)
2026-11-07T06:55:33Z [load_day 2026-04-28] 2026-04-28 hour 7: 148847 events in 3 files, snapshot 1685635771010449669 (task 4606 ms: download 1690 ms overlapping gunzip 265 ms, parse 869 ms, sort 117 ms, write 2067 ms, index 521 ms: 11 candidates, 79248 repo-hours, 250 releases; waiting 546 ms; commit 1141 ms)
2026-11-07T06:55:40Z [load_day 2026-04-28] 2026-04-28 hour 8: 151612 events in 4 files, snapshot 1654230329978254610 (task 4286 ms: download 1527 ms overlapping gunzip 252 ms, parse 816 ms, sort 127 ms, write 1737 ms, index 536 ms: 11 candidates, 81095 repo-hours, 124 releases; waiting 520 ms; commit 3948 ms)
2026-11-07T06:55:41Z [load_day 2026-04-28] 2026-04-28 hour 9: 154374 events in 4 files, snapshot 5097862484599183516 (task 4561 ms: download 1748 ms overlapping gunzip 261 ms, parse 910 ms, sort 105 ms, write 1917 ms, index 563 ms: 9 candidates, 83219 repo-hours, 171 releases; waiting 534 ms; commit 1186 ms)
2026-11-07T06:55:45Z [load_day 2026-04-28] 2026-04-28 hour 10: 152187 events in 4 files, snapshot 8262314347232156676 (task 4518 ms: download 1563 ms overlapping gunzip 238 ms, parse 831 ms, sort 116 ms, write 1909 ms, index 560 ms: 11 candidates, 82838 repo-hours, 194 releases; waiting 539 ms; commit 1088 ms)
2026-11-07T06:55:46Z [load_day 2026-04-28] 2026-04-28 hour 11: 150587 events in 4 files, snapshot 899076737516686250 (task 4501 ms: download 1775 ms overlapping gunzip 230 ms, parse 855 ms, sort 114 ms, write 1898 ms, index 566 ms: 7 candidates, 82398 repo-hours, 159 releases; waiting 519 ms; commit 1278 ms)
2026-11-07T06:55:50Z [load_day 2026-04-28] 2026-04-28 hour 12: 150764 events in 4 files, snapshot 109020548664628166 (task 4195 ms: download 2174 ms overlapping gunzip 220 ms, parse 780 ms, sort 115 ms, write 1689 ms, index 568 ms: 4 candidates, 83231 repo-hours, 149 releases; waiting 549 ms; commit 1155 ms)
2026-11-07T06:55:51Z [load_day 2026-04-28] 2026-04-28 hour 13: 153900 events in 4 files, snapshot 488623480228757571 (task 4149 ms: download 1246 ms overlapping gunzip 226 ms, parse 808 ms, sort 167 ms, write 1609 ms, index 543 ms: 7 candidates, 81486 repo-hours, 38 releases; waiting 525 ms; commit 1131 ms)
2026-11-07T06:55:55Z [load_day 2026-04-28] 2026-04-28 hour 14: 152470 events in 4 files, snapshot 5520614847451596216 (task 4026 ms: download 1540 ms overlapping gunzip 207 ms, parse 810 ms, sort 128 ms, write 1476 ms, index 547 ms: 11 candidates, 82633 repo-hours, 66 releases; waiting 537 ms; commit 1467 ms)
2026-11-07T06:55:57Z [load_day 2026-04-28] 2026-04-28 hour 15: 152443 events in 4 files, snapshot 6537411756512115441 (task 3860 ms: download 1446 ms overlapping gunzip 198 ms, parse 771 ms, sort 108 ms, write 1373 ms, index 553 ms: 8 candidates, 79990 repo-hours, 62 releases; waiting 511 ms; commit 1836 ms)
2026-11-07T06:55:59Z [load_day 2026-04-28] 2026-04-28 hour 16: 154050 events in 4 files, snapshot 970513458863977871 (task 3901 ms: download 1446 ms overlapping gunzip 217 ms, parse 783 ms, sort 118 ms, write 1445 ms, index 568 ms: 6 candidates, 85435 repo-hours, 120 releases; waiting 530 ms; commit 1247 ms)
2026-11-07T06:56:01Z [load_day 2026-04-28] 2026-04-28 hour 17: 157361 events in 4 files, snapshot 7451583155912898831 (task 4381 ms: download 1721 ms overlapping gunzip 224 ms, parse 828 ms, sort 116 ms, write 1679 ms, index 607 ms: 8 candidates, 86192 repo-hours, 98 releases; waiting 545 ms; commit 1213 ms)
2026-11-07T06:56:05Z [load_day 2026-04-28] 2026-04-28 hour 18: 155245 events in 4 files, snapshot 4859694425779888158 (task 4608 ms: download 1418 ms overlapping gunzip 275 ms, parse 920 ms, sort 135 ms, write 1844 ms, index 580 ms: 7 candidates, 82857 repo-hours, 197 releases; waiting 539 ms; commit 1233 ms)
2026-11-07T06:56:06Z [load_day 2026-04-28] 2026-04-28 hour 19: 151158 events in 4 files, snapshot 5755684730317244373 (task 4195 ms: download 1390 ms overlapping gunzip 227 ms, parse 818 ms, sort 107 ms, write 1699 ms, index 534 ms: 12 candidates, 78984 repo-hours, 150 releases; waiting 540 ms; commit 955 ms)
2026-11-07T06:56:10Z [load_day 2026-04-28] 2026-04-28 hour 20: 155469 events in 4 files, snapshot 8759298884428841223 (task 4996 ms: download 2349 ms overlapping gunzip 290 ms, parse 974 ms, sort 135 ms, write 2083 ms, index 612 ms: 8 candidates, 81160 repo-hours, 251 releases; waiting 542 ms; commit 1047 ms)
2026-11-07T06:56:11Z [load_day 2026-04-28] 2026-04-28 hour 21: 158626 events in 4 files, snapshot 5296528809579481385 (task 4516 ms: download 1875 ms overlapping gunzip 237 ms, parse 882 ms, sort 128 ms, write 1946 ms, index 503 ms: 11 candidates, 74700 repo-hours, 188 releases; waiting 516 ms; commit 1078 ms)
2026-11-07T06:56:17Z [load_day 2026-04-28] 2026-04-28 hour 22: 152807 events in 4 files, snapshot 3157054220323038066 (task 5500 ms: download 1764 ms overlapping gunzip 331 ms, parse 1145 ms, sort 157 ms, write 2515 ms, index 547 ms: 7 candidates, 74533 repo-hours, 497 releases; waiting 536 ms; commit 1176 ms)
2026-11-07T06:56:18Z [load_day 2026-04-28] 2026-04-28 hour 23: 150890 events in 4 files, snapshot 7295577982079776704 (task 5086 ms: download 1364 ms overlapping gunzip 370 ms, parse 1253 ms, sort 162 ms, write 2375 ms, index 466 ms: 34 candidates, 73299 repo-hours, 661 releases; waiting 185 ms; commit 1052 ms)
2026-11-07T06:56:26Z [load_day 2026-04-28] 2026-04-28: repo_hour merged from 24 files to 1 (1917229 rows, 7940 ms)
2026-11-07T06:56:28Z [load_day 2026-04-28] 2026-04-28: index committed in 10175 ms (24 + 1 + 24 files)
2026-11-07T06:56:28Z [load_day 2026-04-28] 2026-04-28: 3658498 events in 24 hours
2026-11-07T06:56:28Z [load_day 2026-04-28] attempt 1 succeeded