orcaLog in

Runs · run 488

load_day 2026-06-08, attempt 1 succeeded

Host
4e84322b8c45:105270
Started
2026-11-07T05:57:53Z
Ended
2026-11-07T05:59:04Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/488/load_day/2026-06-08/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:57:53Z [load_day 2026-06-08] attempt 1 started
2026-11-07T05:58:02Z [load_day 2026-06-08] 2026-06-08 hour 0: 150035 events in 4 files, snapshot 3617694774967125178 (task 5822 ms: download 1820 ms overlapping gunzip 343 ms, parse 1195 ms, sort 152 ms, write 2837 ms, index 435 ms: 11 candidates, 66365 repo-hours, 647 releases; waiting 508 ms; commit 1032 ms)
2026-11-07T05:58:03Z [load_day 2026-06-08] 2026-06-08 hour 1: 147988 events in 3 files, snapshot 4814289581724648224 (task 5529 ms: download 1577 ms overlapping gunzip 354 ms, parse 1211 ms, sort 128 ms, write 2516 ms, index 477 ms: 6 candidates, 67720 repo-hours, 555 releases; waiting 522 ms; commit 1040 ms)
2026-11-07T05:58:06Z [load_day 2026-06-08] 2026-06-08 hour 2: 157338 events in 4 files, snapshot 198475095313305610 (task 4235 ms: download 1406 ms overlapping gunzip 238 ms, parse 861 ms, sort 107 ms, write 1747 ms, index 531 ms: 4 candidates, 82576 repo-hours, 171 releases; waiting 519 ms; commit 971 ms)
2026-11-07T05:58:08Z [load_day 2026-06-08] 2026-06-08 hour 3: 162606 events in 4 files, snapshot 3092772251669681523 (task 4368 ms: download 2239 ms overlapping gunzip 248 ms, parse 873 ms, sort 136 ms, write 1722 ms, index 510 ms: 9 candidates, 77654 repo-hours, 183 releases; waiting 548 ms; commit 1021 ms)
2026-11-07T05:58:12Z [load_day 2026-06-08] 2026-06-08 hour 4: 160740 events in 4 files, snapshot 1156075475868833453 (task 4593 ms: download 2116 ms overlapping gunzip 260 ms, parse 909 ms, sort 109 ms, write 1918 ms, index 537 ms: 6 candidates, 86942 repo-hours, 187 releases; waiting 521 ms; commit 1012 ms)
2026-11-07T05:58:13Z [load_day 2026-06-08] 2026-06-08 hour 5: 155371 events in 4 files, snapshot 7728564404266249077 (task 4099 ms: download 1264 ms overlapping gunzip 257 ms, parse 845 ms, sort 103 ms, write 1777 ms, index 495 ms: 8 candidates, 74784 repo-hours, 193 releases; waiting 354 ms; commit 927 ms)
2026-11-07T05:58:16Z [load_day 2026-06-08] 2026-06-08 hour 6: 153771 events in 4 files, snapshot 6861456091233356449 (task 4038 ms: download 1318 ms overlapping gunzip 218 ms, parse 789 ms, sort 103 ms, write 1696 ms, index 485 ms: 4 candidates, 71448 repo-hours, 74 releases; waiting 522 ms; commit 974 ms)
2026-11-07T05:58:17Z [load_day 2026-06-08] 2026-06-08 hour 7: 157811 events in 4 files, snapshot 4854559420146092569 (task 4070 ms: download 1551 ms overlapping gunzip 226 ms, parse 798 ms, sort 105 ms, write 1574 ms, index 513 ms: 3 candidates, 72786 repo-hours, 48 releases; waiting 519 ms; commit 976 ms)
2026-11-07T05:58:21Z [load_day 2026-06-08] 2026-06-08 hour 8: 159726 events in 4 files, snapshot 4667828197282996260 (task 4009 ms: download 1202 ms overlapping gunzip 206 ms, parse 770 ms, sort 105 ms, write 1553 ms, index 537 ms: 10 candidates, 76305 repo-hours, 36 releases; waiting 521 ms; commit 1063 ms)
2026-11-07T05:58:22Z [load_day 2026-06-08] 2026-06-08 hour 9: 156139 events in 4 files, snapshot 3201464694964665844 (task 3928 ms: download 1533 ms overlapping gunzip 210 ms, parse 777 ms, sort 107 ms, write 1390 ms, index 548 ms: 11 candidates, 78664 repo-hours, 19 releases; waiting 509 ms; commit 970 ms)
2026-11-07T05:58:25Z [load_day 2026-06-08] 2026-06-08 hour 10: 160337 events in 4 files, snapshot 6122110118863337903 (task 3703 ms: download 734 ms overlapping gunzip 211 ms, parse 787 ms, sort 105 ms, write 1497 ms, index 531 ms: 12 candidates, 79303 repo-hours, 34 releases; waiting 182 ms; commit 1010 ms)
2026-11-07T05:58:27Z [load_day 2026-06-08] 2026-06-08 hour 11: 160747 events in 4 files, snapshot 4676559456319589616 (task 3910 ms: download 1252 ms overlapping gunzip 201 ms, parse 754 ms, sort 104 ms, write 1516 ms, index 534 ms: 11 candidates, 82204 repo-hours, 42 releases; waiting 517 ms; commit 1057 ms)
2026-11-07T05:58:30Z [load_day 2026-06-08] 2026-06-08 hour 12: 158243 events in 4 files, snapshot 7515126441435703715 (task 3927 ms: download 1315 ms overlapping gunzip 199 ms, parse 730 ms, sort 105 ms, write 1491 ms, index 536 ms: 5 candidates, 80910 repo-hours, 23 releases; waiting 523 ms; commit 1117 ms)
2026-11-07T05:58:31Z [load_day 2026-06-08] 2026-06-08 hour 13: 158142 events in 4 files, snapshot 8867832410499602306 (task 4005 ms: download 1144 ms overlapping gunzip 198 ms, parse 730 ms, sort 99 ms, write 1561 ms, index 560 ms: 3 candidates, 83526 repo-hours, 27 releases; waiting 235 ms; commit 1010 ms)
2026-11-07T05:58:34Z [load_day 2026-06-08] 2026-06-08 hour 14: 150527 events in 4 files, snapshot 1448611012224043693 (task 3823 ms: download 1347 ms overlapping gunzip 188 ms, parse 681 ms, sort 100 ms, write 1449 ms, index 517 ms: 10 candidates, 77785 repo-hours, 35 releases; waiting 495 ms; commit 1204 ms)
2026-11-07T05:58:36Z [load_day 2026-06-08] 2026-06-08 hour 15: 160175 events in 4 files, snapshot 3482634612416105465 (task 3804 ms: download 1022 ms overlapping gunzip 211 ms, parse 750 ms, sort 101 ms, write 1595 ms, index 586 ms: 9 candidates, 91572 repo-hours, 37 releases; waiting 339 ms; commit 1379 ms)
2026-11-07T05:58:39Z [load_day 2026-06-08] 2026-06-08 hour 16: 158811 events in 4 files, snapshot 2412587035280440222 (task 4235 ms: download 1474 ms overlapping gunzip 199 ms, parse 773 ms, sort 110 ms, write 1470 ms, index 609 ms: 12 candidates, 84947 repo-hours, 34 releases; waiting 540 ms; commit 1002 ms)
2026-11-07T05:58:40Z [load_day 2026-06-08] 2026-06-08 hour 17: 156761 events in 4 files, snapshot 1146044918720705198 (task 4003 ms: download 1366 ms overlapping gunzip 199 ms, parse 735 ms, sort 106 ms, write 1610 ms, index 545 ms: 11 candidates, 81688 repo-hours, 28 releases; waiting 527 ms; commit 973 ms)
2026-11-07T05:58:44Z [load_day 2026-06-08] 2026-06-08 hour 18: 160253 events in 4 files, snapshot 6605635887628671233 (task 3890 ms: download 1313 ms overlapping gunzip 208 ms, parse 767 ms, sort 108 ms, write 1452 ms, index 549 ms: 10 candidates, 79077 repo-hours, 60 releases; waiting 527 ms; commit 1053 ms)
2026-11-07T05:58:45Z [load_day 2026-06-08] 2026-06-08 hour 19: 157925 events in 4 files, snapshot 1623489842107446829 (task 3970 ms: download 1192 ms overlapping gunzip 212 ms, parse 781 ms, sort 106 ms, write 1610 ms, index 527 ms: 5 candidates, 78108 repo-hours, 45 releases; waiting 519 ms; commit 918 ms)
2026-11-07T05:58:49Z [load_day 2026-06-08] 2026-06-08 hour 20: 160246 events in 4 files, snapshot 7924084103010758019 (task 4089 ms: download 1459 ms overlapping gunzip 236 ms, parse 892 ms, sort 105 ms, write 1491 ms, index 542 ms: 13 candidates, 79050 repo-hours, 62 releases; waiting 508 ms; commit 1111 ms)
2026-11-07T05:58:50Z [load_day 2026-06-08] 2026-06-08 hour 21: 158801 events in 4 files, snapshot 3940152319245479804 (task 3938 ms: download 1211 ms overlapping gunzip 230 ms, parse 823 ms, sort 111 ms, write 1519 ms, index 471 ms: 4 candidates, 71407 repo-hours, 98 releases; waiting 521 ms; commit 1195 ms)
2026-11-07T05:58:53Z [load_day 2026-06-08] 2026-06-08 hour 22: 156367 events in 4 files, snapshot 2245281646765692385 (task 4341 ms: download 1796 ms overlapping gunzip 242 ms, parse 864 ms, sort 109 ms, write 1832 ms, index 460 ms: 10 candidates, 70685 repo-hours, 154 releases; waiting 556 ms; commit 1025 ms)
2026-11-07T05:58:54Z [load_day 2026-06-08] 2026-06-08 hour 23: 154832 events in 4 files, snapshot 509408192329337210 (task 4285 ms: download 1288 ms overlapping gunzip 263 ms, parse 941 ms, sort 127 ms, write 1683 ms, index 484 ms: 4 candidates, 71613 repo-hours, 254 releases; waiting 527 ms; commit 1019 ms)
2026-11-07T05:59:02Z [load_day 2026-06-08] 2026-06-08: repo_hour merged from 24 files to 1 (1867119 rows, 7477 ms)
2026-11-07T05:59:04Z [load_day 2026-06-08] 2026-06-08: index committed in 9052 ms (24 + 1 + 24 files)
2026-11-07T05:59:04Z [load_day 2026-06-08] 2026-06-08: 3773692 events in 24 hours
2026-11-07T05:59:04Z [load_day 2026-06-08] attempt 1 succeeded