orcaLog in

Runs · run 617

load_day 2026-04-26, attempt 1 succeeded

Host
4e84322b8c45:139531
Started
2026-11-07T06:57:54Z
Ended
2026-11-07T06:59:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/617/load_day/2026-04-26/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:57:54Z [load_day 2026-04-26] attempt 1 started
2026-11-07T06:58:04Z [load_day 2026-04-26] 2026-04-26 hour 0: 145565 events in 3 files, snapshot 6614609555968353054 (task 6699 ms: download 2081 ms overlapping gunzip 381 ms, parse 1269 ms, sort 167 ms, write 3648 ms, index 411 ms: 8 candidates, 64033 repo-hours, 835 releases; waiting 537 ms; commit 1240 ms)
2026-11-07T06:58:06Z [load_day 2026-04-26] 2026-04-26 hour 1: 144970 events in 3 files, snapshot 5923912706091793600 (task 6578 ms: download 2253 ms overlapping gunzip 348 ms, parse 1180 ms, sort 187 ms, write 3558 ms, index 464 ms: 10 candidates, 69255 repo-hours, 808 releases; waiting 528 ms; commit 1507 ms)
2026-11-07T06:58:11Z [load_day 2026-04-26] 2026-04-26 hour 2: 150280 events in 4 files, snapshot 6920924316754477333 (task 6110 ms: download 1760 ms overlapping gunzip 359 ms, parse 1217 ms, sort 262 ms, write 2715 ms, index 701 ms: 10 candidates, 79767 repo-hours, 649 releases; waiting 541 ms; commit 1546 ms)
2026-11-07T06:58:13Z [load_day 2026-04-26] 2026-04-26 hour 3: 148185 events in 3 files, snapshot 43228031850493729 (task 5578 ms: download 1925 ms overlapping gunzip 331 ms, parse 1094 ms, sort 134 ms, write 2706 ms, index 483 ms: 10 candidates, 74784 repo-hours, 800 releases; waiting 553 ms; commit 1365 ms)
2026-11-07T06:58:18Z [load_day 2026-04-26] 2026-04-26 hour 4: 144903 events in 3 files, snapshot 6277042618100371657 (task 5956 ms: download 1920 ms overlapping gunzip 372 ms, parse 1210 ms, sort 179 ms, write 2801 ms, index 539 ms: 8 candidates, 64362 repo-hours, 844 releases; waiting 538 ms; commit 1642 ms)
2026-11-07T06:58:19Z [load_day 2026-04-26] 2026-04-26 hour 5: 144454 events in 3 files, snapshot 3341381186816019988 (task 5966 ms: download 2110 ms overlapping gunzip 425 ms, parse 1315 ms, sort 158 ms, write 2578 ms, index 445 ms: 10 candidates, 67500 repo-hours, 832 releases; waiting 709 ms; commit 1323 ms)
2026-11-07T06:58:24Z [load_day 2026-04-26] 2026-04-26 hour 6: 148368 events in 3 files, snapshot 3828612850882261341 (task 5856 ms: download 2317 ms overlapping gunzip 352 ms, parse 1158 ms, sort 141 ms, write 2719 ms, index 526 ms: 6 candidates, 72041 repo-hours, 744 releases; waiting 557 ms; commit 1528 ms)
2026-11-07T06:58:29Z [load_day 2026-04-26] 2026-04-26 hour 7: 149838 events in 3 files, snapshot 8051915035284102149 (task 6020 ms: download 1935 ms overlapping gunzip 428 ms, parse 1408 ms, sort 201 ms, write 2637 ms, index 483 ms: 14 candidates, 72759 repo-hours, 811 releases; waiting 565 ms; commit 4162 ms)
2026-11-07T06:58:31Z [load_day 2026-04-26] 2026-04-26 hour 8: 148401 events in 3 files, snapshot 6899586533047522742 (task 6846 ms: download 1844 ms overlapping gunzip 438 ms, parse 1451 ms, sort 272 ms, write 3224 ms, index 541 ms: 10 candidates, 73501 repo-hours, 756 releases; waiting 542 ms; commit 1144 ms)
2026-11-07T06:58:32Z [load_day 2026-04-26] 2026-04-26 hour 9: 149436 events in 3 files, snapshot 2757949270357454378 (task 6051 ms: download 1869 ms overlapping gunzip 346 ms, parse 1200 ms, sort 123 ms, write 3206 ms, index 517 ms: 2 candidates, 77171 repo-hours, 837 releases; waiting 297 ms; commit 1014 ms)
2026-11-07T06:58:39Z [load_day 2026-04-26] 2026-04-26 hour 10: 148274 events in 3 files, snapshot 5495962549510587675 (task 5944 ms: download 2017 ms overlapping gunzip 327 ms, parse 1057 ms, sort 155 ms, write 3002 ms, index 518 ms: 4 candidates, 75745 repo-hours, 732 releases; waiting 578 ms; commit 1717 ms)
2026-11-07T06:58:40Z [load_day 2026-04-26] 2026-04-26 hour 11: 147961 events in 3 files, snapshot 6046022730094120685 (task 6221 ms: download 2184 ms overlapping gunzip 345 ms, parse 1128 ms, sort 135 ms, write 3101 ms, index 528 ms: 5 candidates, 76358 repo-hours, 666 releases; waiting 727 ms; commit 1495 ms)
2026-11-07T06:58:45Z [load_day 2026-04-26] 2026-04-26 hour 12: 154331 events in 4 files, snapshot 8513430308975372874 (task 6087 ms: download 1940 ms overlapping gunzip 463 ms, parse 1252 ms, sort 144 ms, write 2682 ms, index 553 ms: 8 candidates, 84868 repo-hours, 659 releases; waiting 664 ms; commit 1102 ms)
2026-11-07T06:58:46Z [load_day 2026-04-26] 2026-04-26 hour 13: 157177 events in 4 files, snapshot 4277479033775659954 (task 5106 ms: download 1212 ms overlapping gunzip 331 ms, parse 1213 ms, sort 114 ms, write 2444 ms, index 568 ms: 10 candidates, 88836 repo-hours, 612 releases; waiting 209 ms; commit 1344 ms)
2026-11-07T06:58:51Z [load_day 2026-04-26] 2026-04-26 hour 14: 153438 events in 4 files, snapshot 6030193477316418400 (task 5873 ms: download 1616 ms overlapping gunzip 307 ms, parse 1015 ms, sort 128 ms, write 2956 ms, index 614 ms: 8 candidates, 78270 repo-hours, 598 releases; waiting 535 ms; commit 1084 ms)
2026-11-07T06:58:53Z [load_day 2026-04-26] 2026-04-26 hour 15: 156803 events in 4 files, snapshot 5614070837590145499 (task 6068 ms: download 1957 ms overlapping gunzip 312 ms, parse 1047 ms, sort 129 ms, write 3080 ms, index 574 ms: 13 candidates, 82748 repo-hours, 577 releases; waiting 620 ms; commit 1163 ms)
2026-11-07T06:58:58Z [load_day 2026-04-26] 2026-04-26 hour 16: 155516 events in 4 files, snapshot 5238392893190579742 (task 6196 ms: download 2199 ms overlapping gunzip 392 ms, parse 1286 ms, sort 174 ms, write 2875 ms, index 621 ms: 13 candidates, 81813 repo-hours, 632 releases; waiting 590 ms; commit 1353 ms)
2026-11-07T06:59:00Z [load_day 2026-04-26] 2026-04-26 hour 17: 157292 events in 4 files, snapshot 3975037715467664299 (task 5813 ms: download 1934 ms overlapping gunzip 402 ms, parse 1140 ms, sort 128 ms, write 2818 ms, index 524 ms: 7 candidates, 78540 repo-hours, 622 releases; waiting 520 ms; commit 1203 ms)
2026-11-07T06:59:05Z [load_day 2026-04-26] 2026-04-26 hour 18: 155566 events in 4 files, snapshot 4754686501178920457 (task 6432 ms: download 1843 ms overlapping gunzip 391 ms, parse 1388 ms, sort 221 ms, write 2755 ms, index 629 ms: 6 candidates, 79475 repo-hours, 589 releases; waiting 555 ms; commit 1247 ms)
2026-11-07T06:59:07Z [load_day 2026-04-26] 2026-04-26 hour 19: 153346 events in 4 files, snapshot 4278688061091650844 (task 6037 ms: download 2091 ms overlapping gunzip 349 ms, parse 1149 ms, sort 130 ms, write 2972 ms, index 514 ms: 5 candidates, 77204 repo-hours, 643 releases; waiting 649 ms; commit 1390 ms)
2026-11-07T06:59:12Z [load_day 2026-04-26] 2026-04-26 hour 20: 150409 events in 4 files, snapshot 7128758853628461052 (task 6180 ms: download 2514 ms overlapping gunzip 360 ms, parse 1250 ms, sort 188 ms, write 3036 ms, index 467 ms: 5 candidates, 73123 repo-hours, 720 releases; waiting 662 ms; commit 1439 ms)
2026-11-07T06:59:14Z [load_day 2026-04-26] 2026-04-26 hour 21: 151638 events in 4 files, snapshot 1421176356644032279 (task 6355 ms: download 2133 ms overlapping gunzip 351 ms, parse 1150 ms, sort 152 ms, write 3275 ms, index 516 ms: 8 candidates, 71685 repo-hours, 735 releases; waiting 591 ms; commit 1334 ms)
2026-11-07T06:59:19Z [load_day 2026-04-26] 2026-04-26 hour 22: 148713 events in 3 files, snapshot 3415323768996000828 (task 6219 ms: download 1999 ms overlapping gunzip 376 ms, parse 1221 ms, sort 183 ms, write 3229 ms, index 442 ms: 5 candidates, 67060 repo-hours, 803 releases; waiting 536 ms; commit 1233 ms)
2026-11-07T06:59:21Z [load_day 2026-04-26] 2026-04-26 hour 23: 148655 events in 3 files, snapshot 1509465711264338878 (task 6171 ms: download 1913 ms overlapping gunzip 354 ms, parse 1159 ms, sort 211 ms, write 2961 ms, index 455 ms: 8 candidates, 67917 repo-hours, 686 releases; waiting 727 ms; commit 963 ms)
2026-11-07T06:59:28Z [load_day 2026-04-26] 2026-04-26: repo_hour merged from 24 files to 1 (1798815 rows, 7309 ms)
2026-11-07T06:59:30Z [load_day 2026-04-26] 2026-04-26: index committed in 9233 ms (24 + 1 + 24 files)
2026-11-07T06:59:30Z [load_day 2026-04-26] 2026-04-26: 3613519 events in 24 hours
2026-11-07T06:59:30Z [load_day 2026-04-26] attempt 1 succeeded