orcaLog in

Runs · run 669

load_day 2026-04-09, attempt 1 succeeded

Host
4e84322b8c45:164286
Started
2026-11-07T13:02:00Z
Ended
2026-11-07T13:03:34Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/669/load_day/2026-04-09/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T13:02:00Z [load_day 2026-04-09] attempt 1 started
2026-11-07T13:02:10Z [load_day 2026-04-09] 2026-04-09 hour 0: 151043 events in 4 files, snapshot 1569589469895200378 (task 6023 ms: download 2231 ms overlapping gunzip 458 ms, parse 1459 ms, sort 179 ms, write 2400 ms, index 531 ms: 6 candidates, 74152 repo-hours, 651 releases; waiting 607 ms; commit 1203 ms)
2026-11-07T13:02:11Z [load_day 2026-04-09] 2026-04-09 hour 1: 159617 events in 4 files, snapshot 4725803994802315642 (task 5773 ms: download 1356 ms overlapping gunzip 432 ms, parse 1356 ms, sort 179 ms, write 2755 ms, index 588 ms: 7 candidates, 91364 repo-hours, 586 releases; waiting 163 ms; commit 1187 ms)
2026-11-07T13:02:18Z [load_day 2026-04-09] 2026-04-09 hour 2: 156846 events in 4 files, snapshot 4109236476951337317 (task 6624 ms: download 1773 ms overlapping gunzip 420 ms, parse 1424 ms, sort 176 ms, write 3142 ms, index 617 ms: 11 candidates, 89006 repo-hours, 591 releases; waiting 521 ms; commit 1302 ms)
2026-11-07T13:02:19Z [load_day 2026-04-09] 2026-04-09 hour 3: 153514 events in 4 files, snapshot 4989329240754792007 (task 6718 ms: download 2441 ms overlapping gunzip 429 ms, parse 1486 ms, sort 198 ms, write 3135 ms, index 515 ms: 10 candidates, 71936 repo-hours, 717 releases; waiting 628 ms; commit 1404 ms)
2026-11-07T13:02:24Z [load_day 2026-04-09] 2026-04-09 hour 4: 152506 events in 4 files, snapshot 2160816850417219727 (task 6012 ms: download 1573 ms overlapping gunzip 404 ms, parse 1380 ms, sort 159 ms, write 2953 ms, index 510 ms: 16 candidates, 73398 repo-hours, 723 releases; waiting 245 ms; commit 1217 ms)
2026-11-07T13:02:26Z [load_day 2026-04-09] 2026-04-09 hour 5: 156846 events in 4 files, snapshot 8898121996322066103 (task 6120 ms: download 1975 ms overlapping gunzip 412 ms, parse 1401 ms, sort 215 ms, write 2740 ms, index 528 ms: 14 candidates, 79065 repo-hours, 686 releases; waiting 592 ms; commit 1404 ms)
2026-11-07T13:02:32Z [load_day 2026-04-09] 2026-04-09 hour 6: 152454 events in 4 files, snapshot 4853148325384901709 (task 6279 ms: download 2250 ms overlapping gunzip 389 ms, parse 1330 ms, sort 166 ms, write 2787 ms, index 556 ms: 7 candidates, 80462 repo-hours, 595 releases; waiting 632 ms; commit 1338 ms)
2026-11-07T13:02:33Z [load_day 2026-04-09] 2026-04-09 hour 7: 157643 events in 4 files, snapshot 8775777384381669002 (task 5841 ms: download 1766 ms overlapping gunzip 368 ms, parse 1265 ms, sort 142 ms, write 2699 ms, index 556 ms: 9 candidates, 86598 repo-hours, 505 releases; waiting 530 ms; commit 1229 ms)
2026-11-07T13:02:38Z [load_day 2026-04-09] 2026-04-09 hour 8: 150917 events in 4 files, snapshot 7874174708204331683 (task 5531 ms: download 1637 ms overlapping gunzip 363 ms, parse 1216 ms, sort 156 ms, write 2491 ms, index 553 ms: 6 candidates, 82309 repo-hours, 471 releases; waiting 519 ms; commit 1392 ms)
2026-11-07T13:02:39Z [load_day 2026-04-09] 2026-04-09 hour 9: 153348 events in 4 files, snapshot 1186615072080286383 (task 5595 ms: download 1789 ms overlapping gunzip 338 ms, parse 1098 ms, sort 138 ms, write 2589 ms, index 581 ms: 12 candidates, 85135 repo-hours, 500 releases; waiting 528 ms; commit 1401 ms)
2026-11-07T13:02:44Z [load_day 2026-04-09] 2026-04-09 hour 10: 159956 events in 4 files, snapshot 761855142692245285 (task 5576 ms: download 1881 ms overlapping gunzip 391 ms, parse 1258 ms, sort 163 ms, write 2411 ms, index 552 ms: 3 candidates, 84188 repo-hours, 478 releases; waiting 530 ms; commit 1095 ms)
2026-11-07T13:02:46Z [load_day 2026-04-09] 2026-04-09 hour 11: 158755 events in 4 files, snapshot 1942185110753447491 (task 5528 ms: download 2482 ms overlapping gunzip 390 ms, parse 1259 ms, sort 162 ms, write 2266 ms, index 562 ms: 9 candidates, 81355 repo-hours, 452 releases; waiting 535 ms; commit 1299 ms)
2026-11-07T13:02:51Z [load_day 2026-04-09] 2026-04-09 hour 12: 155389 events in 4 files, snapshot 7059853099318596692 (task 5641 ms: download 1529 ms overlapping gunzip 332 ms, parse 1109 ms, sort 166 ms, write 2575 ms, index 601 ms: 17 candidates, 85443 repo-hours, 339 releases; waiting 521 ms; commit 1305 ms)
2026-11-07T13:02:52Z [load_day 2026-04-09] 2026-04-09 hour 13: 154954 events in 4 files, snapshot 3850199201384354320 (task 5319 ms: download 1772 ms overlapping gunzip 273 ms, parse 911 ms, sort 152 ms, write 2541 ms, index 615 ms: 9 candidates, 97268 repo-hours, 312 releases; waiting 557 ms; commit 1237 ms)
2026-11-07T13:02:56Z [load_day 2026-04-09] 2026-04-09 hour 14: 152105 events in 4 files, snapshot 766055336544529627 (task 4799 ms: download 1579 ms overlapping gunzip 266 ms, parse 872 ms, sort 119 ms, write 1981 ms, index 643 ms: 9 candidates, 89369 repo-hours, 258 releases; waiting 572 ms; commit 1284 ms)
2026-11-07T13:02:58Z [load_day 2026-04-09] 2026-04-09 hour 15: 148338 events in 3 files, snapshot 6096292393935179301 (task 4677 ms: download 1750 ms overlapping gunzip 273 ms, parse 947 ms, sort 165 ms, write 1892 ms, index 556 ms: 9 candidates, 84215 repo-hours, 349 releases; waiting 585 ms; commit 1256 ms)
2026-11-07T13:03:03Z [load_day 2026-04-09] 2026-04-09 hour 16: 155250 events in 4 files, snapshot 8289275070175145920 (task 5518 ms: download 1657 ms overlapping gunzip 302 ms, parse 1018 ms, sort 153 ms, write 2509 ms, index 603 ms: 4 candidates, 88513 repo-hours, 407 releases; waiting 603 ms; commit 1405 ms)
2026-11-07T13:03:04Z [load_day 2026-04-09] 2026-04-09 hour 17: 151375 events in 4 files, snapshot 7996725865408478063 (task 5167 ms: download 1975 ms overlapping gunzip 297 ms, parse 1000 ms, sort 116 ms, write 2280 ms, index 608 ms: 4 candidates, 86334 repo-hours, 477 releases; waiting 506 ms; commit 1309 ms)
2026-11-07T13:03:08Z [load_day 2026-04-09] 2026-04-09 hour 18: 154924 events in 4 files, snapshot 7808481130235265666 (task 5064 ms: download 1682 ms overlapping gunzip 322 ms, parse 1092 ms, sort 128 ms, write 2077 ms, index 661 ms: 9 candidates, 84894 repo-hours, 454 releases; waiting 527 ms; commit 1253 ms)
2026-11-07T13:03:11Z [load_day 2026-04-09] 2026-04-09 hour 19: 151862 events in 4 files, snapshot 6742791876943808901 (task 5910 ms: download 2400 ms overlapping gunzip 370 ms, parse 1203 ms, sort 145 ms, write 2358 ms, index 634 ms: 10 candidates, 82786 repo-hours, 550 releases; waiting 882 ms; commit 1173 ms)
2026-11-07T13:03:15Z [load_day 2026-04-09] 2026-04-09 hour 20: 151787 events in 4 files, snapshot 8879359243235241975 (task 5349 ms: download 1447 ms overlapping gunzip 384 ms, parse 1223 ms, sort 173 ms, write 2429 ms, index 542 ms: 12 candidates, 79166 repo-hours, 573 releases; waiting 217 ms; commit 1334 ms)
2026-11-07T13:03:17Z [load_day 2026-04-09] 2026-04-09 hour 21: 150435 events in 4 files, snapshot 7427704450150718152 (task 5682 ms: download 1799 ms overlapping gunzip 358 ms, parse 1172 ms, sort 150 ms, write 2615 ms, index 498 ms: 3 candidates, 75761 repo-hours, 719 releases; waiting 536 ms; commit 1312 ms)
2026-11-07T13:03:22Z [load_day 2026-04-09] 2026-04-09 hour 22: 151486 events in 4 files, snapshot 1368952079630022215 (task 6239 ms: download 2263 ms overlapping gunzip 402 ms, parse 1306 ms, sort 150 ms, write 2548 ms, index 655 ms: 4 candidates, 72262 repo-hours, 808 releases; waiting 903 ms; commit 1227 ms)
2026-11-07T13:03:24Z [load_day 2026-04-09] 2026-04-09 hour 23: 150699 events in 4 files, snapshot 794936149664430983 (task 6704 ms: download 2890 ms overlapping gunzip 469 ms, parse 1533 ms, sort 165 ms, write 2429 ms, index 451 ms: 11 candidates, 71348 repo-hours, 934 releases; waiting 1314 ms; commit 1150 ms)
2026-11-07T13:03:32Z [load_day 2026-04-09] 2026-04-09: repo_hour merged from 24 files to 1 (1976327 rows, 8129 ms)
2026-11-07T13:03:34Z [load_day 2026-04-09] 2026-04-09: index committed in 9966 ms (24 + 1 + 24 files)
2026-11-07T13:03:34Z [load_day 2026-04-09] 2026-04-09: 3692049 events in 24 hours
2026-11-07T13:03:34Z [load_day 2026-04-09] attempt 1 succeeded