orcaLog in

Runs · run 266

load_day 2026-08-21, attempt 1 succeeded

Host
4e84322b8c45:44729
Started
2026-11-07T04:28:35Z
Ended
2026-11-07T04:29:12Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/266/load_day/2026-08-21/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:28:35Z [load_day 2026-08-21] attempt 1 started
2026-11-07T04:28:39Z [load_day 2026-08-21] 2026-08-21 hour 0: 2090 events in 1 files, snapshot 1433414757234772020 (task 1011 ms: download 544 ms overlapping gunzip 12 ms, parse 45 ms, sort 1 ms, write 170 ms, index 32 ms: 0 candidates, 1812 repo-hours, 12 releases; waiting 497 ms; commit 687 ms)
2026-11-07T04:28:39Z [load_day 2026-08-21] 2026-08-21 hour 1: 9373 events in 1 files, snapshot 8928884690507940277 (task 1270 ms: download 636 ms overlapping gunzip 25 ms, parse 87 ms, sort 4 ms, write 250 ms, index 49 ms: 0 candidates, 5244 repo-hours, 20 releases; waiting 534 ms; commit 921 ms)
2026-11-07T04:28:41Z [load_day 2026-08-21] 2026-08-21 hour 2: 11477 events in 1 files, snapshot 5014194628768017252 (task 1267 ms: download 659 ms overlapping gunzip 31 ms, parse 107 ms, sort 6 ms, write 252 ms, index 67 ms: 0 candidates, 6418 repo-hours, 21 releases; waiting 532 ms; commit 820 ms)
2026-11-07T04:28:41Z [load_day 2026-08-21] 2026-08-21 hour 3: 29103 events in 1 files, snapshot 3151289242705108952 (task 1486 ms: download 745 ms overlapping gunzip 54 ms, parse 196 ms, sort 16 ms, write 361 ms, index 83 ms: 1 candidates, 9447 repo-hours, 40 releases; waiting 573 ms; commit 873 ms)
2026-11-07T04:28:43Z [load_day 2026-08-21] 2026-08-21 hour 4: 35951 events in 1 files, snapshot 8897187196867393293 (task 1668 ms: download 777 ms overlapping gunzip 63 ms, parse 233 ms, sort 22 ms, write 391 ms, index 107 ms: 1 candidates, 10197 repo-hours, 29 releases; waiting 540 ms; commit 793 ms)
2026-11-07T04:28:44Z [load_day 2026-08-21] 2026-08-21 hour 5: 40372 events in 1 files, snapshot 1594983175229475629 (task 1579 ms: download 780 ms overlapping gunzip 65 ms, parse 252 ms, sort 24 ms, write 426 ms, index 70 ms: 0 candidates, 10187 repo-hours, 24 releases; waiting 522 ms; commit 810 ms)
2026-11-07T04:28:45Z [load_day 2026-08-21] 2026-08-21 hour 6: 41799 events in 1 files, snapshot 8985406641361453692 (task 1685 ms: download 778 ms overlapping gunzip 61 ms, parse 229 ms, sort 25 ms, write 403 ms, index 90 ms: 3 candidates, 11338 repo-hours, 21 releases; waiting 536 ms; commit 729 ms)
2026-11-07T04:28:46Z [load_day 2026-08-21] 2026-08-21 hour 7: 41539 events in 1 files, snapshot 5892603201628937783 (task 1720 ms: download 792 ms overlapping gunzip 62 ms, parse 242 ms, sort 26 ms, write 447 ms, index 135 ms: 2 candidates, 11667 repo-hours, 30 releases; waiting 535 ms; commit 618 ms)
2026-11-07T04:28:48Z [load_day 2026-08-21] 2026-08-21 hour 8: 43553 events in 1 files, snapshot 8289953165989579214 (task 1705 ms: download 778 ms overlapping gunzip 63 ms, parse 236 ms, sort 25 ms, write 424 ms, index 106 ms: 1 candidates, 12547 repo-hours, 27 releases; waiting 521 ms; commit 820 ms)
2026-11-07T04:28:48Z [load_day 2026-08-21] 2026-08-21 hour 9: 44614 events in 1 files, snapshot 6091721027571477761 (task 1783 ms: download 832 ms overlapping gunzip 68 ms, parse 254 ms, sort 26 ms, write 444 ms, index 150 ms: 0 candidates, 13477 repo-hours, 47 releases; waiting 573 ms; commit 728 ms)
2026-11-07T04:28:50Z [load_day 2026-08-21] 2026-08-21 hour 10: 47246 events in 1 files, snapshot 6275254365156856455 (task 1803 ms: download 822 ms overlapping gunzip 83 ms, parse 296 ms, sort 29 ms, write 477 ms, index 99 ms: 3 candidates, 13721 repo-hours, 66 releases; waiting 537 ms; commit 761 ms)
2026-11-07T04:28:51Z [load_day 2026-08-21] 2026-08-21 hour 11: 46603 events in 1 files, snapshot 7783173239320644358 (task 1736 ms: download 812 ms overlapping gunzip 77 ms, parse 286 ms, sort 28 ms, write 460 ms, index 85 ms: 0 candidates, 13070 repo-hours, 35 releases; waiting 527 ms; commit 765 ms)
2026-11-07T04:28:52Z [load_day 2026-08-21] 2026-08-21 hour 12: 46753 events in 1 files, snapshot 4055779306017921909 (task 1760 ms: download 818 ms overlapping gunzip 71 ms, parse 268 ms, sort 28 ms, write 473 ms, index 92 ms: 0 candidates, 14500 repo-hours, 15 releases; waiting 552 ms; commit 868 ms)
2026-11-07T04:28:54Z [load_day 2026-08-21] 2026-08-21 hour 13: 46684 events in 1 files, snapshot 637846203604704890 (task 2421 ms: download 1046 ms overlapping gunzip 129 ms, parse 423 ms, sort 53 ms, write 797 ms, index 128 ms: 1 candidates, 18541 repo-hours, 178 releases; waiting 554 ms; commit 967 ms)
2026-11-07T04:28:56Z [load_day 2026-08-21] 2026-08-21 hour 14: 37784 events in 1 files, snapshot 7375111152271702498 (task 3327 ms: download 1402 ms overlapping gunzip 171 ms, parse 505 ms, sort 60 ms, write 1263 ms, index 147 ms: 0 candidates, 22137 repo-hours, 430 releases; waiting 765 ms; commit 703 ms)
2026-11-07T04:28:58Z [load_day 2026-08-21] 2026-08-21 hour 15: 40785 events in 1 files, snapshot 8218125727975001649 (task 3443 ms: download 1623 ms overlapping gunzip 171 ms, parse 516 ms, sort 58 ms, write 1292 ms, index 153 ms: 1 candidates, 21495 repo-hours, 391 releases; waiting 981 ms; commit 907 ms)
2026-11-07T04:29:00Z [load_day 2026-08-21] 2026-08-21 hour 16: 44249 events in 1 files, snapshot 5647405259320416487 (task 2874 ms: download 818 ms overlapping gunzip 154 ms, parse 478 ms, sort 58 ms, write 1173 ms, index 139 ms: 6 candidates, 20847 repo-hours, 294 releases; waiting 273 ms; commit 878 ms)
2026-11-07T04:29:02Z [load_day 2026-08-21] 2026-08-21 hour 17: 43100 events in 1 files, snapshot 2417992067683033460 (task 2863 ms: download 1242 ms overlapping gunzip 128 ms, parse 402 ms, sort 35 ms, write 930 ms, index 143 ms: 6 candidates, 18968 repo-hours, 192 releases; waiting 748 ms; commit 844 ms)
2026-11-07T04:29:03Z [load_day 2026-08-21] 2026-08-21 hour 18: 45196 events in 1 files, snapshot 5094045336672871558 (task 1997 ms: download 847 ms overlapping gunzip 88 ms, parse 286 ms, sort 31 ms, write 655 ms, index 117 ms: 0 candidates, 17301 repo-hours, 87 releases; waiting 540 ms; commit 878 ms)
2026-11-07T04:29:04Z [load_day 2026-08-21] 2026-08-21 hour 19: 41403 events in 1 files, snapshot 4510759815493553317 (task 1127 ms: download 127 ms overlapping gunzip 66 ms, parse 227 ms, sort 25 ms, write 478 ms, index 120 ms: 1 candidates, 14645 repo-hours, 34 releases; waiting 20 ms; commit 901 ms)
2026-11-07T04:29:04Z [load_day 2026-08-21] 2026-08-21 hour 20: 39620 events in 1 files, snapshot 8798167977933403150 (task 1109 ms: download 120 ms overlapping gunzip 59 ms, parse 194 ms, sort 24 ms, write 447 ms, index 169 ms: 1 candidates, 12906 repo-hours, 45 releases; waiting 17 ms; commit 667 ms)
2026-11-07T04:29:07Z [load_day 2026-08-21] 2026-08-21 hour 21: 38068 events in 1 files, snapshot 337817349590160721 (task 2282 ms: download 1323 ms overlapping gunzip 67 ms, parse 235 ms, sort 24 ms, write 421 ms, index 125 ms: 2 candidates, 12289 repo-hours, 28 releases; waiting 1077 ms; commit 738 ms)
2026-11-07T04:29:07Z [load_day 2026-08-21] 2026-08-21 hour 22: 37483 events in 1 files, snapshot 3610228245392257321 (task 945 ms: download 116 ms overlapping gunzip 50 ms, parse 175 ms, sort 23 ms, write 397 ms, index 83 ms: 0 candidates, 11755 repo-hours, 22 releases; waiting 17 ms; commit 697 ms)
2026-11-07T04:29:08Z [load_day 2026-08-21] 2026-08-21 hour 23: 29407 events in 1 files, snapshot 946338635975321507 (task 825 ms: download 91 ms overlapping gunzip 43 ms, parse 145 ms, sort 16 ms, write 346 ms, index 75 ms: 0 candidates, 9723 repo-hours, 27 releases; waiting 15 ms; commit 697 ms)
2026-11-07T04:29:10Z [load_day 2026-08-21] 2026-08-21: repo_hour merged from 24 files to 1 (314232 rows, 2273 ms)
2026-11-07T04:29:12Z [load_day 2026-08-21] 2026-08-21: index committed in 3668 ms (13 + 1 + 24 files)
2026-11-07T04:29:12Z [load_day 2026-08-21] 2026-08-21: 884252 events in 24 hours
2026-11-07T04:29:12Z [load_day 2026-08-21] attempt 1 succeeded