orcaLog in

Runs · run 636

load_day 2026-04-20, attempt 1 succeeded

Host
4e84322b8c45:155162
Started
2026-11-07T12:44:47Z
Ended
2026-11-07T12:46:12Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/636/load_day/2026-04-20/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T12:44:47Z [load_day 2026-04-20] attempt 1 started
2026-11-07T12:44:57Z [load_day 2026-04-20] 2026-04-20 hour 0: 147731 events in 3 files, snapshot 863657427776161391 (task 5989 ms: download 2205 ms overlapping gunzip 417 ms, parse 1464 ms, sort 175 ms, write 2600 ms, index 457 ms: 4 candidates, 70013 repo-hours, 795 releases; waiting 522 ms; commit 1235 ms)
2026-11-07T12:44:58Z [load_day 2026-04-20] 2026-04-20 hour 1: 146079 events in 3 files, snapshot 8940397894937207289 (task 5507 ms: download 1610 ms overlapping gunzip 371 ms, parse 1280 ms, sort 165 ms, write 2640 ms, index 524 ms: 8 candidates, 79030 repo-hours, 600 releases; waiting 181 ms; commit 1350 ms)
2026-11-07T12:45:03Z [load_day 2026-04-20] 2026-04-20 hour 2: 153486 events in 4 files, snapshot 3017477238025692032 (task 5937 ms: download 1701 ms overlapping gunzip 354 ms, parse 1177 ms, sort 148 ms, write 2784 ms, index 616 ms: 11 candidates, 87355 repo-hours, 568 releases; waiting 535 ms; commit 1367 ms)
2026-11-07T12:45:05Z [load_day 2026-04-20] 2026-04-20 hour 3: 153972 events in 4 files, snapshot 6458103678609978611 (task 5983 ms: download 2135 ms overlapping gunzip 361 ms, parse 1217 ms, sort 153 ms, write 2769 ms, index 558 ms: 5 candidates, 80433 repo-hours, 581 releases; waiting 633 ms; commit 1398 ms)
2026-11-07T12:45:10Z [load_day 2026-04-20] 2026-04-20 hour 4: 146353 events in 3 files, snapshot 3147397747669331278 (task 5704 ms: download 2091 ms overlapping gunzip 416 ms, parse 1328 ms, sort 142 ms, write 2558 ms, index 456 ms: 7 candidates, 69523 repo-hours, 684 releases; waiting 579 ms; commit 1232 ms)
2026-11-07T12:45:11Z [load_day 2026-04-20] 2026-04-20 hour 5: 153220 events in 4 files, snapshot 2179211585276941150 (task 5719 ms: download 2062 ms overlapping gunzip 361 ms, parse 1172 ms, sort 132 ms, write 2548 ms, index 548 ms: 11 candidates, 78526 repo-hours, 648 releases; waiting 672 ms; commit 1117 ms)
2026-11-07T12:45:16Z [load_day 2026-04-20] 2026-04-20 hour 6: 149466 events in 3 files, snapshot 4247884637212143712 (task 5667 ms: download 1771 ms overlapping gunzip 410 ms, parse 1323 ms, sort 143 ms, write 2318 ms, index 569 ms: 10 candidates, 79563 repo-hours, 553 releases; waiting 585 ms; commit 1213 ms)
2026-11-07T12:45:17Z [load_day 2026-04-20] 2026-04-20 hour 7: 150962 events in 4 files, snapshot 8774165806879106923 (task 5389 ms: download 1665 ms overlapping gunzip 324 ms, parse 1030 ms, sort 143 ms, write 2431 ms, index 544 ms: 12 candidates, 84421 repo-hours, 483 releases; waiting 591 ms; commit 1209 ms)
2026-11-07T12:45:23Z [load_day 2026-04-20] 2026-04-20 hour 8: 147717 events in 3 files, snapshot 6347876548561509062 (task 5548 ms: download 1790 ms overlapping gunzip 301 ms, parse 986 ms, sort 135 ms, write 2696 ms, index 560 ms: 4 candidates, 83397 repo-hours, 421 releases; waiting 567 ms; commit 1336 ms)
2026-11-07T12:45:24Z [load_day 2026-04-20] 2026-04-20 hour 9: 150107 events in 4 files, snapshot 9107975937117582092 (task 5763 ms: download 1714 ms overlapping gunzip 302 ms, parse 1025 ms, sort 139 ms, write 2864 ms, index 545 ms: 7 candidates, 84014 repo-hours, 436 releases; waiting 545 ms; commit 1362 ms)
2026-11-07T12:45:28Z [load_day 2026-04-20] 2026-04-20 hour 10: 148884 events in 3 files, snapshot 7669062467331772007 (task 5250 ms: download 1831 ms overlapping gunzip 316 ms, parse 1039 ms, sort 125 ms, write 2277 ms, index 562 ms: 5 candidates, 83245 repo-hours, 524 releases; waiting 603 ms; commit 1259 ms)
2026-11-07T12:45:30Z [load_day 2026-04-20] 2026-04-20 hour 11: 148412 events in 3 files, snapshot 4691230306913226390 (task 4765 ms: download 1866 ms overlapping gunzip 283 ms, parse 966 ms, sort 121 ms, write 1920 ms, index 576 ms: 3 candidates, 84462 repo-hours, 583 releases; waiting 534 ms; commit 1316 ms)
2026-11-07T12:45:34Z [load_day 2026-04-20] 2026-04-20 hour 12: 150976 events in 4 files, snapshot 3413961598363564794 (task 4543 ms: download 1613 ms overlapping gunzip 264 ms, parse 952 ms, sort 123 ms, write 1707 ms, index 595 ms: 3 candidates, 85702 repo-hours, 467 releases; waiting 582 ms; commit 1259 ms)
2026-11-07T12:45:35Z [load_day 2026-04-20] 2026-04-20 hour 13: 156023 events in 4 files, snapshot 4880973264166130791 (task 4316 ms: download 1490 ms overlapping gunzip 207 ms, parse 776 ms, sort 108 ms, write 1706 ms, index 644 ms: 5 candidates, 97979 repo-hours, 144 releases; waiting 553 ms; commit 1176 ms)
2026-11-07T12:45:39Z [load_day 2026-04-20] 2026-04-20 hour 14: 152190 events in 4 files, snapshot 4194145275129772502 (task 4357 ms: download 1613 ms overlapping gunzip 218 ms, parse 789 ms, sort 115 ms, write 1602 ms, index 678 ms: 14 candidates, 89039 repo-hours, 141 releases; waiting 525 ms; commit 1223 ms)
2026-11-07T12:45:40Z [load_day 2026-04-20] 2026-04-20 hour 15: 154723 events in 4 files, snapshot 1578892154602030285 (task 4222 ms: download 1566 ms overlapping gunzip 232 ms, parse 816 ms, sort 114 ms, write 1589 ms, index 572 ms: 6 candidates, 86535 repo-hours, 143 releases; waiting 579 ms; commit 1249 ms)
2026-11-07T12:45:44Z [load_day 2026-04-20] 2026-04-20 hour 16: 154498 events in 4 files, snapshot 8182920104584837648 (task 4426 ms: download 1467 ms overlapping gunzip 255 ms, parse 883 ms, sort 110 ms, write 1684 ms, index 640 ms: 2 candidates, 88611 repo-hours, 126 releases; waiting 542 ms; commit 1317 ms)
2026-11-07T12:45:45Z [load_day 2026-04-20] 2026-04-20 hour 17: 156578 events in 4 files, snapshot 945148354914286231 (task 4377 ms: download 1429 ms overlapping gunzip 244 ms, parse 848 ms, sort 133 ms, write 1629 ms, index 625 ms: 8 candidates, 89154 repo-hours, 158 releases; waiting 531 ms; commit 1214 ms)
2026-11-07T12:45:49Z [load_day 2026-04-20] 2026-04-20 hour 18: 154449 events in 4 files, snapshot 8487027498820027821 (task 4502 ms: download 1631 ms overlapping gunzip 253 ms, parse 876 ms, sort 107 ms, write 1687 ms, index 659 ms: 10 candidates, 87389 repo-hours, 181 releases; waiting 584 ms; commit 1408 ms)
2026-11-07T12:45:51Z [load_day 2026-04-20] 2026-04-20 hour 19: 152086 events in 4 files, snapshot 1632721178703102102 (task 4427 ms: download 1611 ms overlapping gunzip 254 ms, parse 867 ms, sort 120 ms, write 1732 ms, index 592 ms: 4 candidates, 85365 repo-hours, 168 releases; waiting 547 ms; commit 1170 ms)
2026-11-07T12:45:55Z [load_day 2026-04-20] 2026-04-20 hour 20: 154857 events in 4 files, snapshot 7656080819460591790 (task 4583 ms: download 1444 ms overlapping gunzip 258 ms, parse 873 ms, sort 113 ms, write 1830 ms, index 613 ms: 12 candidates, 84266 repo-hours, 227 releases; waiting 538 ms; commit 1157 ms)
2026-11-07T12:45:57Z [load_day 2026-04-20] 2026-04-20 hour 21: 145970 events in 3 files, snapshot 3993083573872837863 (task 5120 ms: download 1822 ms overlapping gunzip 334 ms, parse 1128 ms, sort 116 ms, write 2075 ms, index 559 ms: 9 candidates, 75325 repo-hours, 545 releases; waiting 601 ms; commit 1433 ms)
2026-11-07T12:46:01Z [load_day 2026-04-20] 2026-04-20 hour 22: 148054 events in 3 files, snapshot 6804558977304074777 (task 5266 ms: download 1687 ms overlapping gunzip 331 ms, parse 1096 ms, sort 142 ms, write 2379 ms, index 529 ms: 7 candidates, 74031 repo-hours, 634 releases; waiting 529 ms; commit 1293 ms)
2026-11-07T12:46:02Z [load_day 2026-04-20] 2026-04-20 hour 23: 142665 events in 3 files, snapshot 6228607226478522712 (task 5271 ms: download 1798 ms overlapping gunzip 347 ms, parse 1143 ms, sort 132 ms, write 2258 ms, index 509 ms: 5 candidates, 71437 repo-hours, 827 releases; waiting 550 ms; commit 1132 ms)
2026-11-07T12:46:10Z [load_day 2026-04-20] 2026-04-20: repo_hour merged from 24 files to 1 (1978815 rows, 8108 ms)
2026-11-07T12:46:12Z [load_day 2026-04-20] 2026-04-20: index committed in 9980 ms (24 + 1 + 24 files)
2026-11-07T12:46:12Z [load_day 2026-04-20] 2026-04-20: 3619458 events in 24 hours
2026-11-07T12:46:12Z [load_day 2026-04-20] attempt 1 succeeded