orcaLog in

Runs · run 164

load_day 2026-09-24, attempt 1 succeeded

Host
4e84322b8c45:28273
Started
2026-11-07T03:51:50Z
Ended
2026-11-07T03:52:53Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/164/load_day/2026-09-24/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:51:50Z [load_day 2026-09-24] attempt 1 started
2026-11-07T03:51:56Z [load_day 2026-09-24] 2026-09-24 hour 0: 69420 events in 2 files, snapshot 8880837411475789061 (task 3029 ms: download 1162 ms overlapping gunzip 155 ms, parse 498 ms, sort 61 ms, write 1177 ms, index 257 ms: 6 candidates, 36665 repo-hours, 403 releases; waiting 597 ms; commit 806 ms)
2026-11-07T03:51:57Z [load_day 2026-09-24] 2026-09-24 hour 1: 76358 events in 2 files, snapshot 7184174782177983082 (task 3115 ms: download 1150 ms overlapping gunzip 157 ms, parse 513 ms, sort 64 ms, write 1266 ms, index 275 ms: 9 candidates, 40916 repo-hours, 424 releases; waiting 519 ms; commit 734 ms)
2026-11-07T03:52:00Z [load_day 2026-09-24] 2026-09-24 hour 2: 80414 events in 2 files, snapshot 4661144155738968647 (task 3344 ms: download 1470 ms overlapping gunzip 169 ms, parse 540 ms, sort 59 ms, write 1082 ms, index 336 ms: 3 candidates, 46338 repo-hours, 419 releases; waiting 667 ms; commit 581 ms)
2026-11-07T03:52:01Z [load_day 2026-09-24] 2026-09-24 hour 3: 82070 events in 2 files, snapshot 1788148944075975185 (task 3020 ms: download 1269 ms overlapping gunzip 191 ms, parse 585 ms, sort 62 ms, write 996 ms, index 292 ms: 3 candidates, 48838 repo-hours, 478 releases; waiting 540 ms; commit 687 ms)
2026-11-07T03:52:04Z [load_day 2026-09-24] 2026-09-24 hour 4: 80865 events in 2 files, snapshot 8638853515536404257 (task 3008 ms: download 1088 ms overlapping gunzip 154 ms, parse 505 ms, sort 58 ms, write 1132 ms, index 326 ms: 1 candidates, 47160 repo-hours, 358 releases; waiting 542 ms; commit 678 ms)
2026-11-07T03:52:04Z [load_day 2026-09-24] 2026-09-24 hour 5: 79393 events in 2 files, snapshot 6661476212897037853 (task 3043 ms: download 1357 ms overlapping gunzip 158 ms, parse 490 ms, sort 70 ms, write 1120 ms, index 282 ms: 3 candidates, 46246 repo-hours, 391 releases; waiting 619 ms; commit 743 ms)
2026-11-07T03:52:07Z [load_day 2026-09-24] 2026-09-24 hour 6: 82438 events in 2 files, snapshot 4417370541223753736 (task 2876 ms: download 1279 ms overlapping gunzip 158 ms, parse 525 ms, sort 52 ms, write 990 ms, index 302 ms: 2 candidates, 46542 repo-hours, 291 releases; waiting 545 ms; commit 683 ms)
2026-11-07T03:52:08Z [load_day 2026-09-24] 2026-09-24 hour 7: 84071 events in 2 files, snapshot 4654888059708373959 (task 2856 ms: download 1074 ms overlapping gunzip 166 ms, parse 545 ms, sort 53 ms, write 995 ms, index 317 ms: 4 candidates, 47781 repo-hours, 384 releases; waiting 526 ms; commit 830 ms)
2026-11-07T03:52:10Z [load_day 2026-09-24] 2026-09-24 hour 8: 82194 events in 2 files, snapshot 4459819223579872247 (task 2864 ms: download 1209 ms overlapping gunzip 141 ms, parse 467 ms, sort 50 ms, write 1054 ms, index 288 ms: 5 candidates, 46466 repo-hours, 189 releases; waiting 544 ms; commit 713 ms)
2026-11-07T03:52:11Z [load_day 2026-09-24] 2026-09-24 hour 9: 75196 events in 2 files, snapshot 3459496828703417552 (task 2873 ms: download 1142 ms overlapping gunzip 153 ms, parse 492 ms, sort 55 ms, write 1057 ms, index 287 ms: 5 candidates, 45914 repo-hours, 186 releases; waiting 562 ms; commit 703 ms)
2026-11-07T03:52:14Z [load_day 2026-09-24] 2026-09-24 hour 10: 66606 events in 2 files, snapshot 997372500232924299 (task 2643 ms: download 933 ms overlapping gunzip 133 ms, parse 422 ms, sort 41 ms, write 978 ms, index 294 ms: 4 candidates, 41181 repo-hours, 153 releases; waiting 469 ms; commit 840 ms)
2026-11-07T03:52:14Z [load_day 2026-09-24] 2026-09-24 hour 11: 61964 events in 2 files, snapshot 6196598940580954954 (task 2604 ms: download 966 ms overlapping gunzip 130 ms, parse 421 ms, sort 40 ms, write 968 ms, index 273 ms: 5 candidates, 40392 repo-hours, 143 releases; waiting 566 ms; commit 577 ms)
2026-11-07T03:52:16Z [load_day 2026-09-24] 2026-09-24 hour 12: 55810 events in 2 files, snapshot 5253634294692715651 (task 2383 ms: download 975 ms overlapping gunzip 116 ms, parse 372 ms, sort 36 ms, write 769 ms, index 268 ms: 6 candidates, 37047 repo-hours, 168 releases; waiting 538 ms; commit 503 ms)
2026-11-07T03:52:18Z [load_day 2026-09-24] 2026-09-24 hour 13: 54405 events in 2 files, snapshot 8095769812822065761 (task 2577 ms: download 900 ms overlapping gunzip 113 ms, parse 369 ms, sort 37 ms, write 686 ms, index 495 ms: 7 candidates, 34761 repo-hours, 103 releases; waiting 551 ms; commit 1615 ms)
2026-11-07T03:52:20Z [load_day 2026-09-24] 2026-09-24 hour 14: 54837 events in 2 files, snapshot 8152467239261009768 (task 2469 ms: download 958 ms overlapping gunzip 125 ms, parse 389 ms, sort 37 ms, write 860 ms, index 236 ms: 6 candidates, 36576 repo-hours, 155 releases; waiting 551 ms; commit 805 ms)
2026-11-07T03:52:22Z [load_day 2026-09-24] 2026-09-24 hour 15: 54080 events in 2 files, snapshot 297035415220702152 (task 2698 ms: download 1159 ms overlapping gunzip 141 ms, parse 447 ms, sort 38 ms, write 866 ms, index 238 ms: 7 candidates, 36272 repo-hours, 199 releases; waiting 662 ms; commit 864 ms)
2026-11-07T03:52:29Z [load_day 2026-09-24] 2026-09-24 hour 16: 54974 events in 2 files, snapshot 1951823545459515363 (task 2571 ms: download 1016 ms overlapping gunzip 122 ms, parse 389 ms, sort 38 ms, write 859 ms, index 294 ms: 2 candidates, 38861 repo-hours, 188 releases; waiting 562 ms; commit 6431 ms)
2026-11-07T03:52:29Z [load_day 2026-09-24] 2026-09-24 hour 17: 50129 events in 2 files, snapshot 4971634843129376196 (task 5624 ms: download 1068 ms overlapping gunzip 118 ms, parse 370 ms, sort 34 ms, write 4035 ms, index 237 ms: 4 candidates, 34215 repo-hours, 138 releases; waiting 629 ms; commit 659 ms)
2026-11-07T03:52:40Z [load_day 2026-09-24] 2026-09-24 hour 18: 44701 events in 1 files, snapshot 142454854170357985 (task 2146 ms: download 859 ms overlapping gunzip 103 ms, parse 342 ms, sort 31 ms, write 656 ms, index 203 ms: 1 candidates, 30989 repo-hours, 147 releases; waiting 519 ms; commit 9037 ms)
2026-11-07T03:52:43Z [load_day 2026-09-24] 2026-09-24 hour 19: 40611 events in 1 files, snapshot 7583707544998719965 (task 2161 ms: download 859 ms overlapping gunzip 94 ms, parse 296 ms, sort 27 ms, write 676 ms, index 181 ms: 5 candidates, 27449 repo-hours, 118 releases; waiting 541 ms; commit 3791 ms)
2026-11-07T03:52:44Z [load_day 2026-09-24] 2026-09-24 hour 20: 38497 events in 1 files, snapshot 2733805130937312589 (task 6195 ms: download 866 ms overlapping gunzip 87 ms, parse 302 ms, sort 27 ms, write 4628 ms, index 349 ms: 5 candidates, 25420 repo-hours, 99 releases; waiting 540 ms; commit 797 ms)
2026-11-07T03:52:45Z [load_day 2026-09-24] 2026-09-24 hour 21: 38203 events in 1 files, snapshot 3685510298220659093 (task 1983 ms: download 915 ms overlapping gunzip 90 ms, parse 292 ms, sort 26 ms, write 625 ms, index 167 ms: 6 candidates, 25435 repo-hours, 103 releases; waiting 560 ms; commit 685 ms)
2026-11-07T03:52:47Z [load_day 2026-09-24] 2026-09-24 hour 22: 36904 events in 1 files, snapshot 5506218046521533360 (task 2071 ms: download 874 ms overlapping gunzip 100 ms, parse 322 ms, sort 26 ms, write 617 ms, index 166 ms: 5 candidates, 24139 repo-hours, 127 releases; waiting 552 ms; commit 626 ms)
2026-11-07T03:52:47Z [load_day 2026-09-24] 2026-09-24 hour 23: 35258 events in 1 files, snapshot 7425350640324946835 (task 1966 ms: download 866 ms overlapping gunzip 93 ms, parse 297 ms, sort 36 ms, write 611 ms, index 158 ms: 3 candidates, 22716 repo-hours, 219 releases; waiting 562 ms; commit 611 ms)
2026-11-07T03:52:52Z [load_day 2026-09-24] 2026-09-24: repo_hour merged from 24 files to 1 (908319 rows, 4234 ms)
2026-11-07T03:52:53Z [load_day 2026-09-24] 2026-09-24: index committed in 5640 ms (24 + 1 + 24 files)
2026-11-07T03:52:53Z [load_day 2026-09-24] 2026-09-24: 1479398 events in 24 hours
2026-11-07T03:52:53Z [load_day 2026-09-24] attempt 1 succeeded