orcaLog in

Runs · run 176

load_day 2026-09-20, attempt 1 succeeded

Host
4e84322b8c45:30115
Started
2026-11-07T03:55:35Z
Ended
2026-11-07T03:56:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/176/load_day/2026-09-20/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:55:35Z [load_day 2026-09-20] attempt 1 started
2026-11-07T03:55:41Z [load_day 2026-09-20] 2026-09-20 hour 0: 106182 events in 3 files, snapshot 4490672523930997745 (task 2914 ms: download 891 ms overlapping gunzip 165 ms, parse 612 ms, sort 91 ms, write 1266 ms, index 301 ms: 15 candidates, 42449 repo-hours, 90 releases; waiting 236 ms; commit 806 ms)
2026-11-07T03:55:42Z [load_day 2026-09-20] 2026-09-20 hour 1: 111844 events in 3 files, snapshot 1001084093711211224 (task 3204 ms: download 1432 ms overlapping gunzip 167 ms, parse 618 ms, sort 101 ms, write 1206 ms, index 291 ms: 12 candidates, 44944 repo-hours, 101 releases; waiting 504 ms; commit 551 ms)
2026-11-07T03:55:45Z [load_day 2026-09-20] 2026-09-20 hour 2: 113497 events in 3 files, snapshot 4822830421611066680 (task 3114 ms: download 1255 ms overlapping gunzip 164 ms, parse 583 ms, sort 74 ms, write 1315 ms, index 300 ms: 7 candidates, 49329 repo-hours, 90 releases; waiting 357 ms; commit 856 ms)
2026-11-07T03:55:45Z [load_day 2026-09-20] 2026-09-20 hour 3: 109131 events in 3 files, snapshot 931702025257115438 (task 3004 ms: download 1163 ms overlapping gunzip 153 ms, parse 558 ms, sort 73 ms, write 1117 ms, index 307 ms: 11 candidates, 49153 repo-hours, 69 releases; waiting 535 ms; commit 774 ms)
2026-11-07T03:55:48Z [load_day 2026-09-20] 2026-09-20 hour 4: 111185 events in 3 files, snapshot 5922866108217353243 (task 3098 ms: download 1019 ms overlapping gunzip 157 ms, parse 588 ms, sort 83 ms, write 1161 ms, index 328 ms: 6 candidates, 47801 repo-hours, 44 releases; waiting 531 ms; commit 768 ms)
2026-11-07T03:55:49Z [load_day 2026-09-20] 2026-09-20 hour 5: 107951 events in 3 files, snapshot 625872351700477097 (task 2953 ms: download 979 ms overlapping gunzip 150 ms, parse 520 ms, sort 71 ms, write 1233 ms, index 293 ms: 7 candidates, 45319 repo-hours, 66 releases; waiting 377 ms; commit 814 ms)
2026-11-07T03:55:52Z [load_day 2026-09-20] 2026-09-20 hour 6: 105714 events in 3 files, snapshot 3213380753101453160 (task 2974 ms: download 1206 ms overlapping gunzip 156 ms, parse 560 ms, sort 80 ms, write 1082 ms, index 296 ms: 6 candidates, 43810 repo-hours, 86 releases; waiting 535 ms; commit 681 ms)
2026-11-07T03:55:53Z [load_day 2026-09-20] 2026-09-20 hour 7: 107433 events in 3 files, snapshot 3224741065617961971 (task 2985 ms: download 1066 ms overlapping gunzip 152 ms, parse 527 ms, sort 74 ms, write 1178 ms, index 285 ms: 6 candidates, 44477 repo-hours, 72 releases; waiting 547 ms; commit 720 ms)
2026-11-07T03:55:55Z [load_day 2026-09-20] 2026-09-20 hour 8: 107857 events in 3 files, snapshot 4263243564819072076 (task 2994 ms: download 1152 ms overlapping gunzip 155 ms, parse 541 ms, sort 75 ms, write 1105 ms, index 312 ms: 7 candidates, 45417 repo-hours, 90 releases; waiting 540 ms; commit 709 ms)
2026-11-07T03:55:56Z [load_day 2026-09-20] 2026-09-20 hour 9: 113074 events in 3 files, snapshot 2278081790723774286 (task 3246 ms: download 1084 ms overlapping gunzip 195 ms, parse 669 ms, sort 85 ms, write 1146 ms, index 309 ms: 5 candidates, 48771 repo-hours, 116 releases; waiting 529 ms; commit 753 ms)
2026-11-07T03:55:59Z [load_day 2026-09-20] 2026-09-20 hour 10: 112967 events in 3 files, snapshot 3747057699626631675 (task 3221 ms: download 1120 ms overlapping gunzip 161 ms, parse 589 ms, sort 80 ms, write 1233 ms, index 366 ms: 7 candidates, 47035 repo-hours, 68 releases; waiting 532 ms; commit 860 ms)
2026-11-07T03:56:00Z [load_day 2026-09-20] 2026-09-20 hour 11: 114063 events in 3 files, snapshot 4967882101800958211 (task 3025 ms: download 1035 ms overlapping gunzip 162 ms, parse 571 ms, sort 77 ms, write 1115 ms, index 276 ms: 11 candidates, 46491 repo-hours, 74 releases; waiting 515 ms; commit 736 ms)
2026-11-07T03:56:03Z [load_day 2026-09-20] 2026-09-20 hour 12: 115998 events in 3 files, snapshot 4500943390851815021 (task 3399 ms: download 1057 ms overlapping gunzip 184 ms, parse 669 ms, sort 128 ms, write 1255 ms, index 321 ms: 9 candidates, 50766 repo-hours, 89 releases; waiting 570 ms; commit 696 ms)
2026-11-07T03:56:04Z [load_day 2026-09-20] 2026-09-20 hour 13: 131166 events in 3 files, snapshot 2800777070297602602 (task 3316 ms: download 1158 ms overlapping gunzip 177 ms, parse 629 ms, sort 86 ms, write 1302 ms, index 330 ms: 9 candidates, 53261 repo-hours, 72 releases; waiting 539 ms; commit 746 ms)
2026-11-07T03:56:07Z [load_day 2026-09-20] 2026-09-20 hour 14: 134784 events in 3 files, snapshot 2661312434750196386 (task 3558 ms: download 1202 ms overlapping gunzip 200 ms, parse 742 ms, sort 101 ms, write 1379 ms, index 357 ms: 4 candidates, 56981 repo-hours, 101 releases; waiting 524 ms; commit 675 ms)
2026-11-07T03:56:08Z [load_day 2026-09-20] 2026-09-20 hour 15: 129787 events in 3 files, snapshot 5932783279535469479 (task 3459 ms: download 1104 ms overlapping gunzip 182 ms, parse 649 ms, sort 88 ms, write 1416 ms, index 364 ms: 11 candidates, 60399 repo-hours, 78 releases; waiting 554 ms; commit 737 ms)
2026-11-07T03:56:11Z [load_day 2026-09-20] 2026-09-20 hour 16: 125253 events in 3 files, snapshot 8539532559973418859 (task 3351 ms: download 1234 ms overlapping gunzip 179 ms, parse 609 ms, sort 78 ms, write 1281 ms, index 348 ms: 11 candidates, 52425 repo-hours, 63 releases; waiting 542 ms; commit 731 ms)
2026-11-07T03:56:12Z [load_day 2026-09-20] 2026-09-20 hour 17: 132414 events in 3 files, snapshot 7409280165200896163 (task 3463 ms: download 1157 ms overlapping gunzip 180 ms, parse 652 ms, sort 88 ms, write 1375 ms, index 356 ms: 13 candidates, 55108 repo-hours, 93 releases; waiting 537 ms; commit 639 ms)
2026-11-07T03:56:15Z [load_day 2026-09-20] 2026-09-20 hour 18: 130787 events in 3 files, snapshot 5752825528523038603 (task 3454 ms: download 1130 ms overlapping gunzip 182 ms, parse 636 ms, sort 87 ms, write 1383 ms, index 339 ms: 11 candidates, 52455 repo-hours, 51 releases; waiting 530 ms; commit 583 ms)
2026-11-07T03:56:16Z [load_day 2026-09-20] 2026-09-20 hour 19: 128816 events in 3 files, snapshot 7475351221615119034 (task 3221 ms: download 1173 ms overlapping gunzip 172 ms, parse 611 ms, sort 80 ms, write 1265 ms, index 313 ms: 8 candidates, 46564 repo-hours, 57 releases; waiting 529 ms; commit 825 ms)
2026-11-07T03:56:19Z [load_day 2026-09-20] 2026-09-20 hour 20: 127933 events in 3 files, snapshot 8962670850895458931 (task 3390 ms: download 1093 ms overlapping gunzip 188 ms, parse 674 ms, sort 97 ms, write 1371 ms, index 338 ms: 9 candidates, 48046 repo-hours, 59 releases; waiting 520 ms; commit 1010 ms)
2026-11-07T03:56:20Z [load_day 2026-09-20] 2026-09-20 hour 21: 128204 events in 3 files, snapshot 6941504847701788842 (task 3145 ms: download 1150 ms overlapping gunzip 171 ms, parse 616 ms, sort 84 ms, write 1237 ms, index 292 ms: 7 candidates, 44913 repo-hours, 49 releases; waiting 531 ms; commit 777 ms)
2026-11-07T03:56:23Z [load_day 2026-09-20] 2026-09-20 hour 22: 126327 events in 3 files, snapshot 8219348117514513463 (task 3419 ms: download 1222 ms overlapping gunzip 178 ms, parse 654 ms, sort 85 ms, write 1325 ms, index 298 ms: 7 candidates, 43600 repo-hours, 62 releases; waiting 564 ms; commit 811 ms)
2026-11-07T03:56:24Z [load_day 2026-09-20] 2026-09-20 hour 23: 123897 events in 3 files, snapshot 4144069179385152776 (task 3263 ms: download 870 ms overlapping gunzip 171 ms, parse 617 ms, sort 83 ms, write 1313 ms, index 318 ms: 7 candidates, 42672 repo-hours, 72 releases; waiting 248 ms; commit 664 ms)
2026-11-07T03:56:29Z [load_day 2026-09-20] 2026-09-20: repo_hour merged from 24 files to 1 (1162186 rows, 4956 ms)
2026-11-07T03:56:30Z [load_day 2026-09-20] 2026-09-20: index committed in 6587 ms (24 + 1 + 24 files)
2026-11-07T03:56:30Z [load_day 2026-09-20] 2026-09-20: 2856264 events in 24 hours
2026-11-07T03:56:30Z [load_day 2026-09-20] attempt 1 succeeded