orcaLog in

Runs · run 209

load_day 2026-09-09, attempt 1 succeeded

Host
4e84322b8c45:35949
Started
2026-11-07T04:09:59Z
Ended
2026-11-07T04:10:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/209/load_day/2026-09-09/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:09:59Z [load_day 2026-09-09] attempt 1 started
2026-11-07T04:10:05Z [load_day 2026-09-09] 2026-09-09 hour 0: 31903 events in 1 files, snapshot 6693880952075226995 (task 3184 ms: download 1121 ms overlapping gunzip 167 ms, parse 541 ms, sort 50 ms, write 1493 ms, index 119 ms: 3 candidates, 16368 repo-hours, 330 releases; waiting 491 ms; commit 583 ms)
2026-11-07T04:10:06Z [load_day 2026-09-09] 2026-09-09 hour 1: 54974 events in 2 files, snapshot 5096596089561276401 (task 3452 ms: download 1112 ms overlapping gunzip 162 ms, parse 542 ms, sort 65 ms, write 1699 ms, index 151 ms: 2 candidates, 21167 repo-hours, 389 releases; waiting 539 ms; commit 626 ms)
2026-11-07T04:10:10Z [load_day 2026-09-09] 2026-09-09 hour 2: 71223 events in 2 files, snapshot 6309733497060214799 (task 3797 ms: download 1616 ms overlapping gunzip 207 ms, parse 634 ms, sort 80 ms, write 1550 ms, index 173 ms: 6 candidates, 26808 repo-hours, 493 releases; waiting 802 ms; commit 636 ms)
2026-11-07T04:10:10Z [load_day 2026-09-09] 2026-09-09 hour 3: 85308 events in 2 files, snapshot 971359414030309960 (task 3928 ms: download 1585 ms overlapping gunzip 271 ms, parse 864 ms, sort 79 ms, write 1619 ms, index 170 ms: 5 candidates, 27778 repo-hours, 384 releases; waiting 632 ms; commit 529 ms)
2026-11-07T04:10:15Z [load_day 2026-09-09] 2026-09-09 hour 4: 93319 events in 2 files, snapshot 6201570683047328543 (task 3564 ms: download 1415 ms overlapping gunzip 209 ms, parse 669 ms, sort 81 ms, write 1597 ms, index 168 ms: 5 candidates, 25180 repo-hours, 357 releases; waiting 563 ms; commit 1687 ms)
2026-11-07T04:10:15Z [load_day 2026-09-09] 2026-09-09 hour 5: 94631 events in 2 files, snapshot 1821910857981237200 (task 3595 ms: download 1474 ms overlapping gunzip 206 ms, parse 644 ms, sort 73 ms, write 1527 ms, index 155 ms: 6 candidates, 23401 repo-hours, 275 releases; waiting 713 ms; commit 590 ms)
2026-11-07T04:10:18Z [load_day 2026-09-09] 2026-09-09 hour 6: 96939 events in 2 files, snapshot 2891246134433405099 (task 3338 ms: download 1639 ms overlapping gunzip 196 ms, parse 622 ms, sort 82 ms, write 1296 ms, index 189 ms: 4 candidates, 23992 repo-hours, 226 releases; waiting 573 ms; commit 935 ms)
2026-11-07T04:10:20Z [load_day 2026-09-09] 2026-09-09 hour 7: 94981 events in 2 files, snapshot 7988976441198664662 (task 3353 ms: download 1356 ms overlapping gunzip 184 ms, parse 573 ms, sort 70 ms, write 1259 ms, index 161 ms: 5 candidates, 24271 repo-hours, 246 releases; waiting 590 ms; commit 791 ms)
2026-11-07T04:10:22Z [load_day 2026-09-09] 2026-09-09 hour 8: 92423 events in 2 files, snapshot 5341730834945601712 (task 3329 ms: download 1140 ms overlapping gunzip 195 ms, parse 626 ms, sort 81 ms, write 1387 ms, index 224 ms: 0 candidates, 25536 repo-hours, 261 releases; waiting 538 ms; commit 873 ms)
2026-11-07T04:10:23Z [load_day 2026-09-09] 2026-09-09 hour 9: 84391 events in 2 files, snapshot 2990331386209079847 (task 3184 ms: download 1376 ms overlapping gunzip 180 ms, parse 553 ms, sort 59 ms, write 1335 ms, index 154 ms: 1 candidates, 22251 repo-hours, 278 releases; waiting 562 ms; commit 837 ms)
2026-11-07T04:10:25Z [load_day 2026-09-09] 2026-09-09 hour 10: 65528 events in 2 files, snapshot 6608573737195727928 (task 3067 ms: download 1198 ms overlapping gunzip 163 ms, parse 500 ms, sort 48 ms, write 1276 ms, index 128 ms: 3 candidates, 19711 repo-hours, 270 releases; waiting 627 ms; commit 852 ms)
2026-11-07T04:10:27Z [load_day 2026-09-09] 2026-09-09 hour 11: 65030 events in 2 files, snapshot 5643781862372242711 (task 2735 ms: download 1140 ms overlapping gunzip 149 ms, parse 469 ms, sort 56 ms, write 973 ms, index 127 ms: 3 candidates, 18433 repo-hours, 167 releases; waiting 559 ms; commit 617 ms)
2026-11-07T04:10:29Z [load_day 2026-09-09] 2026-09-09 hour 12: 48611 events in 1 files, snapshot 4028488500741727428 (task 2523 ms: download 982 ms overlapping gunzip 124 ms, parse 396 ms, sort 35 ms, write 895 ms, index 156 ms: 0 candidates, 17532 repo-hours, 192 releases; waiting 579 ms; commit 699 ms)
2026-11-07T04:10:30Z [load_day 2026-09-09] 2026-09-09 hour 13: 31935 events in 1 files, snapshot 2189504702795075249 (task 2245 ms: download 908 ms overlapping gunzip 110 ms, parse 383 ms, sort 25 ms, write 752 ms, index 127 ms: 3 candidates, 14870 repo-hours, 214 releases; waiting 545 ms; commit 760 ms)
2026-11-07T04:10:31Z [load_day 2026-09-09] 2026-09-09 hour 14: 11371 events in 1 files, snapshot 1470749677053479684 (task 2085 ms: download 858 ms overlapping gunzip 82 ms, parse 231 ms, sort 11 ms, write 654 ms, index 71 ms: 0 candidates, 9199 repo-hours, 205 releases; waiting 594 ms; commit 769 ms)
2026-11-07T04:10:32Z [load_day 2026-09-09] 2026-09-09 hour 15: 7414 events in 1 files, snapshot 464917767584883691 (task 1929 ms: download 819 ms overlapping gunzip 78 ms, parse 221 ms, sort 9 ms, write 673 ms, index 74 ms: 0 candidates, 6325 repo-hours, 237 releases; waiting 563 ms; commit 625 ms)
2026-11-07T04:10:34Z [load_day 2026-09-09] 2026-09-09 hour 16: 8408 events in 1 files, snapshot 4814357167270754048 (task 2029 ms: download 853 ms overlapping gunzip 88 ms, parse 249 ms, sort 9 ms, write 714 ms, index 89 ms: 0 candidates, 7074 repo-hours, 291 releases; waiting 556 ms; commit 786 ms)
2026-11-07T04:10:35Z [load_day 2026-09-09] 2026-09-09 hour 17: 9993 events in 1 files, snapshot 2025486591094152665 (task 2026 ms: download 816 ms overlapping gunzip 95 ms, parse 273 ms, sort 12 ms, write 794 ms, index 73 ms: 1 candidates, 8000 repo-hours, 290 releases; waiting 476 ms; commit 785 ms)
2026-11-07T04:10:37Z [load_day 2026-09-09] 2026-09-09 hour 18: 11337 events in 1 files, snapshot 479689328603984069 (task 2436 ms: download 1039 ms overlapping gunzip 120 ms, parse 355 ms, sort 33 ms, write 988 ms, index 79 ms: 1 candidates, 8872 repo-hours, 366 releases; waiting 589 ms; commit 894 ms)
2026-11-07T04:10:39Z [load_day 2026-09-09] 2026-09-09 hour 19: 11618 events in 1 files, snapshot 4696858253674339861 (task 3277 ms: download 1395 ms overlapping gunzip 131 ms, parse 369 ms, sort 16 ms, write 1074 ms, index 70 ms: 0 candidates, 8915 repo-hours, 314 releases; waiting 950 ms; commit 713 ms)
2026-11-07T04:10:41Z [load_day 2026-09-09] 2026-09-09 hour 20: 12382 events in 1 files, snapshot 3513298354460554093 (task 3019 ms: download 1394 ms overlapping gunzip 133 ms, parse 400 ms, sort 38 ms, write 1068 ms, index 80 ms: 1 candidates, 9423 repo-hours, 326 releases; waiting 944 ms; commit 677 ms)
2026-11-07T04:10:42Z [load_day 2026-09-09] 2026-09-09 hour 21: 9888 events in 1 files, snapshot 5263261137457778547 (task 2222 ms: download 945 ms overlapping gunzip 110 ms, parse 294 ms, sort 13 ms, write 843 ms, index 56 ms: 0 candidates, 7638 repo-hours, 240 releases; waiting 576 ms; commit 670 ms)
2026-11-07T04:10:44Z [load_day 2026-09-09] 2026-09-09 hour 22: 9429 events in 1 files, snapshot 7281469497486465664 (task 2215 ms: download 1034 ms overlapping gunzip 105 ms, parse 298 ms, sort 11 ms, write 780 ms, index 56 ms: 0 candidates, 7291 repo-hours, 232 releases; waiting 667 ms; commit 861 ms)
2026-11-07T04:10:45Z [load_day 2026-09-09] 2026-09-09 hour 23: 11517 events in 1 files, snapshot 2216042165478695885 (task 2738 ms: download 1110 ms overlapping gunzip 143 ms, parse 413 ms, sort 39 ms, write 1093 ms, index 79 ms: 1 candidates, 8407 repo-hours, 336 releases; waiting 658 ms; commit 773 ms)
2026-11-07T04:10:47Z [load_day 2026-09-09] 2026-09-09: repo_hour merged from 24 files to 1 (388442 rows, 2293 ms)
2026-11-07T04:10:49Z [load_day 2026-09-09] 2026-09-09: index committed in 3910 ms (16 + 1 + 24 files)
2026-11-07T04:10:49Z [load_day 2026-09-09] 2026-09-09: 1114553 events in 24 hours
2026-11-07T04:10:49Z [load_day 2026-09-09] attempt 1 succeeded