orcaLog in

Runs · run 191

load_day 2026-09-15, attempt 1 succeeded

Host
4e84322b8c45:32937
Started
2026-11-07T04:01:02Z
Ended
2026-11-07T04:02:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/191/load_day/2026-09-15/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:01:02Z [load_day 2026-09-15] attempt 1 started
2026-11-07T04:01:11Z [load_day 2026-09-15] 2026-09-15 hour 0: 68874 events in 2 files, snapshot 4055392611052112665 (task 6570 ms: download 1690 ms overlapping gunzip 371 ms, parse 1178 ms, sort 120 ms, write 3437 ms, index 258 ms: 7 candidates, 37855 repo-hours, 906 releases; waiting 555 ms; commit 786 ms)
2026-11-07T04:01:12Z [load_day 2026-09-15] 2026-09-15 hour 1: 79885 events in 2 files, snapshot 6909997174355819741 (task 6754 ms: download 2469 ms overlapping gunzip 425 ms, parse 1293 ms, sort 138 ms, write 3595 ms, index 249 ms: 5 candidates, 38907 repo-hours, 929 releases; waiting 732 ms; commit 583 ms)
2026-11-07T04:01:18Z [load_day 2026-09-15] 2026-09-15 hour 2: 83932 events in 2 files, snapshot 1359040889683185229 (task 6148 ms: download 2448 ms overlapping gunzip 372 ms, parse 1052 ms, sort 77 ms, write 3149 ms, index 272 ms: 6 candidates, 41575 repo-hours, 948 releases; waiting 868 ms; commit 575 ms)
2026-11-07T04:01:18Z [load_day 2026-09-15] 2026-09-15 hour 3: 88750 events in 2 files, snapshot 7268248996852992516 (task 5157 ms: download 2057 ms overlapping gunzip 314 ms, parse 890 ms, sort 77 ms, write 2569 ms, index 293 ms: 4 candidates, 36404 repo-hours, 526 releases; waiting 717 ms; commit 650 ms)
2026-11-07T04:01:23Z [load_day 2026-09-15] 2026-09-15 hour 4: 90434 events in 2 files, snapshot 6400052681027740050 (task 4185 ms: download 1831 ms overlapping gunzip 302 ms, parse 868 ms, sort 74 ms, write 1847 ms, index 225 ms: 3 candidates, 33461 repo-hours, 447 releases; waiting 543 ms; commit 793 ms)
2026-11-07T04:01:24Z [load_day 2026-09-15] 2026-09-15 hour 5: 86853 events in 2 files, snapshot 6386321162727448923 (task 4403 ms: download 1920 ms overlapping gunzip 309 ms, parse 900 ms, sort 105 ms, write 1984 ms, index 202 ms: 3 candidates, 30818 repo-hours, 446 releases; waiting 596 ms; commit 1023 ms)
2026-11-07T04:01:28Z [load_day 2026-09-15] 2026-09-15 hour 6: 83544 events in 2 files, snapshot 5448230632006680083 (task 4265 ms: download 1623 ms overlapping gunzip 258 ms, parse 745 ms, sort 67 ms, write 2085 ms, index 234 ms: 2 candidates, 31912 repo-hours, 436 releases; waiting 662 ms; commit 862 ms)
2026-11-07T04:01:28Z [load_day 2026-09-15] 2026-09-15 hour 7: 84762 events in 2 files, snapshot 192656476596851484 (task 3202 ms: download 501 ms overlapping gunzip 273 ms, parse 853 ms, sort 68 ms, write 1605 ms, index 204 ms: 2 candidates, 28676 repo-hours, 384 releases; waiting 16 ms; commit 756 ms)
2026-11-07T04:01:32Z [load_day 2026-09-15] 2026-09-15 hour 8: 80300 events in 2 files, snapshot 9045055680168025841 (task 3986 ms: download 1833 ms overlapping gunzip 248 ms, parse 724 ms, sort 78 ms, write 1851 ms, index 202 ms: 2 candidates, 27956 repo-hours, 450 releases; waiting 558 ms; commit 817 ms)
2026-11-07T04:01:33Z [load_day 2026-09-15] 2026-09-15 hour 9: 70456 events in 2 files, snapshot 8931019314056954818 (task 3845 ms: download 1423 ms overlapping gunzip 271 ms, parse 825 ms, sort 82 ms, write 1664 ms, index 179 ms: 1 candidates, 26789 repo-hours, 482 releases; waiting 549 ms; commit 749 ms)
2026-11-07T04:01:37Z [load_day 2026-09-15] 2026-09-15 hour 10: 61235 events in 2 files, snapshot 5242537387096995564 (task 4156 ms: download 1576 ms overlapping gunzip 241 ms, parse 725 ms, sort 107 ms, write 1800 ms, index 189 ms: 3 candidates, 25050 repo-hours, 505 releases; waiting 738 ms; commit 691 ms)
2026-11-07T04:01:38Z [load_day 2026-09-15] 2026-09-15 hour 11: 55729 events in 2 files, snapshot 7583162538838550459 (task 3447 ms: download 1396 ms overlapping gunzip 229 ms, parse 676 ms, sort 71 ms, write 1452 ms, index 165 ms: 4 candidates, 24069 repo-hours, 354 releases; waiting 550 ms; commit 678 ms)
2026-11-07T04:01:42Z [load_day 2026-09-15] 2026-09-15 hour 12: 55822 events in 2 files, snapshot 7570566928441361685 (task 3838 ms: download 1308 ms overlapping gunzip 220 ms, parse 660 ms, sort 83 ms, write 1815 ms, index 172 ms: 7 candidates, 25402 repo-hours, 498 releases; waiting 615 ms; commit 893 ms)
2026-11-07T04:01:43Z [load_day 2026-09-15] 2026-09-15 hour 13: 61865 events in 2 files, snapshot 8847120327876964447 (task 5023 ms: download 1716 ms overlapping gunzip 351 ms, parse 1076 ms, sort 105 ms, write 2358 ms, index 214 ms: 3 candidates, 33895 repo-hours, 975 releases; waiting 582 ms; commit 879 ms)
2026-11-07T04:01:50Z [load_day 2026-09-15] 2026-09-15 hour 14: 80422 events in 2 files, snapshot 7256216283197696533 (task 8147 ms: download 3394 ms overlapping gunzip 593 ms, parse 1737 ms, sort 167 ms, write 3949 ms, index 274 ms: 3 candidates, 45492 repo-hours, 1631 releases; waiting 1084 ms; commit 762 ms)
2026-11-07T04:01:52Z [load_day 2026-09-15] 2026-09-15 hour 15: 81142 events in 2 files, snapshot 4540942540054498600 (task 8143 ms: download 3384 ms overlapping gunzip 612 ms, parse 1932 ms, sort 164 ms, write 3861 ms, index 319 ms: 6 candidates, 45519 repo-hours, 1583 releases; waiting 923 ms; commit 855 ms)
2026-11-07T04:01:58Z [load_day 2026-09-15] 2026-09-15 hour 16: 75454 events in 2 files, snapshot 3158240739493670932 (task 7550 ms: download 2366 ms overlapping gunzip 524 ms, parse 1544 ms, sort 208 ms, write 4072 ms, index 335 ms: 7 candidates, 44331 repo-hours, 1626 releases; waiting 593 ms; commit 627 ms)
2026-11-07T04:02:02Z [load_day 2026-09-15] 2026-09-15 hour 17: 80898 events in 2 files, snapshot 3890326480348003531 (task 9012 ms: download 3040 ms overlapping gunzip 630 ms, parse 1825 ms, sort 165 ms, write 4984 ms, index 310 ms: 3 candidates, 47090 repo-hours, 1777 releases; waiting 768 ms; commit 867 ms)
2026-11-07T04:02:07Z [load_day 2026-09-15] 2026-09-15 hour 18: 76950 events in 2 files, snapshot 1647500758772188127 (task 7992 ms: download 2288 ms overlapping gunzip 564 ms, parse 1678 ms, sort 200 ms, write 4455 ms, index 276 ms: 1 candidates, 44577 repo-hours, 1668 releases; waiting 584 ms; commit 611 ms)
2026-11-07T04:02:09Z [load_day 2026-09-15] 2026-09-15 hour 19: 72601 events in 2 files, snapshot 4827635547295646803 (task 7120 ms: download 1675 ms overlapping gunzip 496 ms, parse 1482 ms, sort 177 ms, write 4177 ms, index 300 ms: 5 candidates, 42197 repo-hours, 1586 releases; waiting 206 ms; commit 851 ms)
2026-11-07T04:02:15Z [load_day 2026-09-15] 2026-09-15 hour 20: 72402 events in 2 files, snapshot 2159512110253352374 (task 7811 ms: download 2773 ms overlapping gunzip 567 ms, parse 1642 ms, sort 179 ms, write 3894 ms, index 282 ms: 7 candidates, 41868 repo-hours, 1499 releases; waiting 918 ms; commit 970 ms)
2026-11-07T04:02:18Z [load_day 2026-09-15] 2026-09-15 hour 21: 71367 events in 2 files, snapshot 3318703567210892648 (task 7707 ms: download 2273 ms overlapping gunzip 600 ms, parse 1761 ms, sort 196 ms, write 4083 ms, index 274 ms: 2 candidates, 39455 repo-hours, 1634 releases; waiting 562 ms; commit 918 ms)
2026-11-07T04:02:23Z [load_day 2026-09-15] 2026-09-15 hour 22: 63925 events in 2 files, snapshot 7602764338181938175 (task 7091 ms: download 2473 ms overlapping gunzip 491 ms, parse 1471 ms, sort 149 ms, write 3548 ms, index 259 ms: 4 candidates, 35553 repo-hours, 1331 releases; waiting 856 ms; commit 894 ms)
2026-11-07T04:02:24Z [load_day 2026-09-15] 2026-09-15 hour 23: 62267 events in 2 files, snapshot 5114583316118628043 (task 6435 ms: download 2306 ms overlapping gunzip 543 ms, parse 1582 ms, sort 138 ms, write 3084 ms, index 224 ms: 6 candidates, 33588 repo-hours, 1298 releases; waiting 549 ms; commit 737 ms)
2026-11-07T04:02:29Z [load_day 2026-09-15] 2026-09-15: repo_hour merged from 24 files to 1 (862439 rows, 4141 ms)
2026-11-07T04:02:30Z [load_day 2026-09-15] 2026-09-15: index committed in 5885 ms (24 + 1 + 24 files)
2026-11-07T04:02:30Z [load_day 2026-09-15] 2026-09-15: 1789869 events in 24 hours
2026-11-07T04:02:30Z [load_day 2026-09-15] attempt 1 succeeded