orcaLog in

Runs · run 302

load_day 2026-08-09, attempt 1 succeeded

Host
4e84322b8c45:52705
Started
2026-11-07T04:39:44Z
Ended
2026-11-07T04:40:46Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/302/load_day/2026-08-09/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:39:44Z [load_day 2026-08-09] attempt 1 started
2026-11-07T04:39:51Z [load_day 2026-08-09] 2026-08-09 hour 0: 168473 events in 4 files, snapshot 2427901441008171238 (task 3786 ms: download 1369 ms overlapping gunzip 223 ms, parse 820 ms, sort 122 ms, write 1521 ms, index 352 ms: 6 candidates, 57166 repo-hours, 17 releases; waiting 517 ms; commit 874 ms)
2026-11-07T04:39:52Z [load_day 2026-08-09] 2026-08-09 hour 1: 171371 events in 4 files, snapshot 564217820943541613 (task 4119 ms: download 1244 ms overlapping gunzip 200 ms, parse 811 ms, sort 109 ms, write 1751 ms, index 453 ms: 5 candidates, 71456 repo-hours, 20 releases; waiting 552 ms; commit 888 ms)
2026-11-07T04:39:55Z [load_day 2026-08-09] 2026-08-09 hour 2: 168977 events in 4 files, snapshot 7769729440058286104 (task 3926 ms: download 1437 ms overlapping gunzip 218 ms, parse 839 ms, sort 118 ms, write 1472 ms, index 338 ms: 5 candidates, 53238 repo-hours, 21 releases; waiting 609 ms; commit 775 ms)
2026-11-07T04:39:56Z [load_day 2026-08-09] 2026-08-09 hour 3: 169470 events in 4 files, snapshot 8966391491330718773 (task 3728 ms: download 1320 ms overlapping gunzip 206 ms, parse 797 ms, sort 103 ms, write 1563 ms, index 286 ms: 2 candidates, 41318 repo-hours, 16 releases; waiting 518 ms; commit 703 ms)
2026-11-07T04:40:00Z [load_day 2026-08-09] 2026-08-09 hour 4: 168381 events in 4 files, snapshot 1358873435821615539 (task 3601 ms: download 1238 ms overlapping gunzip 214 ms, parse 788 ms, sort 108 ms, write 1499 ms, index 250 ms: 4 candidates, 38243 repo-hours, 26 releases; waiting 530 ms; commit 982 ms)
2026-11-07T04:40:01Z [load_day 2026-08-09] 2026-08-09 hour 5: 167875 events in 4 files, snapshot 4431168676341144089 (task 3597 ms: download 1151 ms overlapping gunzip 200 ms, parse 783 ms, sort 103 ms, write 1501 ms, index 260 ms: 1 candidates, 38858 repo-hours, 13 releases; waiting 510 ms; commit 1104 ms)
2026-11-07T04:40:04Z [load_day 2026-08-09] 2026-08-09 hour 6: 170486 events in 4 files, snapshot 3168275385320322716 (task 3885 ms: download 1143 ms overlapping gunzip 206 ms, parse 836 ms, sort 125 ms, write 1658 ms, index 291 ms: 0 candidates, 40618 repo-hours, 17 releases; waiting 504 ms; commit 1069 ms)
2026-11-07T04:40:05Z [load_day 2026-08-09] 2026-08-09 hour 7: 167086 events in 4 files, snapshot 4381574322624885058 (task 3749 ms: download 1322 ms overlapping gunzip 197 ms, parse 747 ms, sort 113 ms, write 1697 ms, index 182 ms: 2 candidates, 27439 repo-hours, 10 releases; waiting 531 ms; commit 732 ms)
2026-11-07T04:40:09Z [load_day 2026-08-09] 2026-08-09 hour 8: 166978 events in 4 files, snapshot 5653605427185496398 (task 3624 ms: download 1458 ms overlapping gunzip 185 ms, parse 761 ms, sort 114 ms, write 1517 ms, index 200 ms: 2 candidates, 28160 repo-hours, 10 releases; waiting 536 ms; commit 857 ms)
2026-11-07T04:40:10Z [load_day 2026-08-09] 2026-08-09 hour 9: 172298 events in 4 files, snapshot 8435105351301389609 (task 3717 ms: download 1400 ms overlapping gunzip 210 ms, parse 780 ms, sort 111 ms, write 1533 ms, index 214 ms: 1 candidates, 28673 repo-hours, 9 releases; waiting 597 ms; commit 781 ms)
2026-11-07T04:40:13Z [load_day 2026-08-09] 2026-08-09 hour 10: 168086 events in 4 files, snapshot 5776884428235291504 (task 3675 ms: download 1524 ms overlapping gunzip 204 ms, parse 796 ms, sort 111 ms, write 1559 ms, index 177 ms: 2 candidates, 27131 repo-hours, 12 releases; waiting 515 ms; commit 938 ms)
2026-11-07T04:40:14Z [load_day 2026-08-09] 2026-08-09 hour 11: 171879 events in 4 files, snapshot 5718441930047935456 (task 3710 ms: download 1354 ms overlapping gunzip 198 ms, parse 767 ms, sort 104 ms, write 1510 ms, index 186 ms: 0 candidates, 30909 repo-hours, 15 releases; waiting 636 ms; commit 1013 ms)
2026-11-07T04:40:17Z [load_day 2026-08-09] 2026-08-09 hour 12: 171691 events in 4 files, snapshot 8264477646693383228 (task 3908 ms: download 1244 ms overlapping gunzip 197 ms, parse 784 ms, sort 111 ms, write 1578 ms, index 239 ms: 0 candidates, 33902 repo-hours, 10 releases; waiting 532 ms; commit 777 ms)
2026-11-07T04:40:18Z [load_day 2026-08-09] 2026-08-09 hour 13: 170523 events in 4 files, snapshot 5648795739108418670 (task 3727 ms: download 1194 ms overlapping gunzip 202 ms, parse 796 ms, sort 110 ms, write 1569 ms, index 212 ms: 2 candidates, 31892 repo-hours, 21 releases; waiting 518 ms; commit 824 ms)
2026-11-07T04:40:22Z [load_day 2026-08-09] 2026-08-09 hour 14: 169845 events in 4 files, snapshot 2862798794238679302 (task 3757 ms: download 1653 ms overlapping gunzip 206 ms, parse 827 ms, sort 107 ms, write 1573 ms, index 196 ms: 2 candidates, 30907 repo-hours, 12 releases; waiting 519 ms; commit 905 ms)
2026-11-07T04:40:23Z [load_day 2026-08-09] 2026-08-09 hour 15: 170180 events in 4 files, snapshot 2969381386773835867 (task 3728 ms: download 1736 ms overlapping gunzip 208 ms, parse 807 ms, sort 110 ms, write 1470 ms, index 227 ms: 2 candidates, 33419 repo-hours, 18 releases; waiting 544 ms; commit 670 ms)
2026-11-07T04:40:26Z [load_day 2026-08-09] 2026-08-09 hour 16: 170673 events in 4 files, snapshot 1508208227492010754 (task 3907 ms: download 1179 ms overlapping gunzip 206 ms, parse 813 ms, sort 119 ms, write 1714 ms, index 261 ms: 3 candidates, 35689 repo-hours, 18 releases; waiting 479 ms; commit 757 ms)
2026-11-07T04:40:27Z [load_day 2026-08-09] 2026-08-09 hour 17: 164919 events in 4 files, snapshot 8901772602056128284 (task 3773 ms: download 1387 ms overlapping gunzip 205 ms, parse 848 ms, sort 111 ms, write 1541 ms, index 212 ms: 1 candidates, 31417 repo-hours, 62 releases; waiting 359 ms; commit 764 ms)
2026-11-07T04:40:30Z [load_day 2026-08-09] 2026-08-09 hour 18: 170091 events in 4 files, snapshot 8102996978884241114 (task 3798 ms: download 1346 ms overlapping gunzip 202 ms, parse 797 ms, sort 120 ms, write 1590 ms, index 234 ms: 2 candidates, 33520 repo-hours, 8 releases; waiting 535 ms; commit 801 ms)
2026-11-07T04:40:31Z [load_day 2026-08-09] 2026-08-09 hour 19: 170089 events in 4 files, snapshot 7398884711927032938 (task 3777 ms: download 1233 ms overlapping gunzip 198 ms, parse 765 ms, sort 116 ms, write 1713 ms, index 227 ms: 2 candidates, 33789 repo-hours, 8 releases; waiting 520 ms; commit 875 ms)
2026-11-07T04:40:35Z [load_day 2026-08-09] 2026-08-09 hour 20: 168290 events in 4 files, snapshot 911948632726374713 (task 3571 ms: download 1270 ms overlapping gunzip 195 ms, parse 764 ms, sort 120 ms, write 1511 ms, index 217 ms: 4 candidates, 32024 repo-hours, 5 releases; waiting 467 ms; commit 1022 ms)
2026-11-07T04:40:36Z [load_day 2026-08-09] 2026-08-09 hour 21: 165481 events in 4 files, snapshot 6432954488022340839 (task 3703 ms: download 2023 ms overlapping gunzip 200 ms, parse 779 ms, sort 115 ms, write 1420 ms, index 219 ms: 2 candidates, 32457 repo-hours, 14 releases; waiting 535 ms; commit 797 ms)
2026-11-07T04:40:39Z [load_day 2026-08-09] 2026-08-09 hour 22: 169188 events in 4 files, snapshot 7550289075376036805 (task 3785 ms: download 1307 ms overlapping gunzip 206 ms, parse 815 ms, sort 125 ms, write 1577 ms, index 214 ms: 0 candidates, 33453 repo-hours, 12 releases; waiting 554 ms; commit 912 ms)
2026-11-07T04:40:40Z [load_day 2026-08-09] 2026-08-09 hour 23: 169077 events in 4 files, snapshot 9081511665531302841 (task 3562 ms: download 1640 ms overlapping gunzip 193 ms, parse 765 ms, sort 115 ms, write 1451 ms, index 199 ms: 0 candidates, 32459 repo-hours, 19 releases; waiting 520 ms; commit 880 ms)
2026-11-07T04:40:44Z [load_day 2026-08-09] 2026-08-09: repo_hour merged from 24 files to 1 (878137 rows, 3986 ms)
2026-11-07T04:40:46Z [load_day 2026-08-09] 2026-08-09: index committed in 5511 ms (19 + 1 + 24 files)
2026-11-07T04:40:46Z [load_day 2026-08-09] 2026-08-09: 4061407 events in 24 hours
2026-11-07T04:40:46Z [load_day 2026-08-09] attempt 1 succeeded