orcaLog in

Runs · run 281

load_day 2026-08-16, attempt 1 succeeded

Host
4e84322b8c45:46849
Started
2026-11-07T04:32:04Z
Ended
2026-11-07T04:33:06Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/281/load_day/2026-08-16/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:32:04Z [load_day 2026-08-16] attempt 1 started
2026-11-07T04:32:11Z [load_day 2026-08-16] 2026-08-16 hour 0: 163779 events in 4 files, snapshot 2336110742602726727 (task 3751 ms: download 1252 ms overlapping gunzip 187 ms, parse 761 ms, sort 102 ms, write 1642 ms, index 281 ms: 1 candidates, 38103 repo-hours, 12 releases; waiting 501 ms; commit 834 ms)
2026-11-07T04:32:12Z [load_day 2026-08-16] 2026-08-16 hour 1: 167894 events in 4 files, snapshot 5947937354151749663 (task 4024 ms: download 1371 ms overlapping gunzip 205 ms, parse 830 ms, sort 126 ms, write 1728 ms, index 296 ms: 2 candidates, 40218 repo-hours, 6 releases; waiting 512 ms; commit 924 ms)
2026-11-07T04:32:16Z [load_day 2026-08-16] 2026-08-16 hour 2: 169389 events in 4 files, snapshot 5971585435507897322 (task 3886 ms: download 1418 ms overlapping gunzip 193 ms, parse 767 ms, sort 108 ms, write 1601 ms, index 375 ms: 1 candidates, 31091 repo-hours, 12 releases; waiting 516 ms; commit 1328 ms)
2026-11-07T04:32:16Z [load_day 2026-08-16] 2026-08-16 hour 3: 171389 events in 4 files, snapshot 8892704624570898648 (task 3637 ms: download 1592 ms overlapping gunzip 194 ms, parse 759 ms, sort 105 ms, write 1587 ms, index 188 ms: 2 candidates, 27427 repo-hours, 7 releases; waiting 537 ms; commit 845 ms)
2026-11-07T04:32:20Z [load_day 2026-08-16] 2026-08-16 hour 4: 172784 events in 4 files, snapshot 7561857426596369005 (task 4033 ms: download 1618 ms overlapping gunzip 205 ms, parse 814 ms, sort 108 ms, write 1715 ms, index 187 ms: 1 candidates, 26623 repo-hours, 8 releases; waiting 519 ms; commit 880 ms)
2026-11-07T04:32:21Z [load_day 2026-08-16] 2026-08-16 hour 5: 170116 events in 4 files, snapshot 207424000905007794 (task 3735 ms: download 1376 ms overlapping gunzip 196 ms, parse 782 ms, sort 109 ms, write 1666 ms, index 178 ms: 1 candidates, 25554 repo-hours, 26 releases; waiting 525 ms; commit 1241 ms)
2026-11-07T04:32:24Z [load_day 2026-08-16] 2026-08-16 hour 6: 169193 events in 4 files, snapshot 3892277349596389917 (task 3677 ms: download 1473 ms overlapping gunzip 203 ms, parse 826 ms, sort 135 ms, write 1509 ms, index 168 ms: 2 candidates, 25063 repo-hours, 14 releases; waiting 513 ms; commit 908 ms)
2026-11-07T04:32:25Z [load_day 2026-08-16] 2026-08-16 hour 7: 171189 events in 4 files, snapshot 6309427445057304601 (task 3278 ms: download 1028 ms overlapping gunzip 195 ms, parse 763 ms, sort 102 ms, write 1506 ms, index 159 ms: 4 candidates, 23729 repo-hours, 7 releases; waiting 269 ms; commit 748 ms)
2026-11-07T04:32:29Z [load_day 2026-08-16] 2026-08-16 hour 8: 167128 events in 4 files, snapshot 3678013775471170209 (task 3527 ms: download 1266 ms overlapping gunzip 203 ms, parse 807 ms, sort 109 ms, write 1444 ms, index 173 ms: 2 candidates, 24523 repo-hours, 7 releases; waiting 526 ms; commit 867 ms)
2026-11-07T04:32:30Z [load_day 2026-08-16] 2026-08-16 hour 9: 170475 events in 4 files, snapshot 5112544155874078333 (task 3588 ms: download 1303 ms overlapping gunzip 199 ms, parse 790 ms, sort 102 ms, write 1460 ms, index 160 ms: 4 candidates, 23178 repo-hours, 6 releases; waiting 532 ms; commit 929 ms)
2026-11-07T04:32:33Z [load_day 2026-08-16] 2026-08-16 hour 10: 165492 events in 4 files, snapshot 97273048086928956 (task 3392 ms: download 1277 ms overlapping gunzip 188 ms, parse 733 ms, sort 102 ms, write 1504 ms, index 175 ms: 0 candidates, 27239 repo-hours, 10 releases; waiting 331 ms; commit 741 ms)
2026-11-07T04:32:34Z [load_day 2026-08-16] 2026-08-16 hour 11: 165981 events in 4 files, snapshot 2920953690038103313 (task 3486 ms: download 1265 ms overlapping gunzip 189 ms, parse 754 ms, sort 104 ms, write 1414 ms, index 186 ms: 2 candidates, 29074 repo-hours, 15 releases; waiting 531 ms; commit 884 ms)
2026-11-07T04:32:38Z [load_day 2026-08-16] 2026-08-16 hour 12: 171286 events in 4 files, snapshot 2592121413630603513 (task 4125 ms: download 1275 ms overlapping gunzip 202 ms, parse 818 ms, sort 111 ms, write 1531 ms, index 207 ms: 2 candidates, 32523 repo-hours, 7 releases; waiting 565 ms; commit 885 ms)
2026-11-07T04:32:38Z [load_day 2026-08-16] 2026-08-16 hour 13: 170411 events in 4 files, snapshot 6800678538458840568 (task 3700 ms: download 1595 ms overlapping gunzip 188 ms, parse 768 ms, sort 105 ms, write 1596 ms, index 200 ms: 1 candidates, 30851 repo-hours, 10 releases; waiting 555 ms; commit 706 ms)
2026-11-07T04:32:42Z [load_day 2026-08-16] 2026-08-16 hour 14: 172289 events in 4 files, snapshot 6033552182051937019 (task 3619 ms: download 1619 ms overlapping gunzip 193 ms, parse 772 ms, sort 106 ms, write 1566 ms, index 178 ms: 3 candidates, 28018 repo-hours, 10 releases; waiting 530 ms; commit 919 ms)
2026-11-07T04:32:43Z [load_day 2026-08-16] 2026-08-16 hour 15: 168274 events in 4 files, snapshot 7867002917512111658 (task 3765 ms: download 1469 ms overlapping gunzip 192 ms, parse 750 ms, sort 98 ms, write 1472 ms, index 191 ms: 3 candidates, 29855 repo-hours, 14 releases; waiting 780 ms; commit 924 ms)
2026-11-07T04:32:46Z [load_day 2026-08-16] 2026-08-16 hour 16: 167895 events in 4 files, snapshot 7643775395991014102 (task 3648 ms: download 1167 ms overlapping gunzip 195 ms, parse 783 ms, sort 105 ms, write 1524 ms, index 198 ms: 4 candidates, 31059 repo-hours, 10 releases; waiting 530 ms; commit 890 ms)
2026-11-07T04:32:47Z [load_day 2026-08-16] 2026-08-16 hour 17: 169788 events in 4 files, snapshot 1037030182016376281 (task 3644 ms: download 1225 ms overlapping gunzip 212 ms, parse 824 ms, sort 111 ms, write 1480 ms, index 209 ms: 4 candidates, 31891 repo-hours, 11 releases; waiting 534 ms; commit 765 ms)
2026-11-07T04:32:51Z [load_day 2026-08-16] 2026-08-16 hour 18: 164987 events in 4 files, snapshot 4790762239469516225 (task 3643 ms: download 1216 ms overlapping gunzip 193 ms, parse 780 ms, sort 115 ms, write 1472 ms, index 226 ms: 1 candidates, 34512 repo-hours, 9 releases; waiting 572 ms; commit 842 ms)
2026-11-07T04:32:52Z [load_day 2026-08-16] 2026-08-16 hour 19: 165044 events in 4 files, snapshot 3366647805751189866 (task 3598 ms: download 1173 ms overlapping gunzip 185 ms, parse 742 ms, sort 104 ms, write 1487 ms, index 248 ms: 1 candidates, 34096 repo-hours, 12 releases; waiting 534 ms; commit 930 ms)
2026-11-07T04:32:55Z [load_day 2026-08-16] 2026-08-16 hour 20: 171400 events in 4 files, snapshot 8988844470356849363 (task 3804 ms: download 1355 ms overlapping gunzip 210 ms, parse 812 ms, sort 112 ms, write 1518 ms, index 241 ms: 5 candidates, 37798 repo-hours, 18 releases; waiting 516 ms; commit 951 ms)
2026-11-07T04:32:56Z [load_day 2026-08-16] 2026-08-16 hour 21: 163986 events in 4 files, snapshot 3884353708416836507 (task 3610 ms: download 1173 ms overlapping gunzip 199 ms, parse 778 ms, sort 106 ms, write 1476 ms, index 235 ms: 6 candidates, 35393 repo-hours, 9 releases; waiting 518 ms; commit 774 ms)
2026-11-07T04:33:00Z [load_day 2026-08-16] 2026-08-16 hour 22: 165476 events in 4 files, snapshot 7520959129349030197 (task 3646 ms: download 1418 ms overlapping gunzip 202 ms, parse 779 ms, sort 110 ms, write 1508 ms, index 235 ms: 3 candidates, 35619 repo-hours, 6 releases; waiting 517 ms; commit 1929 ms)
2026-11-07T04:33:01Z [load_day 2026-08-16] 2026-08-16 hour 23: 166088 events in 4 files, snapshot 3385131340323545840 (task 3614 ms: download 1355 ms overlapping gunzip 187 ms, parse 756 ms, sort 109 ms, write 1486 ms, index 262 ms: 5 candidates, 36795 repo-hours, 10 releases; waiting 532 ms; commit 910 ms)
2026-11-07T04:33:05Z [load_day 2026-08-16] 2026-08-16: repo_hour merged from 24 files to 1 (740232 rows, 3573 ms)
2026-11-07T04:33:06Z [load_day 2026-08-16] 2026-08-16: index committed in 5057 ms (23 + 1 + 24 files)
2026-11-07T04:33:06Z [load_day 2026-08-16] 2026-08-16: 4041733 events in 24 hours
2026-11-07T04:33:06Z [load_day 2026-08-16] attempt 1 succeeded