orcaLog in

Runs · run 326

load_day 2026-08-01, attempt 1 succeeded

Host
4e84322b8c45:58755
Started
2026-11-07T04:48:45Z
Ended
2026-11-07T04:49:48Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/326/load_day/2026-08-01/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:48:45Z [load_day 2026-08-01] attempt 1 started
2026-11-07T04:48:52Z [load_day 2026-08-01] 2026-08-01 hour 0: 171167 events in 4 files, snapshot 4335198976990229075 (task 3760 ms: download 1489 ms overlapping gunzip 209 ms, parse 836 ms, sort 114 ms, write 1543 ms, index 245 ms: 3 candidates, 33257 repo-hours, 10 releases; waiting 488 ms; commit 778 ms)
2026-11-07T04:48:53Z [load_day 2026-08-01] 2026-08-01 hour 1: 167181 events in 4 files, snapshot 2490082051866954921 (task 3870 ms: download 1757 ms overlapping gunzip 201 ms, parse 820 ms, sort 117 ms, write 1545 ms, index 260 ms: 3 candidates, 39754 repo-hours, 9 releases; waiting 520 ms; commit 748 ms)
2026-11-07T04:48:57Z [load_day 2026-08-01] 2026-08-01 hour 2: 169578 events in 4 files, snapshot 2047246187732170445 (task 3976 ms: download 1201 ms overlapping gunzip 206 ms, parse 809 ms, sort 122 ms, write 1786 ms, index 309 ms: 5 candidates, 40718 repo-hours, 12 releases; waiting 478 ms; commit 847 ms)
2026-11-07T04:48:57Z [load_day 2026-08-01] 2026-08-01 hour 3: 166688 events in 4 files, snapshot 6394279363985165038 (task 3663 ms: download 1538 ms overlapping gunzip 188 ms, parse 774 ms, sort 118 ms, write 1516 ms, index 210 ms: 2 candidates, 31176 repo-hours, 7 releases; waiting 514 ms; commit 818 ms)
2026-11-07T04:49:01Z [load_day 2026-08-01] 2026-08-01 hour 4: 168493 events in 4 files, snapshot 5481644343010358484 (task 3663 ms: download 1267 ms overlapping gunzip 190 ms, parse 770 ms, sort 110 ms, write 1597 ms, index 143 ms: 0 candidates, 20546 repo-hours, 3 releases; waiting 540 ms; commit 831 ms)
2026-11-07T04:49:02Z [load_day 2026-08-01] 2026-08-01 hour 5: 170592 events in 4 files, snapshot 2401755436386845686 (task 3940 ms: download 1734 ms overlapping gunzip 195 ms, parse 795 ms, sort 120 ms, write 1592 ms, index 133 ms: 0 candidates, 20752 repo-hours, 5 releases; waiting 787 ms; commit 973 ms)
2026-11-07T04:49:05Z [load_day 2026-08-01] 2026-08-01 hour 6: 178686 events in 4 files, snapshot 7021300666416380292 (task 3674 ms: download 1534 ms overlapping gunzip 203 ms, parse 787 ms, sort 107 ms, write 1601 ms, index 143 ms: 0 candidates, 23022 repo-hours, 7 releases; waiting 538 ms; commit 859 ms)
2026-11-07T04:49:06Z [load_day 2026-08-01] 2026-08-01 hour 7: 169492 events in 4 files, snapshot 3944606392031132761 (task 3608 ms: download 1374 ms overlapping gunzip 203 ms, parse 765 ms, sort 105 ms, write 1505 ms, index 175 ms: 2 candidates, 23976 repo-hours, 6 releases; waiting 520 ms; commit 909 ms)
2026-11-07T04:49:10Z [load_day 2026-08-01] 2026-08-01 hour 8: 169489 events in 4 files, snapshot 4148623531792538431 (task 3464 ms: download 1311 ms overlapping gunzip 189 ms, parse 760 ms, sort 111 ms, write 1535 ms, index 216 ms: 2 candidates, 28013 repo-hours, 15 releases; waiting 356 ms; commit 1076 ms)
2026-11-07T04:49:11Z [load_day 2026-08-01] 2026-08-01 hour 9: 168787 events in 4 files, snapshot 8664760299157112764 (task 3783 ms: download 1373 ms overlapping gunzip 194 ms, parse 781 ms, sort 120 ms, write 1670 ms, index 200 ms: 1 candidates, 27569 repo-hours, 8 releases; waiting 517 ms; commit 858 ms)
2026-11-07T04:49:14Z [load_day 2026-08-01] 2026-08-01 hour 10: 169582 events in 4 files, snapshot 7998190301483026673 (task 3978 ms: download 1304 ms overlapping gunzip 213 ms, parse 889 ms, sort 148 ms, write 1713 ms, index 187 ms: 0 candidates, 27277 repo-hours, 10 releases; waiting 506 ms; commit 1074 ms)
2026-11-07T04:49:15Z [load_day 2026-08-01] 2026-08-01 hour 11: 166397 events in 4 files, snapshot 7124692815887339366 (task 3737 ms: download 1306 ms overlapping gunzip 194 ms, parse 748 ms, sort 108 ms, write 1566 ms, index 216 ms: 3 candidates, 28793 repo-hours, 11 releases; waiting 595 ms; commit 906 ms)
2026-11-07T04:49:18Z [load_day 2026-08-01] 2026-08-01 hour 12: 169487 events in 4 files, snapshot 8384133158581946505 (task 3698 ms: download 1414 ms overlapping gunzip 189 ms, parse 753 ms, sort 108 ms, write 1604 ms, index 191 ms: 0 candidates, 27274 repo-hours, 8 releases; waiting 541 ms; commit 1003 ms)
2026-11-07T04:49:20Z [load_day 2026-08-01] 2026-08-01 hour 13: 173683 events in 4 files, snapshot 7551596886883920950 (task 3757 ms: download 1551 ms overlapping gunzip 193 ms, parse 805 ms, sort 113 ms, write 1609 ms, index 204 ms: 5 candidates, 31656 repo-hours, 7 releases; waiting 505 ms; commit 1011 ms)
2026-11-07T04:49:23Z [load_day 2026-08-01] 2026-08-01 hour 14: 171081 events in 4 files, snapshot 4090651379304066981 (task 3758 ms: download 1349 ms overlapping gunzip 202 ms, parse 823 ms, sort 125 ms, write 1562 ms, index 253 ms: 5 candidates, 33304 repo-hours, 9 releases; waiting 519 ms; commit 879 ms)
2026-11-07T04:49:24Z [load_day 2026-08-01] 2026-08-01 hour 15: 168788 events in 4 files, snapshot 3781624037155738771 (task 3799 ms: download 1458 ms overlapping gunzip 198 ms, parse 790 ms, sort 119 ms, write 1569 ms, index 306 ms: 1 candidates, 41163 repo-hours, 17 releases; waiting 522 ms; commit 699 ms)
2026-11-07T04:49:27Z [load_day 2026-08-01] 2026-08-01 hour 16: 166179 events in 4 files, snapshot 3876363821942900349 (task 3774 ms: download 1176 ms overlapping gunzip 196 ms, parse 750 ms, sort 117 ms, write 1556 ms, index 340 ms: 4 candidates, 46201 repo-hours, 10 releases; waiting 519 ms; commit 773 ms)
2026-11-07T04:49:28Z [load_day 2026-08-01] 2026-08-01 hour 17: 170076 events in 4 files, snapshot 6285154918622668237 (task 3807 ms: download 1513 ms overlapping gunzip 198 ms, parse 766 ms, sort 114 ms, write 1596 ms, index 299 ms: 0 candidates, 44696 repo-hours, 10 releases; waiting 536 ms; commit 967 ms)
2026-11-07T04:49:32Z [load_day 2026-08-01] 2026-08-01 hour 18: 168476 events in 4 files, snapshot 479089868118418895 (task 4058 ms: download 1322 ms overlapping gunzip 197 ms, parse 764 ms, sort 113 ms, write 1754 ms, index 315 ms: 3 candidates, 44044 repo-hours, 13 releases; waiting 558 ms; commit 879 ms)
2026-11-07T04:49:33Z [load_day 2026-08-01] 2026-08-01 hour 19: 167478 events in 4 files, snapshot 4413485635387918899 (task 3939 ms: download 1491 ms overlapping gunzip 202 ms, parse 783 ms, sort 111 ms, write 1605 ms, index 304 ms: 0 candidates, 47955 repo-hours, 16 releases; waiting 633 ms; commit 996 ms)
2026-11-07T04:49:36Z [load_day 2026-08-01] 2026-08-01 hour 20: 172475 events in 4 files, snapshot 8066289514669546603 (task 3871 ms: download 1115 ms overlapping gunzip 205 ms, parse 791 ms, sort 117 ms, write 1744 ms, index 332 ms: 6 candidates, 47530 repo-hours, 16 releases; waiting 359 ms; commit 976 ms)
2026-11-07T04:49:37Z [load_day 2026-08-01] 2026-08-01 hour 21: 169665 events in 4 files, snapshot 1959930588606311369 (task 3818 ms: download 1316 ms overlapping gunzip 204 ms, parse 785 ms, sort 118 ms, write 1585 ms, index 310 ms: 3 candidates, 47141 repo-hours, 13 releases; waiting 527 ms; commit 877 ms)
2026-11-07T04:49:41Z [load_day 2026-08-01] 2026-08-01 hour 22: 168374 events in 4 files, snapshot 8091505119140512205 (task 3790 ms: download 1317 ms overlapping gunzip 204 ms, parse 773 ms, sort 117 ms, write 1505 ms, index 349 ms: 3 candidates, 48282 repo-hours, 15 releases; waiting 483 ms; commit 1047 ms)
2026-11-07T04:49:42Z [load_day 2026-08-01] 2026-08-01 hour 23: 169662 events in 4 files, snapshot 2803501479761843225 (task 4001 ms: download 1370 ms overlapping gunzip 208 ms, parse 770 ms, sort 107 ms, write 1668 ms, index 356 ms: 7 candidates, 53367 repo-hours, 20 releases; waiting 538 ms; commit 961 ms)
2026-11-07T04:49:46Z [load_day 2026-08-01] 2026-08-01: repo_hour merged from 24 files to 1 (857466 rows, 4181 ms)
2026-11-07T04:49:48Z [load_day 2026-08-01] 2026-08-01: index committed in 6311 ms (17 + 1 + 24 files)
2026-11-07T04:49:48Z [load_day 2026-08-01] 2026-08-01: 4071556 events in 24 hours
2026-11-07T04:49:48Z [load_day 2026-08-01] attempt 1 succeeded