orcaLog in

Runs · run 389

load_day 2026-07-11, attempt 1 succeeded

Host
4e84322b8c45:76663
Started
2026-11-07T05:11:32Z
Ended
2026-11-07T05:12:36Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/389/load_day/2026-07-11/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:11:32Z [load_day 2026-07-11] attempt 1 started
2026-11-07T05:11:39Z [load_day 2026-07-11] 2026-07-11 hour 0: 166975 events in 4 files, snapshot 1465696136849733716 (task 3790 ms: download 1519 ms overlapping gunzip 195 ms, parse 776 ms, sort 108 ms, write 1564 ms, index 277 ms: 3 candidates, 41631 repo-hours, 14 releases; waiting 495 ms; commit 990 ms)
2026-11-07T05:11:40Z [load_day 2026-07-11] 2026-07-11 hour 1: 170067 events in 4 files, snapshot 1553010132089744060 (task 3956 ms: download 1666 ms overlapping gunzip 195 ms, parse 776 ms, sort 111 ms, write 1706 ms, index 344 ms: 5 candidates, 52870 repo-hours, 19 releases; waiting 506 ms; commit 971 ms)
2026-11-07T05:11:44Z [load_day 2026-07-11] 2026-07-11 hour 2: 171082 events in 4 files, snapshot 5316172264443668433 (task 3867 ms: download 1133 ms overlapping gunzip 214 ms, parse 800 ms, sort 116 ms, write 1570 ms, index 340 ms: 3 candidates, 53962 repo-hours, 10 releases; waiting 523 ms; commit 924 ms)
2026-11-07T05:11:45Z [load_day 2026-07-11] 2026-07-11 hour 3: 171275 events in 4 files, snapshot 6201860956292522720 (task 3627 ms: download 1263 ms overlapping gunzip 197 ms, parse 756 ms, sort 105 ms, write 1465 ms, index 284 ms: 1 candidates, 40135 repo-hours, 14 releases; waiting 522 ms; commit 861 ms)
2026-11-07T05:11:48Z [load_day 2026-07-11] 2026-07-11 hour 4: 172883 events in 4 files, snapshot 4595484971599915276 (task 3852 ms: download 1298 ms overlapping gunzip 200 ms, parse 792 ms, sort 111 ms, write 1429 ms, index 240 ms: 4 candidates, 33806 repo-hours, 15 releases; waiting 807 ms; commit 1105 ms)
2026-11-07T05:11:49Z [load_day 2026-07-11] 2026-07-11 hour 5: 171785 events in 4 files, snapshot 5770177419865691762 (task 3735 ms: download 1328 ms overlapping gunzip 202 ms, parse 750 ms, sort 109 ms, write 1454 ms, index 216 ms: 6 candidates, 32108 repo-hours, 12 releases; waiting 465 ms; commit 1198 ms)
2026-11-07T05:11:52Z [load_day 2026-07-11] 2026-07-11 hour 6: 170987 events in 4 files, snapshot 2717458172870053616 (task 3720 ms: download 1580 ms overlapping gunzip 208 ms, parse 824 ms, sort 101 ms, write 1482 ms, index 257 ms: 4 candidates, 36203 repo-hours, 13 releases; waiting 521 ms; commit 929 ms)
2026-11-07T05:11:53Z [load_day 2026-07-11] 2026-07-11 hour 7: 171382 events in 4 files, snapshot 139505468238569133 (task 3584 ms: download 1371 ms overlapping gunzip 201 ms, parse 768 ms, sort 99 ms, write 1415 ms, index 260 ms: 3 candidates, 34971 repo-hours, 13 releases; waiting 539 ms; commit 1059 ms)
2026-11-07T05:11:57Z [load_day 2026-07-11] 2026-07-11 hour 8: 173090 events in 4 files, snapshot 7000155340937761448 (task 3765 ms: download 1369 ms overlapping gunzip 194 ms, parse 790 ms, sort 102 ms, write 1594 ms, index 201 ms: 5 candidates, 29885 repo-hours, 7 releases; waiting 544 ms; commit 1012 ms)
2026-11-07T05:11:58Z [load_day 2026-07-11] 2026-07-11 hour 9: 168487 events in 4 files, snapshot 8846102496752174881 (task 3695 ms: download 1271 ms overlapping gunzip 196 ms, parse 761 ms, sort 98 ms, write 1605 ms, index 227 ms: 2 candidates, 31433 repo-hours, 18 releases; waiting 517 ms; commit 834 ms)
2026-11-07T05:12:01Z [load_day 2026-07-11] 2026-07-11 hour 10: 171585 events in 4 files, snapshot 4090895649533699923 (task 3620 ms: download 1392 ms overlapping gunzip 208 ms, parse 750 ms, sort 100 ms, write 1464 ms, index 246 ms: 5 candidates, 35266 repo-hours, 13 releases; waiting 564 ms; commit 1048 ms)
2026-11-07T05:12:02Z [load_day 2026-07-11] 2026-07-11 hour 11: 174087 events in 4 files, snapshot 4188026354795219384 (task 3747 ms: download 1830 ms overlapping gunzip 192 ms, parse 784 ms, sort 107 ms, write 1524 ms, index 253 ms: 5 candidates, 36198 repo-hours, 15 releases; waiting 526 ms; commit 1021 ms)
2026-11-07T05:12:06Z [load_day 2026-07-11] 2026-07-11 hour 12: 168383 events in 4 files, snapshot 2952917842261242838 (task 3699 ms: download 1259 ms overlapping gunzip 203 ms, parse 797 ms, sort 110 ms, write 1484 ms, index 259 ms: 2 candidates, 38299 repo-hours, 17 releases; waiting 530 ms; commit 1040 ms)
2026-11-07T05:12:07Z [load_day 2026-07-11] 2026-07-11 hour 13: 169773 events in 4 files, snapshot 6721607649738638659 (task 3491 ms: download 1140 ms overlapping gunzip 191 ms, parse 747 ms, sort 105 ms, write 1498 ms, index 262 ms: 4 candidates, 38575 repo-hours, 12 releases; waiting 381 ms; commit 923 ms)
2026-11-07T05:12:10Z [load_day 2026-07-11] 2026-07-11 hour 14: 170888 events in 4 files, snapshot 1468249837478605977 (task 3738 ms: download 1298 ms overlapping gunzip 199 ms, parse 785 ms, sort 109 ms, write 1562 ms, index 266 ms: 4 candidates, 38779 repo-hours, 10 releases; waiting 530 ms; commit 860 ms)
2026-11-07T05:12:11Z [load_day 2026-07-11] 2026-07-11 hour 15: 171473 events in 4 files, snapshot 2593016399005943334 (task 3762 ms: download 1323 ms overlapping gunzip 224 ms, parse 811 ms, sort 118 ms, write 1536 ms, index 297 ms: 8 candidates, 40557 repo-hours, 11 releases; waiting 507 ms; commit 932 ms)
2026-11-07T05:12:15Z [load_day 2026-07-11] 2026-07-11 hour 16: 168780 events in 4 files, snapshot 4412908922986985287 (task 3825 ms: download 1373 ms overlapping gunzip 198 ms, parse 775 ms, sort 103 ms, write 1606 ms, index 330 ms: 4 candidates, 43349 repo-hours, 13 releases; waiting 535 ms; commit 895 ms)
2026-11-07T05:12:16Z [load_day 2026-07-11] 2026-07-11 hour 17: 173887 events in 4 files, snapshot 645453953991073798 (task 3791 ms: download 1690 ms overlapping gunzip 205 ms, parse 793 ms, sort 105 ms, write 1496 ms, index 281 ms: 1 candidates, 41614 repo-hours, 14 releases; waiting 514 ms; commit 1072 ms)
2026-11-07T05:12:20Z [load_day 2026-07-11] 2026-07-11 hour 18: 168389 events in 4 files, snapshot 236928640922229640 (task 3800 ms: download 1173 ms overlapping gunzip 195 ms, parse 751 ms, sort 103 ms, write 1676 ms, index 270 ms: 0 candidates, 37897 repo-hours, 6 releases; waiting 514 ms; commit 2019 ms)
2026-11-07T05:12:21Z [load_day 2026-07-11] 2026-07-11 hour 19: 167974 events in 4 files, snapshot 7081602961021854116 (task 3761 ms: download 1218 ms overlapping gunzip 189 ms, parse 741 ms, sort 108 ms, write 1684 ms, index 286 ms: 4 candidates, 38819 repo-hours, 14 releases; waiting 529 ms; commit 679 ms)
2026-11-07T05:12:25Z [load_day 2026-07-11] 2026-07-11 hour 20: 167487 events in 4 files, snapshot 3017045589577674981 (task 3611 ms: download 1345 ms overlapping gunzip 197 ms, parse 774 ms, sort 109 ms, write 1433 ms, index 269 ms: 3 candidates, 37715 repo-hours, 13 releases; waiting 520 ms; commit 1097 ms)
2026-11-07T05:12:26Z [load_day 2026-07-11] 2026-07-11 hour 21: 173289 events in 4 files, snapshot 8510391450908788934 (task 3676 ms: download 1347 ms overlapping gunzip 209 ms, parse 818 ms, sort 106 ms, write 1451 ms, index 261 ms: 2 candidates, 37683 repo-hours, 13 releases; waiting 504 ms; commit 917 ms)
2026-11-07T05:12:29Z [load_day 2026-07-11] 2026-07-11 hour 22: 168492 events in 4 files, snapshot 813142927305205244 (task 3511 ms: download 1192 ms overlapping gunzip 191 ms, parse 774 ms, sort 99 ms, write 1454 ms, index 248 ms: 4 candidates, 36108 repo-hours, 16 releases; waiting 524 ms; commit 943 ms)
2026-11-07T05:12:30Z [load_day 2026-07-11] 2026-07-11 hour 23: 170379 events in 4 files, snapshot 2665408024588320464 (task 3409 ms: download 951 ms overlapping gunzip 211 ms, parse 806 ms, sort 127 ms, write 1442 ms, index 268 ms: 4 candidates, 37345 repo-hours, 21 releases; waiting 348 ms; commit 959 ms)
2026-11-07T05:12:34Z [load_day 2026-07-11] 2026-07-11: repo_hour merged from 24 files to 1 (925208 rows, 4294 ms)
2026-11-07T05:12:36Z [load_day 2026-07-11] 2026-07-11: index committed in 6059 ms (23 + 1 + 24 files)
2026-11-07T05:12:36Z [load_day 2026-07-11] 2026-07-11: 4092879 events in 24 hours
2026-11-07T05:12:36Z [load_day 2026-07-11] attempt 1 succeeded