orcaLog in

Runs · run 380

load_day 2026-07-14, attempt 1 succeeded

Host
4e84322b8c45:74095
Started
2026-11-07T05:08:15Z
Ended
2026-11-07T05:09:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/380/load_day/2026-07-14/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:08:15Z [load_day 2026-07-14] attempt 1 started
2026-11-07T05:08:22Z [load_day 2026-07-14] 2026-07-14 hour 0: 163667 events in 4 files, snapshot 761820339771303000 (task 3945 ms: download 1317 ms overlapping gunzip 200 ms, parse 763 ms, sort 110 ms, write 1724 ms, index 373 ms: 7 candidates, 56889 repo-hours, 21 releases; waiting 515 ms; commit 1051 ms)
2026-11-07T05:08:23Z [load_day 2026-07-14] 2026-07-14 hour 1: 168075 events in 4 files, snapshot 819290546926648991 (task 4227 ms: download 1422 ms overlapping gunzip 207 ms, parse 787 ms, sort 111 ms, write 1781 ms, index 508 ms: 3 candidates, 74290 repo-hours, 18 releases; waiting 509 ms; commit 987 ms)
2026-11-07T05:08:27Z [load_day 2026-07-14] 2026-07-14 hour 2: 165564 events in 4 files, snapshot 8334986607330515805 (task 4005 ms: download 1435 ms overlapping gunzip 208 ms, parse 769 ms, sort 109 ms, write 1544 ms, index 503 ms: 10 candidates, 78316 repo-hours, 19 releases; waiting 535 ms; commit 1026 ms)
2026-11-07T05:08:28Z [load_day 2026-07-14] 2026-07-14 hour 3: 166656 events in 4 files, snapshot 5127482506929723092 (task 3887 ms: download 1358 ms overlapping gunzip 203 ms, parse 774 ms, sort 107 ms, write 1528 ms, index 423 ms: 2 candidates, 64538 repo-hours, 19 releases; waiting 535 ms; commit 1032 ms)
2026-11-07T05:08:31Z [load_day 2026-07-14] 2026-07-14 hour 4: 166566 events in 4 files, snapshot 3138927857617337025 (task 3672 ms: download 1148 ms overlapping gunzip 200 ms, parse 821 ms, sort 102 ms, write 1420 ms, index 386 ms: 7 candidates, 60078 repo-hours, 12 releases; waiting 515 ms; commit 978 ms)
2026-11-07T05:08:32Z [load_day 2026-07-14] 2026-07-14 hour 5: 165156 events in 4 files, snapshot 3991763365531323577 (task 3609 ms: download 1147 ms overlapping gunzip 210 ms, parse 753 ms, sort 100 ms, write 1423 ms, index 399 ms: 2 candidates, 59829 repo-hours, 17 releases; waiting 514 ms; commit 1101 ms)
2026-11-07T05:08:36Z [load_day 2026-07-14] 2026-07-14 hour 6: 167868 events in 4 files, snapshot 8416630220084723792 (task 4038 ms: download 1349 ms overlapping gunzip 221 ms, parse 840 ms, sort 109 ms, write 1560 ms, index 505 ms: 5 candidates, 67943 repo-hours, 19 releases; waiting 507 ms; commit 1091 ms)
2026-11-07T05:08:37Z [load_day 2026-07-14] 2026-07-14 hour 7: 159859 events in 4 files, snapshot 7897657100669692955 (task 3994 ms: download 1498 ms overlapping gunzip 204 ms, parse 786 ms, sort 112 ms, write 1519 ms, index 531 ms: 3 candidates, 71973 repo-hours, 26 releases; waiting 523 ms; commit 860 ms)
2026-11-07T05:08:41Z [load_day 2026-07-14] 2026-07-14 hour 8: 165161 events in 4 files, snapshot 7342333955396790607 (task 3923 ms: download 1290 ms overlapping gunzip 208 ms, parse 778 ms, sort 110 ms, write 1486 ms, index 535 ms: 4 candidates, 73290 repo-hours, 29 releases; waiting 517 ms; commit 1143 ms)
2026-11-07T05:08:42Z [load_day 2026-07-14] 2026-07-14 hour 9: 163056 events in 4 files, snapshot 5521828067071148174 (task 3863 ms: download 1408 ms overlapping gunzip 198 ms, parse 745 ms, sort 101 ms, write 1449 ms, index 540 ms: 10 candidates, 77552 repo-hours, 11 releases; waiting 520 ms; commit 998 ms)
2026-11-07T05:08:45Z [load_day 2026-07-14] 2026-07-14 hour 10: 162344 events in 4 files, snapshot 5604224180044161107 (task 3893 ms: download 1500 ms overlapping gunzip 201 ms, parse 748 ms, sort 103 ms, write 1471 ms, index 542 ms: 6 candidates, 77608 repo-hours, 23 releases; waiting 540 ms; commit 905 ms)
2026-11-07T05:08:46Z [load_day 2026-07-14] 2026-07-14 hour 11: 161963 events in 4 files, snapshot 9130782088284291473 (task 3877 ms: download 1324 ms overlapping gunzip 199 ms, parse 744 ms, sort 100 ms, write 1430 ms, index 530 ms: 5 candidates, 75431 repo-hours, 11 releases; waiting 544 ms; commit 758 ms)
2026-11-07T05:08:50Z [load_day 2026-07-14] 2026-07-14 hour 12: 165163 events in 4 files, snapshot 3333798022484368704 (task 4003 ms: download 1387 ms overlapping gunzip 210 ms, parse 798 ms, sort 114 ms, write 1544 ms, index 502 ms: 5 candidates, 72380 repo-hours, 29 releases; waiting 525 ms; commit 1110 ms)
2026-11-07T05:08:51Z [load_day 2026-07-14] 2026-07-14 hour 13: 157965 events in 4 files, snapshot 1690609799153864389 (task 3622 ms: download 1084 ms overlapping gunzip 186 ms, parse 723 ms, sort 103 ms, write 1358 ms, index 533 ms: 7 candidates, 78761 repo-hours, 22 releases; waiting 508 ms; commit 986 ms)
2026-11-07T05:08:54Z [load_day 2026-07-14] 2026-07-14 hour 14: 162868 events in 4 files, snapshot 7126977728951863810 (task 3964 ms: download 1416 ms overlapping gunzip 200 ms, parse 794 ms, sort 99 ms, write 1522 ms, index 525 ms: 8 candidates, 76045 repo-hours, 18 releases; waiting 524 ms; commit 952 ms)
2026-11-07T05:08:55Z [load_day 2026-07-14] 2026-07-14 hour 15: 165061 events in 4 files, snapshot 7823894626247413561 (task 3869 ms: download 1240 ms overlapping gunzip 203 ms, parse 781 ms, sort 102 ms, write 1519 ms, index 514 ms: 12 candidates, 75076 repo-hours, 31 releases; waiting 526 ms; commit 991 ms)
2026-11-07T05:08:59Z [load_day 2026-07-14] 2026-07-14 hour 16: 165758 events in 4 files, snapshot 9084053016733449278 (task 3975 ms: download 1412 ms overlapping gunzip 204 ms, parse 764 ms, sort 100 ms, write 1597 ms, index 490 ms: 8 candidates, 71199 repo-hours, 23 releases; waiting 512 ms; commit 960 ms)
2026-11-07T05:09:01Z [load_day 2026-07-14] 2026-07-14 hour 17: 159654 events in 4 files, snapshot 3637909215685857445 (task 3931 ms: download 1284 ms overlapping gunzip 195 ms, parse 734 ms, sort 104 ms, write 1517 ms, index 540 ms: 3 candidates, 74787 repo-hours, 19 releases; waiting 527 ms; commit 1163 ms)
2026-11-07T05:09:04Z [load_day 2026-07-14] 2026-07-14 hour 18: 163736 events in 4 files, snapshot 1744167602126691681 (task 4151 ms: download 1895 ms overlapping gunzip 221 ms, parse 836 ms, sort 114 ms, write 1617 ms, index 520 ms: 11 candidates, 72792 repo-hours, 48 releases; waiting 540 ms; commit 951 ms)
2026-11-07T05:09:05Z [load_day 2026-07-14] 2026-07-14 hour 19: 165335 events in 4 files, snapshot 3566563164156147759 (task 4026 ms: download 1382 ms overlapping gunzip 204 ms, parse 773 ms, sort 110 ms, write 1597 ms, index 562 ms: 6 candidates, 74298 repo-hours, 42 releases; waiting 540 ms; commit 955 ms)
2026-11-07T05:09:08Z [load_day 2026-07-14] 2026-07-14 hour 20: 163103 events in 4 files, snapshot 7605501725368217430 (task 3959 ms: download 1467 ms overlapping gunzip 222 ms, parse 829 ms, sort 103 ms, write 1493 ms, index 488 ms: 5 candidates, 72451 repo-hours, 50 releases; waiting 518 ms; commit 1022 ms)
2026-11-07T05:09:10Z [load_day 2026-07-14] 2026-07-14 hour 21: 165689 events in 4 files, snapshot 8014247875583533035 (task 4213 ms: download 1174 ms overlapping gunzip 226 ms, parse 814 ms, sort 121 ms, write 1799 ms, index 505 ms: 8 candidates, 73437 repo-hours, 77 releases; waiting 526 ms; commit 927 ms)
2026-11-07T05:09:15Z [load_day 2026-07-14] 2026-07-14 hour 22: 163706 events in 4 files, snapshot 5525668839869277677 (task 4003 ms: download 1409 ms overlapping gunzip 212 ms, parse 798 ms, sort 103 ms, write 1565 ms, index 480 ms: 5 candidates, 71392 repo-hours, 75 releases; waiting 531 ms; commit 2401 ms)
2026-11-07T05:09:16Z [load_day 2026-07-14] 2026-07-14 hour 23: 167247 events in 4 files, snapshot 3634599354874523229 (task 4218 ms: download 1561 ms overlapping gunzip 226 ms, parse 835 ms, sort 108 ms, write 1703 ms, index 482 ms: 7 candidates, 71801 repo-hours, 83 releases; waiting 525 ms; commit 852 ms)
2026-11-07T05:09:23Z [load_day 2026-07-14] 2026-07-14: repo_hour merged from 24 files to 1 (1722156 rows, 7084 ms)
2026-11-07T05:09:24Z [load_day 2026-07-14] 2026-07-14: index committed in 8896 ms (24 + 1 + 24 files)
2026-11-07T05:09:24Z [load_day 2026-07-14] 2026-07-14: 3941220 events in 24 hours
2026-11-07T05:09:24Z [load_day 2026-07-14] attempt 1 succeeded