orcaLog in

Runs · run 392

load_day 2026-07-10, attempt 1 succeeded

Host
4e84322b8c45:77540
Started
2026-11-07T05:12:37Z
Ended
2026-11-07T05:13:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/392/load_day/2026-07-10/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:12:37Z [load_day 2026-07-10] attempt 1 started
2026-11-07T05:12:44Z [load_day 2026-07-10] 2026-07-10 hour 0: 163566 events in 4 files, snapshot 2207923804820747544 (task 3900 ms: download 1571 ms overlapping gunzip 195 ms, parse 759 ms, sort 109 ms, write 1661 ms, index 317 ms: 5 candidates, 46478 repo-hours, 13 releases; waiting 523 ms; commit 915 ms)
2026-11-07T05:12:45Z [load_day 2026-07-10] 2026-07-10 hour 1: 165677 events in 4 files, snapshot 3356547973928578928 (task 3788 ms: download 1399 ms overlapping gunzip 202 ms, parse 805 ms, sort 113 ms, write 1517 ms, index 317 ms: 3 candidates, 50335 repo-hours, 11 releases; waiting 511 ms; commit 1075 ms)
2026-11-07T05:12:48Z [load_day 2026-07-10] 2026-07-10 hour 2: 163082 events in 4 files, snapshot 16077590478263969 (task 3799 ms: download 1305 ms overlapping gunzip 199 ms, parse 764 ms, sort 101 ms, write 1456 ms, index 441 ms: 8 candidates, 62730 repo-hours, 20 releases; waiting 520 ms; commit 965 ms)
2026-11-07T05:12:49Z [load_day 2026-07-10] 2026-07-10 hour 3: 164778 events in 4 files, snapshot 600773866770469012 (task 3705 ms: download 1219 ms overlapping gunzip 212 ms, parse 793 ms, sort 104 ms, write 1412 ms, index 385 ms: 5 candidates, 54129 repo-hours, 11 releases; waiting 517 ms; commit 1007 ms)
2026-11-07T05:12:53Z [load_day 2026-07-10] 2026-07-10 hour 4: 163970 events in 4 files, snapshot 9101342829318291275 (task 3781 ms: download 1204 ms overlapping gunzip 200 ms, parse 763 ms, sort 108 ms, write 1605 ms, index 304 ms: 6 candidates, 46218 repo-hours, 17 releases; waiting 513 ms; commit 969 ms)
2026-11-07T05:12:54Z [load_day 2026-07-10] 2026-07-10 hour 5: 161669 events in 4 files, snapshot 8661380195501281707 (task 3512 ms: download 1146 ms overlapping gunzip 189 ms, parse 729 ms, sort 131 ms, write 1422 ms, index 301 ms: 9 candidates, 43756 repo-hours, 12 releases; waiting 528 ms; commit 1054 ms)
2026-11-07T05:12:57Z [load_day 2026-07-10] 2026-07-10 hour 6: 162366 events in 4 files, snapshot 5198064117166380019 (task 3837 ms: download 1338 ms overlapping gunzip 213 ms, parse 811 ms, sort 108 ms, write 1476 ms, index 296 ms: 3 candidates, 43536 repo-hours, 18 releases; waiting 518 ms; commit 1027 ms)
2026-11-07T05:12:58Z [load_day 2026-07-10] 2026-07-10 hour 7: 164375 events in 4 files, snapshot 2031492828706179983 (task 3722 ms: download 1174 ms overlapping gunzip 195 ms, parse 747 ms, sort 99 ms, write 1586 ms, index 268 ms: 7 candidates, 38943 repo-hours, 5 releases; waiting 520 ms; commit 915 ms)
2026-11-07T05:13:01Z [load_day 2026-07-10] 2026-07-10 hour 8: 160879 events in 4 files, snapshot 2045371344735572971 (task 3091 ms: download 780 ms overlapping gunzip 178 ms, parse 694 ms, sort 109 ms, write 1372 ms, index 260 ms: 0 candidates, 40596 repo-hours, 12 releases; waiting 181 ms; commit 964 ms)
2026-11-07T05:13:02Z [load_day 2026-07-10] 2026-07-10 hour 9: 162680 events in 4 files, snapshot 8564244054679394551 (task 3607 ms: download 1471 ms overlapping gunzip 189 ms, parse 732 ms, sort 99 ms, write 1436 ms, index 268 ms: 3 candidates, 37896 repo-hours, 8 releases; waiting 527 ms; commit 1016 ms)
2026-11-07T05:13:05Z [load_day 2026-07-10] 2026-07-10 hour 10: 163486 events in 4 files, snapshot 4438561363341146143 (task 3753 ms: download 1333 ms overlapping gunzip 191 ms, parse 762 ms, sort 99 ms, write 1536 ms, index 315 ms: 5 candidates, 40218 repo-hours, 19 releases; waiting 523 ms; commit 949 ms)
2026-11-07T05:13:07Z [load_day 2026-07-10] 2026-07-10 hour 11: 162569 events in 4 files, snapshot 3979926851570506166 (task 3613 ms: download 1341 ms overlapping gunzip 190 ms, parse 724 ms, sort 96 ms, write 1472 ms, index 315 ms: 4 candidates, 42192 repo-hours, 10 releases; waiting 513 ms; commit 1092 ms)
2026-11-07T05:13:09Z [load_day 2026-07-10] 2026-07-10 hour 12: 163179 events in 4 files, snapshot 3961890228755687555 (task 3575 ms: download 1846 ms overlapping gunzip 190 ms, parse 759 ms, sort 107 ms, write 1419 ms, index 262 ms: 2 candidates, 36995 repo-hours, 10 releases; waiting 523 ms; commit 896 ms)
2026-11-07T05:13:11Z [load_day 2026-07-10] 2026-07-10 hour 13: 162282 events in 4 files, snapshot 3406949518750666955 (task 3583 ms: download 1195 ms overlapping gunzip 190 ms, parse 727 ms, sort 100 ms, write 1440 ms, index 281 ms: 1 candidates, 40659 repo-hours, 16 releases; waiting 529 ms; commit 1053 ms)
2026-11-07T05:13:14Z [load_day 2026-07-10] 2026-07-10 hour 14: 161486 events in 4 files, snapshot 7037919399095025634 (task 3650 ms: download 1248 ms overlapping gunzip 193 ms, parse 776 ms, sort 98 ms, write 1416 ms, index 313 ms: 3 candidates, 43786 repo-hours, 10 releases; waiting 524 ms; commit 1205 ms)
2026-11-07T05:13:15Z [load_day 2026-07-10] 2026-07-10 hour 15: 168686 events in 4 files, snapshot 7112777428303468496 (task 3663 ms: download 1349 ms overlapping gunzip 197 ms, parse 750 ms, sort 105 ms, write 1489 ms, index 294 ms: 4 candidates, 39916 repo-hours, 14 releases; waiting 546 ms; commit 970 ms)
2026-11-07T05:13:18Z [load_day 2026-07-10] 2026-07-10 hour 16: 164266 events in 4 files, snapshot 2743990446804626619 (task 3705 ms: download 1427 ms overlapping gunzip 199 ms, parse 761 ms, sort 104 ms, write 1492 ms, index 313 ms: 6 candidates, 40807 repo-hours, 32 releases; waiting 537 ms; commit 1018 ms)
2026-11-07T05:13:19Z [load_day 2026-07-10] 2026-07-10 hour 17: 167550 events in 4 files, snapshot 7063155620893144799 (task 3716 ms: download 1695 ms overlapping gunzip 210 ms, parse 792 ms, sort 103 ms, write 1478 ms, index 315 ms: 5 candidates, 47646 repo-hours, 37 releases; waiting 530 ms; commit 991 ms)
2026-11-07T05:13:23Z [load_day 2026-07-10] 2026-07-10 hour 18: 164876 events in 4 files, snapshot 4421491868043624850 (task 3612 ms: download 1449 ms overlapping gunzip 192 ms, parse 754 ms, sort 102 ms, write 1424 ms, index 316 ms: 4 candidates, 45832 repo-hours, 19 releases; waiting 536 ms; commit 1250 ms)
2026-11-07T05:13:24Z [load_day 2026-07-10] 2026-07-10 hour 19: 165169 events in 4 files, snapshot 3053701873605710811 (task 3648 ms: download 1211 ms overlapping gunzip 199 ms, parse 760 ms, sort 100 ms, write 1444 ms, index 322 ms: 6 candidates, 50104 repo-hours, 28 releases; waiting 522 ms; commit 1030 ms)
2026-11-07T05:13:27Z [load_day 2026-07-10] 2026-07-10 hour 20: 167273 events in 4 files, snapshot 3165989325447319047 (task 3865 ms: download 1749 ms overlapping gunzip 195 ms, parse 757 ms, sort 103 ms, write 1534 ms, index 377 ms: 6 candidates, 48521 repo-hours, 11 releases; waiting 530 ms; commit 849 ms)
2026-11-07T05:13:28Z [load_day 2026-07-10] 2026-07-10 hour 21: 164182 events in 4 files, snapshot 103554254034125794 (task 3749 ms: download 1144 ms overlapping gunzip 190 ms, parse 731 ms, sort 104 ms, write 1432 ms, index 306 ms: 4 candidates, 46358 repo-hours, 13 releases; waiting 525 ms; commit 993 ms)
2026-11-07T05:13:31Z [load_day 2026-07-10] 2026-07-10 hour 22: 165028 events in 4 files, snapshot 3630533347274630585 (task 3288 ms: download 930 ms overlapping gunzip 188 ms, parse 718 ms, sort 102 ms, write 1431 ms, index 308 ms: 5 candidates, 43662 repo-hours, 11 releases; waiting 235 ms; commit 1106 ms)
2026-11-07T05:13:32Z [load_day 2026-07-10] 2026-07-10 hour 23: 168185 events in 4 files, snapshot 7359391594311723831 (task 3691 ms: download 2013 ms overlapping gunzip 204 ms, parse 777 ms, sort 100 ms, write 1515 ms, index 286 ms: 5 candidates, 41606 repo-hours, 12 releases; waiting 500 ms; commit 950 ms)
2026-11-07T05:13:37Z [load_day 2026-07-10] 2026-07-10: repo_hour merged from 24 files to 1 (1072919 rows, 5006 ms)
2026-11-07T05:13:39Z [load_day 2026-07-10] 2026-07-10: index committed in 6989 ms (23 + 1 + 24 files)
2026-11-07T05:13:39Z [load_day 2026-07-10] 2026-07-10: 3941259 events in 24 hours
2026-11-07T05:13:39Z [load_day 2026-07-10] attempt 1 succeeded