orcaLog in

Runs · run 395

load_day 2026-07-09, attempt 1 succeeded

Host
4e84322b8c45:78396
Started
2026-11-07T05:13:40Z
Ended
2026-11-07T05:14:44Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/395/load_day/2026-07-09/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:13:40Z [load_day 2026-07-09] attempt 1 started
2026-11-07T05:13:48Z [load_day 2026-07-09] 2026-07-09 hour 0: 168270 events in 4 files, snapshot 7953382740901020757 (task 3920 ms: download 1196 ms overlapping gunzip 207 ms, parse 795 ms, sort 110 ms, write 1630 ms, index 413 ms: 4 candidates, 64150 repo-hours, 9 releases; waiting 486 ms; commit 997 ms)
2026-11-07T05:13:50Z [load_day 2026-07-09] 2026-07-09 hour 1: 168165 events in 4 files, snapshot 7202444292662652671 (task 3862 ms: download 1465 ms overlapping gunzip 190 ms, parse 767 ms, sort 106 ms, write 1497 ms, index 450 ms: 4 candidates, 69403 repo-hours, 20 releases; waiting 509 ms; commit 2142 ms)
2026-11-07T05:13:52Z [load_day 2026-07-09] 2026-07-09 hour 2: 169974 events in 4 files, snapshot 174858737057661105 (task 3871 ms: download 1157 ms overlapping gunzip 215 ms, parse 832 ms, sort 114 ms, write 1537 ms, index 438 ms: 3 candidates, 67506 repo-hours, 13 releases; waiting 518 ms; commit 939 ms)
2026-11-07T05:13:53Z [load_day 2026-07-09] 2026-07-09 hour 3: 166063 events in 4 files, snapshot 4962972414757673702 (task 3684 ms: download 1504 ms overlapping gunzip 188 ms, parse 751 ms, sort 99 ms, write 1395 ms, index 422 ms: 7 candidates, 59066 repo-hours, 16 releases; waiting 514 ms; commit 786 ms)
2026-11-07T05:13:56Z [load_day 2026-07-09] 2026-07-09 hour 4: 167266 events in 4 files, snapshot 4030854704747146635 (task 3657 ms: download 1167 ms overlapping gunzip 197 ms, parse 746 ms, sort 101 ms, write 1514 ms, index 328 ms: 0 candidates, 53036 repo-hours, 18 releases; waiting 537 ms; commit 1003 ms)
2026-11-07T05:13:57Z [load_day 2026-07-09] 2026-07-09 hour 5: 167383 events in 4 files, snapshot 8499997789185232576 (task 3650 ms: download 1375 ms overlapping gunzip 192 ms, parse 765 ms, sort 107 ms, write 1410 ms, index 318 ms: 4 candidates, 47264 repo-hours, 20 releases; waiting 524 ms; commit 1019 ms)
2026-11-07T05:14:01Z [load_day 2026-07-09] 2026-07-09 hour 6: 171563 events in 4 files, snapshot 5658498447478718253 (task 3813 ms: download 1275 ms overlapping gunzip 198 ms, parse 770 ms, sort 102 ms, write 1555 ms, index 389 ms: 11 candidates, 63681 repo-hours, 20 releases; waiting 511 ms; commit 1102 ms)
2026-11-07T05:14:02Z [load_day 2026-07-09] 2026-07-09 hour 7: 167776 events in 4 files, snapshot 8762192278708705550 (task 3654 ms: download 1465 ms overlapping gunzip 198 ms, parse 752 ms, sort 112 ms, write 1444 ms, index 350 ms: 5 candidates, 55208 repo-hours, 18 releases; waiting 526 ms; commit 935 ms)
2026-11-07T05:14:05Z [load_day 2026-07-09] 2026-07-09 hour 8: 165575 events in 4 files, snapshot 2834067449225654441 (task 3627 ms: download 1295 ms overlapping gunzip 193 ms, parse 766 ms, sort 100 ms, write 1405 ms, index 338 ms: 7 candidates, 52673 repo-hours, 11 releases; waiting 523 ms; commit 885 ms)
2026-11-07T05:14:06Z [load_day 2026-07-09] 2026-07-09 hour 9: 168080 events in 4 files, snapshot 5595365413687635202 (task 3510 ms: download 969 ms overlapping gunzip 189 ms, parse 758 ms, sort 101 ms, write 1503 ms, index 318 ms: 4 candidates, 49130 repo-hours, 15 releases; waiting 368 ms; commit 902 ms)
2026-11-07T05:14:09Z [load_day 2026-07-09] 2026-07-09 hour 10: 164129 events in 4 files, snapshot 6045652756265805522 (task 3840 ms: download 1280 ms overlapping gunzip 216 ms, parse 827 ms, sort 104 ms, write 1536 ms, index 334 ms: 4 candidates, 51100 repo-hours, 15 releases; waiting 510 ms; commit 960 ms)
2026-11-07T05:14:10Z [load_day 2026-07-09] 2026-07-09 hour 11: 164078 events in 4 files, snapshot 1333524818528129033 (task 3596 ms: download 1264 ms overlapping gunzip 191 ms, parse 728 ms, sort 100 ms, write 1388 ms, index 339 ms: 7 candidates, 50311 repo-hours, 20 releases; waiting 528 ms; commit 820 ms)
2026-11-07T05:14:14Z [load_day 2026-07-09] 2026-07-09 hour 12: 164478 events in 4 files, snapshot 778471595063021339 (task 3720 ms: download 1342 ms overlapping gunzip 193 ms, parse 725 ms, sort 99 ms, write 1484 ms, index 373 ms: 5 candidates, 55092 repo-hours, 12 releases; waiting 559 ms; commit 1116 ms)
2026-11-07T05:14:15Z [load_day 2026-07-09] 2026-07-09 hour 13: 165477 events in 4 files, snapshot 6101458738517074659 (task 3915 ms: download 1395 ms overlapping gunzip 200 ms, parse 756 ms, sort 108 ms, write 1477 ms, index 353 ms: 5 candidates, 52695 repo-hours, 9 releases; waiting 581 ms; commit 1085 ms)
2026-11-07T05:14:19Z [load_day 2026-07-09] 2026-07-09 hour 14: 169366 events in 4 files, snapshot 2283894713946977721 (task 4005 ms: download 1364 ms overlapping gunzip 203 ms, parse 763 ms, sort 110 ms, write 1680 ms, index 412 ms: 5 candidates, 62630 repo-hours, 22 releases; waiting 542 ms; commit 1061 ms)
2026-11-07T05:14:20Z [load_day 2026-07-09] 2026-07-09 hour 15: 161970 events in 4 files, snapshot 8663299917895178524 (task 3701 ms: download 1285 ms overlapping gunzip 187 ms, parse 730 ms, sort 107 ms, write 1433 ms, index 403 ms: 3 candidates, 61966 repo-hours, 11 releases; waiting 526 ms; commit 911 ms)
2026-11-07T05:14:23Z [load_day 2026-07-09] 2026-07-09 hour 16: 165559 events in 4 files, snapshot 257585893194803614 (task 3626 ms: download 1216 ms overlapping gunzip 197 ms, parse 762 ms, sort 107 ms, write 1386 ms, index 337 ms: 6 candidates, 50721 repo-hours, 10 releases; waiting 523 ms; commit 950 ms)
2026-11-07T05:14:24Z [load_day 2026-07-09] 2026-07-09 hour 17: 169090 events in 4 files, snapshot 8440162163086662716 (task 3821 ms: download 1865 ms overlapping gunzip 205 ms, parse 771 ms, sort 105 ms, write 1523 ms, index 353 ms: 12 candidates, 51513 repo-hours, 25 releases; waiting 541 ms; commit 995 ms)
2026-11-07T05:14:27Z [load_day 2026-07-09] 2026-07-09 hour 18: 163369 events in 4 files, snapshot 5951316617289790448 (task 3430 ms: download 1105 ms overlapping gunzip 189 ms, parse 724 ms, sort 106 ms, write 1449 ms, index 309 ms: 8 candidates, 46264 repo-hours, 11 releases; waiting 361 ms; commit 837 ms)
2026-11-07T05:14:28Z [load_day 2026-07-09] 2026-07-09 hour 19: 162182 events in 4 files, snapshot 3369568372776838380 (task 3706 ms: download 1386 ms overlapping gunzip 185 ms, parse 728 ms, sort 104 ms, write 1561 ms, index 307 ms: 7 candidates, 47804 repo-hours, 18 releases; waiting 530 ms; commit 978 ms)
2026-11-07T05:14:31Z [load_day 2026-07-09] 2026-07-09 hour 20: 166377 events in 4 files, snapshot 3827002134627161248 (task 3881 ms: download 1345 ms overlapping gunzip 228 ms, parse 856 ms, sort 137 ms, write 1546 ms, index 306 ms: 8 candidates, 46783 repo-hours, 16 releases; waiting 521 ms; commit 1189 ms)
2026-11-07T05:14:33Z [load_day 2026-07-09] 2026-07-09 hour 21: 157077 events in 4 files, snapshot 2053072439894904090 (task 3636 ms: download 1125 ms overlapping gunzip 183 ms, parse 701 ms, sort 103 ms, write 1345 ms, index 567 ms: 4 candidates, 45339 repo-hours, 6 releases; waiting 521 ms; commit 1236 ms)
2026-11-07T05:14:36Z [load_day 2026-07-09] 2026-07-09 hour 22: 165965 events in 4 files, snapshot 3757562288364348627 (task 3793 ms: download 1689 ms overlapping gunzip 209 ms, parse 808 ms, sort 124 ms, write 1525 ms, index 292 ms: 6 candidates, 46080 repo-hours, 15 releases; waiting 510 ms; commit 959 ms)
2026-11-07T05:14:37Z [load_day 2026-07-09] 2026-07-09 hour 23: 166170 events in 4 files, snapshot 556972045447473202 (task 3817 ms: download 1349 ms overlapping gunzip 198 ms, parse 755 ms, sort 113 ms, write 1429 ms, index 369 ms: 9 candidates, 46494 repo-hours, 20 releases; waiting 530 ms; commit 925 ms)
2026-11-07T05:14:43Z [load_day 2026-07-09] 2026-07-09: repo_hour merged from 24 files to 1 (1295909 rows, 5752 ms)
2026-11-07T05:14:44Z [load_day 2026-07-09] 2026-07-09: index committed in 7228 ms (23 + 1 + 24 files)
2026-11-07T05:14:44Z [load_day 2026-07-09] 2026-07-09: 3985402 events in 24 hours
2026-11-07T05:14:44Z [load_day 2026-07-09] attempt 1 succeeded