orcaLog in

Runs · run 179

load_day 2026-09-19, attempt 1 succeeded

Host
4e84322b8c45:30777
Started
2026-11-07T03:56:31Z
Ended
2026-11-07T03:57:28Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/179/load_day/2026-09-19/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:56:31Z [load_day 2026-09-19] attempt 1 started
2026-11-07T03:56:38Z [load_day 2026-09-19] 2026-09-19 hour 0: 110768 events in 3 files, snapshot 3813340096526217466 (task 3404 ms: download 1359 ms overlapping gunzip 163 ms, parse 604 ms, sort 88 ms, write 1398 ms, index 312 ms: 6 candidates, 49412 repo-hours, 71 releases; waiting 533 ms; commit 801 ms)
2026-11-07T03:56:38Z [load_day 2026-09-19] 2026-09-19 hour 1: 111550 events in 3 files, snapshot 61620637945424911 (task 3469 ms: download 1098 ms overlapping gunzip 163 ms, parse 590 ms, sort 87 ms, write 1445 ms, index 316 ms: 12 candidates, 49117 repo-hours, 80 releases; waiting 518 ms; commit 734 ms)
2026-11-07T03:56:42Z [load_day 2026-09-19] 2026-09-19 hour 2: 112086 events in 3 files, snapshot 678405668697261164 (task 3371 ms: download 1705 ms overlapping gunzip 170 ms, parse 598 ms, sort 73 ms, write 1290 ms, index 384 ms: 9 candidates, 55679 repo-hours, 89 releases; waiting 520 ms; commit 800 ms)
2026-11-07T03:56:43Z [load_day 2026-09-19] 2026-09-19 hour 3: 111334 events in 3 files, snapshot 3165887991527329266 (task 3298 ms: download 1123 ms overlapping gunzip 169 ms, parse 573 ms, sort 75 ms, write 1326 ms, index 338 ms: 7 candidates, 53776 repo-hours, 80 releases; waiting 526 ms; commit 736 ms)
2026-11-07T03:56:46Z [load_day 2026-09-19] 2026-09-19 hour 4: 111524 events in 3 files, snapshot 1597296498015831985 (task 3268 ms: download 1157 ms overlapping gunzip 164 ms, parse 639 ms, sort 82 ms, write 1205 ms, index 323 ms: 11 candidates, 49396 repo-hours, 57 releases; waiting 538 ms; commit 779 ms)
2026-11-07T03:56:46Z [load_day 2026-09-19] 2026-09-19 hour 5: 115565 events in 3 files, snapshot 7658810704155530352 (task 2800 ms: download 812 ms overlapping gunzip 168 ms, parse 573 ms, sort 73 ms, write 1182 ms, index 286 ms: 3 candidates, 46433 repo-hours, 65 releases; waiting 186 ms; commit 657 ms)
2026-11-07T03:56:50Z [load_day 2026-09-19] 2026-09-19 hour 6: 117394 events in 3 files, snapshot 5682949112225557295 (task 3271 ms: download 1345 ms overlapping gunzip 160 ms, parse 587 ms, sort 80 ms, write 1272 ms, index 315 ms: 3 candidates, 47859 repo-hours, 49 releases; waiting 525 ms; commit 805 ms)
2026-11-07T03:56:50Z [load_day 2026-09-19] 2026-09-19 hour 7: 111575 events in 3 files, snapshot 7559616175559671244 (task 3211 ms: download 1201 ms overlapping gunzip 158 ms, parse 550 ms, sort 80 ms, write 1259 ms, index 337 ms: 3 candidates, 48612 repo-hours, 83 releases; waiting 530 ms; commit 589 ms)
2026-11-07T03:56:53Z [load_day 2026-09-19] 2026-09-19 hour 8: 112032 events in 3 files, snapshot 2841556943100619105 (task 3029 ms: download 1130 ms overlapping gunzip 171 ms, parse 575 ms, sort 80 ms, write 1251 ms, index 329 ms: 4 candidates, 50100 repo-hours, 106 releases; waiting 394 ms; commit 688 ms)
2026-11-07T03:56:54Z [load_day 2026-09-19] 2026-09-19 hour 9: 115213 events in 3 files, snapshot 4726010213367565321 (task 3133 ms: download 1274 ms overlapping gunzip 168 ms, parse 594 ms, sort 75 ms, write 1159 ms, index 334 ms: 4 candidates, 51409 repo-hours, 101 releases; waiting 449 ms; commit 797 ms)
2026-11-07T03:56:57Z [load_day 2026-09-19] 2026-09-19 hour 10: 111097 events in 3 files, snapshot 7934638811439382403 (task 3052 ms: download 1221 ms overlapping gunzip 158 ms, parse 554 ms, sort 73 ms, write 1116 ms, index 313 ms: 6 candidates, 50210 repo-hours, 82 releases; waiting 538 ms; commit 751 ms)
2026-11-07T03:56:58Z [load_day 2026-09-19] 2026-09-19 hour 11: 117114 events in 3 files, snapshot 1283839036510701290 (task 3214 ms: download 1132 ms overlapping gunzip 203 ms, parse 687 ms, sort 78 ms, write 1119 ms, index 316 ms: 8 candidates, 51295 repo-hours, 73 releases; waiting 513 ms; commit 761 ms)
2026-11-07T03:57:00Z [load_day 2026-09-19] 2026-09-19 hour 12: 120276 events in 3 files, snapshot 7245055390182056582 (task 3353 ms: download 1185 ms overlapping gunzip 197 ms, parse 646 ms, sort 87 ms, write 1229 ms, index 381 ms: 3 candidates, 55744 repo-hours, 69 releases; waiting 523 ms; commit 649 ms)
2026-11-07T03:57:02Z [load_day 2026-09-19] 2026-09-19 hour 13: 117104 events in 3 files, snapshot 8627108074305424830 (task 3269 ms: download 1214 ms overlapping gunzip 168 ms, parse 602 ms, sort 74 ms, write 1178 ms, index 365 ms: 6 candidates, 58513 repo-hours, 96 releases; waiting 516 ms; commit 852 ms)
2026-11-07T03:57:05Z [load_day 2026-09-19] 2026-09-19 hour 14: 121488 events in 3 files, snapshot 5229932319454785711 (task 3524 ms: download 1167 ms overlapping gunzip 170 ms, parse 629 ms, sort 84 ms, write 1314 ms, index 360 ms: 12 candidates, 59908 repo-hours, 91 releases; waiting 605 ms; commit 978 ms)
2026-11-07T03:57:05Z [load_day 2026-09-19] 2026-09-19 hour 15: 120341 events in 3 files, snapshot 2415584437705790822 (task 3314 ms: download 1211 ms overlapping gunzip 167 ms, parse 610 ms, sort 78 ms, write 1161 ms, index 466 ms: 13 candidates, 66222 repo-hours, 63 releases; waiting 533 ms; commit 619 ms)
2026-11-07T03:57:08Z [load_day 2026-09-19] 2026-09-19 hour 16: 120022 events in 3 files, snapshot 206078012656559130 (task 3571 ms: download 1404 ms overlapping gunzip 169 ms, parse 605 ms, sort 79 ms, write 1302 ms, index 433 ms: 11 candidates, 57251 repo-hours, 65 releases; waiting 683 ms; commit 619 ms)
2026-11-07T03:57:09Z [load_day 2026-09-19] 2026-09-19 hour 17: 117538 events in 3 files, snapshot 4459447377389626353 (task 3313 ms: download 1268 ms overlapping gunzip 176 ms, parse 631 ms, sort 90 ms, write 1309 ms, index 371 ms: 10 candidates, 57454 repo-hours, 81 releases; waiting 526 ms; commit 716 ms)
2026-11-07T03:57:12Z [load_day 2026-09-19] 2026-09-19 hour 18: 117434 events in 3 files, snapshot 727708510229310837 (task 3441 ms: download 1268 ms overlapping gunzip 176 ms, parse 617 ms, sort 72 ms, write 1466 ms, index 329 ms: 9 candidates, 51424 repo-hours, 67 releases; waiting 522 ms; commit 639 ms)
2026-11-07T03:57:13Z [load_day 2026-09-19] 2026-09-19 hour 19: 117919 events in 3 files, snapshot 2401461540021700406 (task 3410 ms: download 1111 ms overlapping gunzip 174 ms, parse 598 ms, sort 72 ms, write 1418 ms, index 316 ms: 9 candidates, 50320 repo-hours, 88 releases; waiting 549 ms; commit 578 ms)
2026-11-07T03:57:17Z [load_day 2026-09-19] 2026-09-19 hour 20: 123560 events in 3 files, snapshot 4485307205346402205 (task 3244 ms: download 1077 ms overlapping gunzip 178 ms, parse 647 ms, sort 81 ms, write 1232 ms, index 299 ms: 10 candidates, 44772 repo-hours, 55 releases; waiting 555 ms; commit 709 ms)
2026-11-07T03:57:17Z [load_day 2026-09-19] 2026-09-19 hour 21: 124165 events in 3 files, snapshot 666511548520854761 (task 3137 ms: download 1241 ms overlapping gunzip 174 ms, parse 589 ms, sort 78 ms, write 1184 ms, index 284 ms: 11 candidates, 43985 repo-hours, 63 releases; waiting 551 ms; commit 823 ms)
2026-11-07T03:57:20Z [load_day 2026-09-19] 2026-09-19 hour 22: 115700 events in 3 files, snapshot 859749431321427175 (task 3096 ms: download 1185 ms overlapping gunzip 161 ms, parse 569 ms, sort 80 ms, write 1157 ms, index 302 ms: 7 candidates, 44562 repo-hours, 60 releases; waiting 531 ms; commit 706 ms)
2026-11-07T03:57:21Z [load_day 2026-09-19] 2026-09-19 hour 23: 109877 events in 3 files, snapshot 7934083204285597742 (task 3199 ms: download 1223 ms overlapping gunzip 160 ms, parse 553 ms, sort 70 ms, write 1220 ms, index 277 ms: 9 candidates, 42221 repo-hours, 71 releases; waiting 542 ms; commit 737 ms)
2026-11-07T03:57:26Z [load_day 2026-09-19] 2026-09-19: repo_hour merged from 24 files to 1 (1235674 rows, 5401 ms)
2026-11-07T03:57:28Z [load_day 2026-09-19] 2026-09-19: index committed in 6994 ms (24 + 1 + 24 files)
2026-11-07T03:57:28Z [load_day 2026-09-19] 2026-09-19: 2782676 events in 24 hours
2026-11-07T03:57:28Z [load_day 2026-09-19] attempt 1 succeeded