orcaLog in

Runs · run 575

load_day 2026-05-10, attempt 1 succeeded

Host
4e84322b8c45:128409
Started
2026-11-07T06:34:46Z
Ended
2026-11-07T06:36:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/575/load_day/2026-05-10/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:34:46Z [load_day 2026-05-10] attempt 1 started
2026-11-07T06:34:56Z [load_day 2026-05-10] 2026-05-10 hour 0: 146227 events in 3 files, snapshot 8494601330708314925 (task 6232 ms: download 2134 ms overlapping gunzip 434 ms, parse 1475 ms, sort 140 ms, write 2995 ms, index 382 ms: 7 candidates, 62975 repo-hours, 954 releases; waiting 495 ms; commit 1068 ms)
2026-11-07T06:34:57Z [load_day 2026-05-10] 2026-05-10 hour 1: 143566 events in 3 files, snapshot 4558481511842592075 (task 6087 ms: download 1875 ms overlapping gunzip 355 ms, parse 1206 ms, sort 133 ms, write 3070 ms, index 427 ms: 6 candidates, 68774 repo-hours, 788 releases; waiting 554 ms; commit 1366 ms)
2026-11-07T06:35:02Z [load_day 2026-05-10] 2026-05-10 hour 2: 149200 events in 3 files, snapshot 6270260316931041269 (task 5472 ms: download 1722 ms overlapping gunzip 328 ms, parse 1103 ms, sort 125 ms, write 2619 ms, index 535 ms: 3 candidates, 77644 repo-hours, 663 releases; waiting 447 ms; commit 1473 ms)
2026-11-07T06:35:04Z [load_day 2026-05-10] 2026-05-10 hour 3: 145112 events in 3 files, snapshot 4397868060996551656 (task 5281 ms: download 1891 ms overlapping gunzip 332 ms, parse 1083 ms, sort 113 ms, write 2417 ms, index 477 ms: 7 candidates, 72965 repo-hours, 725 releases; waiting 543 ms; commit 1285 ms)
2026-11-07T06:35:08Z [load_day 2026-05-10] 2026-05-10 hour 4: 145658 events in 3 files, snapshot 2281292503917933299 (task 5313 ms: download 1975 ms overlapping gunzip 353 ms, parse 1198 ms, sort 166 ms, write 2277 ms, index 456 ms: 3 candidates, 66088 repo-hours, 746 releases; waiting 502 ms; commit 1115 ms)
2026-11-07T06:35:09Z [load_day 2026-05-10] 2026-05-10 hour 5: 146295 events in 3 files, snapshot 5731437028771370248 (task 5022 ms: download 1724 ms overlapping gunzip 347 ms, parse 1159 ms, sort 109 ms, write 2461 ms, index 430 ms: 8 candidates, 65649 repo-hours, 749 releases; waiting 303 ms; commit 1062 ms)
2026-11-07T06:35:15Z [load_day 2026-05-10] 2026-05-10 hour 6: 146353 events in 3 files, snapshot 9078777332202326954 (task 5648 ms: download 2050 ms overlapping gunzip 387 ms, parse 1190 ms, sort 138 ms, write 2325 ms, index 449 ms: 6 candidates, 66555 repo-hours, 772 releases; waiting 788 ms; commit 1137 ms)
2026-11-07T06:35:16Z [load_day 2026-05-10] 2026-05-10 hour 7: 147427 events in 3 files, snapshot 1943351472085086669 (task 5088 ms: download 1735 ms overlapping gunzip 381 ms, parse 1215 ms, sort 114 ms, write 2161 ms, index 452 ms: 7 candidates, 72176 repo-hours, 715 releases; waiting 549 ms; commit 1158 ms)
2026-11-07T06:35:21Z [load_day 2026-05-10] 2026-05-10 hour 8: 148887 events in 3 files, snapshot 3831497494588262816 (task 5470 ms: download 2141 ms overlapping gunzip 348 ms, parse 1104 ms, sort 135 ms, write 2357 ms, index 494 ms: 4 candidates, 74451 repo-hours, 705 releases; waiting 610 ms; commit 1089 ms)
2026-11-07T06:35:22Z [load_day 2026-05-10] 2026-05-10 hour 9: 147585 events in 3 files, snapshot 8097595723960249734 (task 5377 ms: download 2298 ms overlapping gunzip 337 ms, parse 1093 ms, sort 128 ms, write 2413 ms, index 480 ms: 2 candidates, 72442 repo-hours, 710 releases; waiting 593 ms; commit 1062 ms)
2026-11-07T06:35:27Z [load_day 2026-05-10] 2026-05-10 hour 10: 148510 events in 3 files, snapshot 1893361374419854470 (task 5258 ms: download 2115 ms overlapping gunzip 353 ms, parse 1191 ms, sort 155 ms, write 2119 ms, index 487 ms: 3 candidates, 72100 repo-hours, 696 releases; waiting 650 ms; commit 1105 ms)
2026-11-07T06:35:28Z [load_day 2026-05-10] 2026-05-10 hour 11: 150665 events in 4 files, snapshot 8015034283482563707 (task 5164 ms: download 2024 ms overlapping gunzip 319 ms, parse 1070 ms, sort 112 ms, write 2283 ms, index 528 ms: 7 candidates, 76369 repo-hours, 643 releases; waiting 543 ms; commit 1092 ms)
2026-11-07T06:35:33Z [load_day 2026-05-10] 2026-05-10 hour 12: 150982 events in 4 files, snapshot 6078534009852179291 (task 5079 ms: download 1835 ms overlapping gunzip 324 ms, parse 1066 ms, sort 139 ms, write 2146 ms, index 521 ms: 7 candidates, 79288 repo-hours, 635 releases; waiting 543 ms; commit 1148 ms)
2026-11-07T06:35:34Z [load_day 2026-05-10] 2026-05-10 hour 13: 160011 events in 4 files, snapshot 4210354269913094171 (task 5204 ms: download 1621 ms overlapping gunzip 295 ms, parse 1013 ms, sort 123 ms, write 2381 ms, index 559 ms: 13 candidates, 90229 repo-hours, 545 releases; waiting 536 ms; commit 1126 ms)
2026-11-07T06:35:38Z [load_day 2026-05-10] 2026-05-10 hour 14: 155186 events in 4 files, snapshot 8651037750888517664 (task 4863 ms: download 1799 ms overlapping gunzip 282 ms, parse 998 ms, sort 113 ms, write 2127 ms, index 524 ms: 9 candidates, 77640 repo-hours, 446 releases; waiting 533 ms; commit 1405 ms)
2026-11-07T06:35:39Z [load_day 2026-05-10] 2026-05-10 hour 15: 152911 events in 4 files, snapshot 2264297691646585895 (task 5017 ms: download 1987 ms overlapping gunzip 322 ms, parse 1094 ms, sort 109 ms, write 2069 ms, index 572 ms: 8 candidates, 77626 repo-hours, 596 releases; waiting 548 ms; commit 1167 ms)
2026-11-07T06:35:44Z [load_day 2026-05-10] 2026-05-10 hour 16: 154141 events in 4 files, snapshot 7532283681661872408 (task 5183 ms: download 1742 ms overlapping gunzip 307 ms, parse 1051 ms, sort 121 ms, write 2361 ms, index 551 ms: 9 candidates, 79179 repo-hours, 473 releases; waiting 529 ms; commit 1275 ms)
2026-11-07T06:35:45Z [load_day 2026-05-10] 2026-05-10 hour 17: 150766 events in 4 files, snapshot 1911006294977783400 (task 5053 ms: download 1689 ms overlapping gunzip 320 ms, parse 1064 ms, sort 114 ms, write 2236 ms, index 515 ms: 9 candidates, 77802 repo-hours, 611 releases; waiting 537 ms; commit 1115 ms)
2026-11-07T06:35:50Z [load_day 2026-05-10] 2026-05-10 hour 18: 154630 events in 4 files, snapshot 6077983059470382042 (task 5512 ms: download 2026 ms overlapping gunzip 331 ms, parse 1110 ms, sort 125 ms, write 2484 ms, index 554 ms: 5 candidates, 76094 repo-hours, 578 releases; waiting 574 ms; commit 1119 ms)
2026-11-07T06:35:51Z [load_day 2026-05-10] 2026-05-10 hour 19: 148909 events in 3 files, snapshot 5250493341663456920 (task 5276 ms: download 1995 ms overlapping gunzip 313 ms, parse 1019 ms, sort 123 ms, write 2281 ms, index 488 ms: 7 candidates, 72957 repo-hours, 657 releases; waiting 555 ms; commit 1191 ms)
2026-11-07T06:35:56Z [load_day 2026-05-10] 2026-05-10 hour 20: 152150 events in 4 files, snapshot 962728317371342297 (task 5319 ms: download 2351 ms overlapping gunzip 401 ms, parse 1292 ms, sort 142 ms, write 2138 ms, index 494 ms: 7 candidates, 73779 repo-hours, 618 releases; waiting 523 ms; commit 1145 ms)
2026-11-07T06:35:57Z [load_day 2026-05-10] 2026-05-10 hour 21: 149839 events in 3 files, snapshot 1579752042791395248 (task 5134 ms: download 1581 ms overlapping gunzip 345 ms, parse 1134 ms, sort 140 ms, write 2378 ms, index 448 ms: 7 candidates, 71183 repo-hours, 731 releases; waiting 406 ms; commit 1064 ms)
2026-11-07T06:36:03Z [load_day 2026-05-10] 2026-05-10 hour 22: 148515 events in 3 files, snapshot 7104041385579748806 (task 5501 ms: download 1989 ms overlapping gunzip 365 ms, parse 1262 ms, sort 146 ms, write 2404 ms, index 485 ms: 2 candidates, 68409 repo-hours, 733 releases; waiting 537 ms; commit 1341 ms)
2026-11-07T06:36:04Z [load_day 2026-05-10] 2026-05-10 hour 23: 145830 events in 3 files, snapshot 8117323257291751912 (task 5445 ms: download 1956 ms overlapping gunzip 340 ms, parse 1137 ms, sort 126 ms, write 2467 ms, index 444 ms: 4 candidates, 67240 repo-hours, 736 releases; waiting 539 ms; commit 1061 ms)
2026-11-07T06:36:11Z [load_day 2026-05-10] 2026-05-10: repo_hour merged from 24 files to 1 (1759614 rows, 7057 ms)
2026-11-07T06:36:13Z [load_day 2026-05-10] 2026-05-10: index committed in 8804 ms (24 + 1 + 24 files)
2026-11-07T06:36:13Z [load_day 2026-05-10] 2026-05-10: 3589355 events in 24 hours
2026-11-07T06:36:13Z [load_day 2026-05-10] attempt 1 succeeded