orcaLog in

Runs · run 32

load_day 2023-01-11, attempt 1 succeeded

Host
4e84322b8c45:11191
Started
2026-11-07T03:17:04Z
Ended
2026-11-07T03:20:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/32/load_day/2023-01-11/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:17:04Z [load_day 2023-01-11] attempt 1 started
2026-11-07T03:17:20Z [load_day 2023-01-11] 2023-01-11 hour 0: 154909 events in 4 files, snapshot 6635549102059249553 (task 13259 ms: download 5013 ms overlapping gunzip 996 ms, parse 4444 ms, sort 393 ms, write 5087 ms, index 416 ms: 9 candidates, 72766 repo-hours, 876 releases; waiting 1329 ms; commit 521 ms)
2026-11-07T03:17:21Z [load_day 2023-01-11] 2023-01-11 hour 1: 184625 events in 4 files, snapshot 8093473046957156515 (task 14843 ms: download 4349 ms overlapping gunzip 1232 ms, parse 5604 ms, sort 361 ms, write 6251 ms, index 486 ms: 4 candidates, 85499 repo-hours, 818 releases; waiting 472 ms; commit 616 ms)
2026-11-07T03:17:34Z [load_day 2023-01-11] 2023-01-11 hour 2: 153013 events in 4 files, snapshot 1997210995242262029 (task 13145 ms: download 2830 ms overlapping gunzip 1044 ms, parse 4963 ms, sort 450 ms, write 5692 ms, index 496 ms: 3 candidates, 77131 repo-hours, 615 releases; waiting 203 ms; commit 691 ms)
2026-11-07T03:17:34Z [load_day 2023-01-11] 2023-01-11 hour 3: 160964 events in 4 files, snapshot 4210843791839094641 (task 12123 ms: download 4252 ms overlapping gunzip 992 ms, parse 4431 ms, sort 389 ms, write 5056 ms, index 374 ms: 2 candidates, 63335 repo-hours, 894 releases; waiting 546 ms; commit 619 ms)
2026-11-07T03:17:46Z [load_day 2023-01-11] 2023-01-11 hour 4: 150850 events in 4 files, snapshot 8007811741228028660 (task 11211 ms: download 3098 ms overlapping gunzip 896 ms, parse 3878 ms, sort 339 ms, write 4864 ms, index 381 ms: 1 candidates, 56784 repo-hours, 606 releases; waiting 520 ms; commit 618 ms)
2026-11-07T03:17:46Z [load_day 2023-01-11] 2023-01-11 hour 5: 146500 events in 3 files, snapshot 1334108087466076419 (task 9593 ms: download 2992 ms overlapping gunzip 724 ms, parse 3154 ms, sort 224 ms, write 4287 ms, index 383 ms: 6 candidates, 55663 repo-hours, 773 releases; waiting 520 ms; commit 619 ms)
2026-11-07T03:17:57Z [load_day 2023-01-11] 2023-01-11 hour 6: 159194 events in 4 files, snapshot 1581720490352142711 (task 10569 ms: download 3461 ms overlapping gunzip 715 ms, parse 3283 ms, sort 191 ms, write 5079 ms, index 389 ms: 2 candidates, 65420 repo-hours, 852 releases; waiting 551 ms; commit 622 ms)
2026-11-07T03:17:58Z [load_day 2023-01-11] 2023-01-11 hour 7: 170464 events in 4 files, snapshot 3465542633308251206 (task 11133 ms: download 3299 ms overlapping gunzip 797 ms, parse 3604 ms, sort 205 ms, write 5471 ms, index 426 ms: 5 candidates, 66064 repo-hours, 884 releases; waiting 340 ms; commit 540 ms)
2026-11-07T03:18:11Z [load_day 2023-01-11] 2023-01-11 hour 8: 184099 events in 4 files, snapshot 4041067210410642430 (task 13234 ms: download 3961 ms overlapping gunzip 945 ms, parse 4302 ms, sort 305 ms, write 6405 ms, index 458 ms: 7 candidates, 74644 repo-hours, 943 releases; waiting 512 ms; commit 832 ms)
2026-11-07T03:18:12Z [load_day 2023-01-11] 2023-01-11 hour 9: 191738 events in 4 files, snapshot 2024257761976633186 (task 13523 ms: download 3696 ms overlapping gunzip 1090 ms, parse 4891 ms, sort 306 ms, write 5963 ms, index 468 ms: 7 candidates, 78038 repo-hours, 1136 releases; waiting 516 ms; commit 533 ms)
2026-11-07T03:18:25Z [load_day 2023-01-11] 2023-01-11 hour 10: 188622 events in 4 files, snapshot 447040133285918881 (task 13841 ms: download 4130 ms overlapping gunzip 1039 ms, parse 4774 ms, sort 339 ms, write 6077 ms, index 517 ms: 4 candidates, 77569 repo-hours, 1055 releases; waiting 789 ms; commit 544 ms)
2026-11-07T03:18:26Z [load_day 2023-01-11] 2023-01-11 hour 11: 181808 events in 4 files, snapshot 1240039499239510490 (task 13322 ms: download 3813 ms overlapping gunzip 1020 ms, parse 5005 ms, sort 438 ms, write 5535 ms, index 459 ms: 4 candidates, 74625 repo-hours, 949 releases; waiting 503 ms; commit 627 ms)
2026-11-07T03:18:41Z [load_day 2023-01-11] 2023-01-11 hour 12: 211050 events in 5 files, snapshot 4017381961056248636 (task 15539 ms: download 4896 ms overlapping gunzip 1020 ms, parse 4657 ms, sort 328 ms, write 7459 ms, index 691 ms: 7 candidates, 100685 repo-hours, 1060 releases; waiting 983 ms; commit 666 ms)
2026-11-07T03:18:42Z [load_day 2023-01-11] 2023-01-11 hour 13: 216197 events in 5 files, snapshot 6605017313540671314 (task 15241 ms: download 4741 ms overlapping gunzip 1049 ms, parse 4812 ms, sort 372 ms, write 7671 ms, index 546 ms: 9 candidates, 99287 repo-hours, 963 releases; waiting 500 ms; commit 481 ms)
2026-11-07T03:18:57Z [load_day 2023-01-11] 2023-01-11 hour 14: 205386 events in 5 files, snapshot 4765036617323564867 (task 14928 ms: download 4259 ms overlapping gunzip 1091 ms, parse 5050 ms, sort 351 ms, write 7007 ms, index 524 ms: 7 candidates, 88200 repo-hours, 1078 releases; waiting 518 ms; commit 691 ms)
2026-11-07T03:18:58Z [load_day 2023-01-11] 2023-01-11 hour 15: 205212 events in 5 files, snapshot 1658825045127055042 (task 15146 ms: download 4349 ms overlapping gunzip 1047 ms, parse 5128 ms, sort 652 ms, write 6496 ms, index 636 ms: 2 candidates, 89930 repo-hours, 1261 releases; waiting 645 ms; commit 1038 ms)
2026-11-07T03:19:11Z [load_day 2023-01-11] 2023-01-11 hour 16: 188617 events in 4 files, snapshot 2134879510192864754 (task 13898 ms: download 3270 ms overlapping gunzip 940 ms, parse 4480 ms, sort 257 ms, write 6904 ms, index 524 ms: 9 candidates, 82972 repo-hours, 1074 releases; waiting 502 ms; commit 539 ms)
2026-11-07T03:19:12Z [load_day 2023-01-11] 2023-01-11 hour 17: 196047 events in 4 files, snapshot 8890413627307819998 (task 13815 ms: download 3548 ms overlapping gunzip 991 ms, parse 4747 ms, sort 566 ms, write 6276 ms, index 495 ms: 4 candidates, 80795 repo-hours, 893 releases; waiting 510 ms; commit 359 ms)
2026-11-07T03:19:26Z [load_day 2023-01-11] 2023-01-11 hour 18: 191982 events in 4 files, snapshot 1588102599180581967 (task 13985 ms: download 4032 ms overlapping gunzip 1058 ms, parse 4737 ms, sort 348 ms, write 6510 ms, index 487 ms: 5 candidates, 83113 repo-hours, 996 releases; waiting 502 ms; commit 555 ms)
2026-11-07T03:19:30Z [load_day 2023-01-11] 2023-01-11 hour 19: 198990 events in 4 files, snapshot 8201025459200826611 (task 18024 ms: download 7905 ms overlapping gunzip 1354 ms, parse 5802 ms, sort 671 ms, write 7405 ms, index 511 ms: 7 candidates, 81703 repo-hours, 864 releases; waiting 1953 ms; commit 432 ms)
2026-11-07T03:19:43Z [load_day 2023-01-11] 2023-01-11 hour 20: 199945 events in 4 files, snapshot 7546037555202583927 (task 16457 ms: download 5240 ms overlapping gunzip 1393 ms, parse 6036 ms, sort 475 ms, write 7179 ms, index 482 ms: 3 candidates, 83719 repo-hours, 901 releases; waiting 516 ms; commit 560 ms)
2026-11-07T03:19:46Z [load_day 2023-01-11] 2023-01-11 hour 21: 186599 events in 4 files, snapshot 736836281423429905 (task 14937 ms: download 4341 ms overlapping gunzip 1163 ms, parse 5288 ms, sort 482 ms, write 6630 ms, index 449 ms: 5 candidates, 74585 repo-hours, 989 releases; waiting 541 ms; commit 639 ms)
2026-11-07T03:19:59Z [load_day 2023-01-11] 2023-01-11 hour 22: 179539 events in 4 files, snapshot 4459625439687176253 (task 15443 ms: download 4188 ms overlapping gunzip 1258 ms, parse 5670 ms, sort 520 ms, write 6744 ms, index 460 ms: 3 candidates, 74605 repo-hours, 843 releases; waiting 500 ms; commit 642 ms)
2026-11-07T03:19:59Z [load_day 2023-01-11] 2023-01-11 hour 23: 145480 events in 3 files, snapshot 6178841623936818804 (task 10466 ms: download 3375 ms overlapping gunzip 824 ms, parse 3757 ms, sort 204 ms, write 4512 ms, index 358 ms: 7 candidates, 58384 repo-hours, 763 releases; waiting 506 ms; commit 622 ms)
2026-11-07T03:20:07Z [load_day 2023-01-11] 2023-01-11: repo_hour merged from 24 files to 1 (1845516 rows, 7443 ms)
2026-11-07T03:20:09Z [load_day 2023-01-11] 2023-01-11: index committed in 10053 ms (24 + 1 + 24 files)
2026-11-07T03:20:09Z [load_day 2023-01-11] 2023-01-11: 4351830 events in 24 hours
2026-11-07T03:20:09Z [load_day 2023-01-11] attempt 1 succeeded