orcaLog in

Runs · run 23

load_day 2023-01-08, attempt 1 succeeded

Host
4e84322b8c45:8473
Started
2026-11-07T03:09:11Z
Ended
2026-11-07T03:10:57Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/23/load_day/2023-01-08/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:09:11Z [load_day 2023-01-08] attempt 1 started
2026-11-07T03:09:22Z [load_day 2023-01-08] 2023-01-08 hour 0: 116673 events in 3 files, snapshot 4994088128863234445 (task 8245 ms: download 3222 ms overlapping gunzip 500 ms, parse 2424 ms, sort 205 ms, write 3891 ms, index 337 ms: 1 candidates, 58637 repo-hours, 854 releases; waiting 544 ms; commit 521 ms)
2026-11-07T03:09:22Z [load_day 2023-01-08] 2023-01-08 hour 1: 117888 events in 3 files, snapshot 7834019772671436587 (task 8208 ms: download 2454 ms overlapping gunzip 518 ms, parse 2407 ms, sort 202 ms, write 3840 ms, index 362 ms: 5 candidates, 62609 repo-hours, 760 releases; waiting 470 ms; commit 466 ms)
2026-11-07T03:09:29Z [load_day 2023-01-08] 2023-01-08 hour 2: 102770 events in 3 files, snapshot 4950307798672731548 (task 6759 ms: download 2498 ms overlapping gunzip 422 ms, parse 1985 ms, sort 120 ms, write 2949 ms, index 307 ms: 1 candidates, 47443 repo-hours, 545 releases; waiting 621 ms; commit 562 ms)
2026-11-07T03:09:30Z [load_day 2023-01-08] 2023-01-08 hour 3: 108216 events in 3 files, snapshot 526496337533076189 (task 6186 ms: download 1708 ms overlapping gunzip 403 ms, parse 1936 ms, sort 118 ms, write 2679 ms, index 276 ms: 5 candidates, 38737 repo-hours, 678 releases; waiting 525 ms; commit 509 ms)
2026-11-07T03:09:36Z [load_day 2023-01-08] 2023-01-08 hour 4: 105889 events in 3 files, snapshot 1271186243348886578 (task 5759 ms: download 2107 ms overlapping gunzip 436 ms, parse 1927 ms, sort 110 ms, write 2286 ms, index 279 ms: 3 candidates, 38528 repo-hours, 508 releases; waiting 510 ms; commit 755 ms)
2026-11-07T03:09:36Z [load_day 2023-01-08] 2023-01-08 hour 5: 110586 events in 3 files, snapshot 7164606698170009621 (task 5818 ms: download 1939 ms overlapping gunzip 421 ms, parse 1995 ms, sort 155 ms, write 2189 ms, index 247 ms: 2 candidates, 40896 repo-hours, 649 releases; waiting 513 ms; commit 497 ms)
2026-11-07T03:09:42Z [load_day 2023-01-08] 2023-01-08 hour 6: 112908 events in 3 files, snapshot 3383213567797871005 (task 6079 ms: download 1911 ms overlapping gunzip 430 ms, parse 2045 ms, sort 111 ms, write 2358 ms, index 311 ms: 3 candidates, 45306 repo-hours, 628 releases; waiting 497 ms; commit 720 ms)
2026-11-07T03:09:43Z [load_day 2023-01-08] 2023-01-08 hour 7: 117036 events in 3 files, snapshot 2103847735491782044 (task 6254 ms: download 2281 ms overlapping gunzip 464 ms, parse 2255 ms, sort 127 ms, write 2301 ms, index 259 ms: 0 candidates, 42489 repo-hours, 484 releases; waiting 498 ms; commit 1272 ms)
2026-11-07T03:09:49Z [load_day 2023-01-08] 2023-01-08 hour 8: 122130 events in 3 files, snapshot 8744885982903307377 (task 6652 ms: download 2169 ms overlapping gunzip 468 ms, parse 2187 ms, sort 135 ms, write 2795 ms, index 307 ms: 4 candidates, 46155 repo-hours, 548 releases; waiting 504 ms; commit 715 ms)
2026-11-07T03:09:50Z [load_day 2023-01-08] 2023-01-08 hour 9: 125652 events in 3 files, snapshot 553209659126911654 (task 6983 ms: download 2276 ms overlapping gunzip 494 ms, parse 2398 ms, sort 141 ms, write 2867 ms, index 296 ms: 3 candidates, 47205 repo-hours, 700 releases; waiting 496 ms; commit 513 ms)
2026-11-07T03:09:56Z [load_day 2023-01-08] 2023-01-08 hour 10: 126799 events in 3 files, snapshot 8517521784625099162 (task 6736 ms: download 2115 ms overlapping gunzip 485 ms, parse 2212 ms, sort 197 ms, write 2667 ms, index 411 ms: 4 candidates, 51055 repo-hours, 682 releases; waiting 496 ms; commit 498 ms)
2026-11-07T03:09:58Z [load_day 2023-01-08] 2023-01-08 hour 11: 126250 events in 3 files, snapshot 1616426441185433967 (task 6774 ms: download 2348 ms overlapping gunzip 470 ms, parse 2181 ms, sort 164 ms, write 2799 ms, index 379 ms: 2 candidates, 50891 repo-hours, 637 releases; waiting 516 ms; commit 606 ms)
2026-11-07T03:10:05Z [load_day 2023-01-08] 2023-01-08 hour 12: 171403 events in 4 files, snapshot 1738700210174937848 (task 8370 ms: download 2092 ms overlapping gunzip 530 ms, parse 2602 ms, sort 176 ms, write 3788 ms, index 484 ms: 2 candidates, 79237 repo-hours, 782 releases; waiting 526 ms; commit 645 ms)
2026-11-07T03:10:08Z [load_day 2023-01-08] 2023-01-08 hour 13: 167065 events in 4 files, snapshot 5370008263098350505 (task 9038 ms: download 2426 ms overlapping gunzip 585 ms, parse 2853 ms, sort 182 ms, write 4078 ms, index 551 ms: 4 candidates, 76994 repo-hours, 775 releases; waiting 498 ms; commit 568 ms)
2026-11-07T03:10:14Z [load_day 2023-01-08] 2023-01-08 hour 14: 158918 events in 4 files, snapshot 2057080656907323234 (task 8648 ms: download 2433 ms overlapping gunzip 618 ms, parse 2901 ms, sort 227 ms, write 3740 ms, index 386 ms: 1 candidates, 64318 repo-hours, 788 releases; waiting 506 ms; commit 604 ms)
2026-11-07T03:10:17Z [load_day 2023-01-08] 2023-01-08 hour 15: 163970 events in 4 files, snapshot 7737070086953264465 (task 8871 ms: download 2992 ms overlapping gunzip 615 ms, parse 3019 ms, sort 315 ms, write 3637 ms, index 444 ms: 0 candidates, 65760 repo-hours, 1045 releases; waiting 533 ms; commit 425 ms)
2026-11-07T03:10:23Z [load_day 2023-01-08] 2023-01-08 hour 16: 156317 events in 4 files, snapshot 1381089479723672676 (task 8336 ms: download 2499 ms overlapping gunzip 609 ms, parse 2773 ms, sort 160 ms, write 3592 ms, index 406 ms: 5 candidates, 64776 repo-hours, 835 releases; waiting 471 ms; commit 518 ms)
2026-11-07T03:10:26Z [load_day 2023-01-08] 2023-01-08 hour 17: 147614 events in 3 files, snapshot 1884419643229597427 (task 8086 ms: download 2273 ms overlapping gunzip 602 ms, parse 2826 ms, sort 148 ms, write 3257 ms, index 464 ms: 3 candidates, 61944 repo-hours, 875 releases; waiting 510 ms; commit 660 ms)
2026-11-07T03:10:32Z [load_day 2023-01-08] 2023-01-08 hour 18: 152644 events in 4 files, snapshot 8478190872100307706 (task 7941 ms: download 2400 ms overlapping gunzip 546 ms, parse 2573 ms, sort 155 ms, write 3449 ms, index 394 ms: 3 candidates, 65589 repo-hours, 933 releases; waiting 518 ms; commit 706 ms)
2026-11-07T03:10:34Z [load_day 2023-01-08] 2023-01-08 hour 19: 146268 events in 3 files, snapshot 8977899438406219460 (task 7581 ms: download 2699 ms overlapping gunzip 563 ms, parse 2757 ms, sort 168 ms, write 2918 ms, index 357 ms: 4 candidates, 57979 repo-hours, 852 releases; waiting 521 ms; commit 642 ms)
2026-11-07T03:10:40Z [load_day 2023-01-08] 2023-01-08 hour 20: 143523 events in 3 files, snapshot 1529288832667134921 (task 7369 ms: download 2344 ms overlapping gunzip 537 ms, parse 2504 ms, sort 142 ms, write 3264 ms, index 344 ms: 6 candidates, 56437 repo-hours, 823 releases; waiting 291 ms; commit 924 ms)
2026-11-07T03:10:43Z [load_day 2023-01-08] 2023-01-08 hour 21: 136923 events in 3 files, snapshot 5784947967644022083 (task 7325 ms: download 2607 ms overlapping gunzip 547 ms, parse 2601 ms, sort 182 ms, write 2820 ms, index 330 ms: 4 candidates, 52374 repo-hours, 821 releases; waiting 504 ms; commit 1243 ms)
2026-11-07T03:10:47Z [load_day 2023-01-08] 2023-01-08 hour 22: 117659 events in 3 files, snapshot 8219143150965473848 (task 7226 ms: download 2900 ms overlapping gunzip 499 ms, parse 2346 ms, sort 129 ms, write 3077 ms, index 315 ms: 1 candidates, 46900 repo-hours, 752 releases; waiting 566 ms; commit 433 ms)
2026-11-07T03:10:49Z [load_day 2023-01-08] 2023-01-08 hour 23: 111785 events in 3 files, snapshot 5382294562177471937 (task 6704 ms: download 2850 ms overlapping gunzip 463 ms, parse 2166 ms, sort 187 ms, write 2767 ms, index 292 ms: 2 candidates, 46110 repo-hours, 608 releases; waiting 505 ms; commit 667 ms)
2026-11-07T03:10:55Z [load_day 2023-01-08] 2023-01-08: repo_hour merged from 24 files to 1 (1308369 rows, 5798 ms)
2026-11-07T03:10:57Z [load_day 2023-01-08] 2023-01-08: index committed in 7377 ms (22 + 1 + 24 files)
2026-11-07T03:10:57Z [load_day 2023-01-08] 2023-01-08: 3166886 events in 24 hours
2026-11-07T03:10:57Z [load_day 2023-01-08] attempt 1 succeeded