orcaLog in

Runs · run 1991

load_day 2024-01-21, attempt 1 succeeded

Host
73ccef5e07c2:53276
Started
2026-11-08T04:15:24Z
Ended
2026-11-08T04:16:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
605 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
109.4 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1991/load_day/2024-01-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:15:24Z [load_day 2024-01-21] attempt 1 started
2026-11-08T04:15:25Z [load_day 2024-01-21] 2024-01-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:15:32Z [load_day 2024-01-21] 2024-01-21 hour 0: 161522 events in 0 files, snapshot none (task 6362 ms: download 2728 ms overlapping gunzip 880 ms, parse 3974 ms, sort 0 ms, write 0 ms, index 773 ms: 4 candidates, 69887 repo-hours, 873 releases; waiting 462 ms; commit 0 ms)
2026-11-08T04:15:32Z [load_day 2024-01-21] 2024-01-21 hour 1: 168905 events in 0 files, snapshot none (task 6401 ms: download 2740 ms overlapping gunzip 914 ms, parse 4073 ms, sort 0 ms, write 0 ms, index 653 ms: 11 candidates, 80745 repo-hours, 751 releases; waiting 510 ms; commit 0 ms)
2026-11-08T04:15:38Z [load_day 2024-01-21] 2024-01-21 hour 2: 133346 events in 0 files, snapshot none (task 5188 ms: download 2161 ms overlapping gunzip 733 ms, parse 3174 ms, sort 0 ms, write 0 ms, index 447 ms: 5 candidates, 44387 repo-hours, 580 releases; waiting 515 ms; commit 0 ms)
2026-11-08T04:15:38Z [load_day 2024-01-21] 2024-01-21 hour 3: 131599 events in 0 files, snapshot none (task 4880 ms: download 2067 ms overlapping gunzip 636 ms, parse 2953 ms, sort 0 ms, write 0 ms, index 536 ms: 7 candidates, 42510 repo-hours, 614 releases; waiting 499 ms; commit 0 ms)
2026-11-08T04:15:43Z [load_day 2024-01-21] 2024-01-21 hour 4: 132452 events in 0 files, snapshot none (task 4874 ms: download 1782 ms overlapping gunzip 641 ms, parse 2965 ms, sort 0 ms, write 0 ms, index 562 ms: 3 candidates, 43343 repo-hours, 467 releases; waiting 506 ms; commit 0 ms)
2026-11-08T04:15:43Z [load_day 2024-01-21] 2024-01-21 hour 5: 138982 events in 0 files, snapshot none (task 5234 ms: download 2327 ms overlapping gunzip 787 ms, parse 3133 ms, sort 0 ms, write 0 ms, index 605 ms: 2 candidates, 44701 repo-hours, 521 releases; waiting 469 ms; commit 0 ms)
2026-11-08T04:15:48Z [load_day 2024-01-21] 2024-01-21 hour 6: 149037 events in 0 files, snapshot none (task 4669 ms: download 2110 ms overlapping gunzip 620 ms, parse 2776 ms, sort 0 ms, write 0 ms, index 417 ms: 1 candidates, 53453 repo-hours, 627 releases; waiting 550 ms; commit 0 ms)
2026-11-08T04:15:49Z [load_day 2024-01-21] 2024-01-21 hour 7: 148732 events in 0 files, snapshot none (task 4848 ms: download 2394 ms overlapping gunzip 641 ms, parse 2855 ms, sort 0 ms, write 0 ms, index 559 ms: 3 candidates, 48289 repo-hours, 434 releases; waiting 496 ms; commit 0 ms)
2026-11-08T04:15:54Z [load_day 2024-01-21] 2024-01-21 hour 8: 157037 events in 0 files, snapshot none (task 4689 ms: download 2248 ms overlapping gunzip 693 ms, parse 2937 ms, sort 0 ms, write 0 ms, index 377 ms: 12 candidates, 52196 repo-hours, 556 releases; waiting 470 ms; commit 0 ms)
2026-11-08T04:15:54Z [load_day 2024-01-21] 2024-01-21 hour 9: 163834 events in 0 files, snapshot none (task 4820 ms: download 2280 ms overlapping gunzip 729 ms, parse 3112 ms, sort 0 ms, write 0 ms, index 412 ms: 5 candidates, 54480 repo-hours, 802 releases; waiting 277 ms; commit 0 ms)
2026-11-08T04:16:00Z [load_day 2024-01-21] 2024-01-21 hour 10: 165014 events in 0 files, snapshot none (task 5986 ms: download 3363 ms overlapping gunzip 869 ms, parse 3893 ms, sort 0 ms, write 0 ms, index 488 ms: 14 candidates, 57306 repo-hours, 666 releases; waiting 494 ms; commit 0 ms)
2026-11-08T04:16:00Z [load_day 2024-01-21] 2024-01-21 hour 11: 174773 events in 0 files, snapshot none (task 5315 ms: download 2901 ms overlapping gunzip 745 ms, parse 3464 ms, sort 0 ms, write 0 ms, index 477 ms: 7 candidates, 57882 repo-hours, 844 releases; waiting 394 ms; commit 0 ms)
2026-11-08T04:16:07Z [load_day 2024-01-21] 2024-01-21 hour 12: 237791 events in 0 files, snapshot none (task 6785 ms: download 3632 ms overlapping gunzip 908 ms, parse 4393 ms, sort 0 ms, write 0 ms, index 675 ms: 7 candidates, 91773 repo-hours, 836 releases; waiting 499 ms; commit 0 ms)
2026-11-08T04:16:08Z [load_day 2024-01-21] 2024-01-21 hour 13: 204469 events in 0 files, snapshot none (task 6782 ms: download 3963 ms overlapping gunzip 1012 ms, parse 4407 ms, sort 0 ms, write 0 ms, index 653 ms: 6 candidates, 85275 repo-hours, 972 releases; waiting 485 ms; commit 0 ms)
2026-11-08T04:16:14Z [load_day 2024-01-21] 2024-01-21 hour 14: 199889 events in 0 files, snapshot none (task 5595 ms: download 3150 ms overlapping gunzip 763 ms, parse 3219 ms, sort 0 ms, write 0 ms, index 546 ms: 0 candidates, 70244 repo-hours, 1548 releases; waiting 847 ms; commit 0 ms)
2026-11-08T04:16:14Z [load_day 2024-01-21] 2024-01-21 hour 15: 200988 events in 0 files, snapshot none (task 5605 ms: download 3118 ms overlapping gunzip 819 ms, parse 3400 ms, sort 0 ms, write 0 ms, index 554 ms: 3 candidates, 74059 repo-hours, 1003 releases; waiting 517 ms; commit 0 ms)
2026-11-08T04:16:19Z [load_day 2024-01-21] 2024-01-21 hour 16: 198674 events in 0 files, snapshot none (task 5385 ms: download 2713 ms overlapping gunzip 735 ms, parse 3244 ms, sort 0 ms, write 0 ms, index 614 ms: 3 candidates, 71469 repo-hours, 1008 releases; waiting 517 ms; commit 0 ms)
2026-11-08T04:16:19Z [load_day 2024-01-21] 2024-01-21 hour 17: 197472 events in 0 files, snapshot none (task 5195 ms: download 2558 ms overlapping gunzip 721 ms, parse 3115 ms, sort 0 ms, write 0 ms, index 581 ms: 9 candidates, 67364 repo-hours, 1385 releases; waiting 520 ms; commit 0 ms)
2026-11-08T04:16:28Z [load_day 2024-01-21] 2024-01-21 hour 18: 212191 events in 0 files, snapshot none (task 8013 ms: download 4852 ms overlapping gunzip 1255 ms, parse 5331 ms, sort 0 ms, write 0 ms, index 617 ms: 4 candidates, 75161 repo-hours, 913 releases; waiting 509 ms; commit 0 ms)
2026-11-08T04:16:28Z [load_day 2024-01-21] 2024-01-21 hour 19: 196146 events in 0 files, snapshot none (task 7274 ms: download 4171 ms overlapping gunzip 1089 ms, parse 4710 ms, sort 0 ms, write 0 ms, index 671 ms: 6 candidates, 61016 repo-hours, 837 releases; waiting 497 ms; commit 0 ms)
2026-11-08T04:16:35Z [load_day 2024-01-21] 2024-01-21 hour 20: 190213 events in 0 files, snapshot none (task 7170 ms: download 3623 ms overlapping gunzip 1059 ms, parse 4716 ms, sort 0 ms, write 0 ms, index 625 ms: 3 candidates, 61817 repo-hours, 893 releases; waiting 514 ms; commit 0 ms)
2026-11-08T04:16:35Z [load_day 2024-01-21] 2024-01-21 hour 21: 180530 events in 0 files, snapshot none (task 7023 ms: download 3898 ms overlapping gunzip 1069 ms, parse 4574 ms, sort 0 ms, write 0 ms, index 558 ms: 4 candidates, 56786 repo-hours, 1107 releases; waiting 531 ms; commit 0 ms)
2026-11-08T04:16:42Z [load_day 2024-01-21] 2024-01-21 hour 22: 172050 events in 0 files, snapshot none (task 5624 ms: download 2424 ms overlapping gunzip 789 ms, parse 3509 ms, sort 0 ms, write 0 ms, index 550 ms: 6 candidates, 53772 repo-hours, 1405 releases; waiting 527 ms; commit 0 ms)
2026-11-08T04:16:42Z [load_day 2024-01-21] 2024-01-21 hour 23: 162169 events in 0 files, snapshot none (task 5529 ms: download 2315 ms overlapping gunzip 813 ms, parse 3545 ms, sort 0 ms, write 0 ms, index 391 ms: 10 candidates, 48399 repo-hours, 625 releases; waiting 516 ms; commit 0 ms)
2026-11-08T04:16:49Z [load_day 2024-01-21] 2024-01-21: repo_hour merged from 24 files to 1 (1466314 rows, 7222 ms)
2026-11-08T04:16:52Z [load_day 2024-01-21] 2024-01-21: index committed in 10023 ms (23 + 1 + 24 files)
2026-11-08T04:16:52Z [load_day 2024-01-21] 2024-01-21: 4177815 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:16:52Z [load_day 2024-01-21] attempt 1 succeeded