orcaLog in

Runs · run 2733

load_day 2024-07-19, attempt 1 succeeded

Host
73ccef5e07c2:151661
Started
2026-11-08T07:03:40Z
Ended
2026-11-08T07:05:23Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
686 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
161.4 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2733/load_day/2024-07-19/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:03:40Z [load_day 2024-07-19] attempt 1 started
2026-11-08T07:03:41Z [load_day 2024-07-19] 2024-07-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:03:47Z [load_day 2024-07-19] 2024-07-19 hour 0: 136002 events in 0 files, snapshot none (task 6233 ms: download 2891 ms overlapping gunzip 947 ms, parse 3884 ms, sort 0 ms, write 0 ms, index 591 ms: 5 candidates, 67003 repo-hours, 587 releases; waiting 527 ms; commit 0 ms)
2026-11-08T07:03:48Z [load_day 2024-07-19] 2024-07-19 hour 1: 162220 events in 0 files, snapshot none (task 6856 ms: download 3871 ms overlapping gunzip 1033 ms, parse 4455 ms, sort 0 ms, write 0 ms, index 648 ms: 4 candidates, 86591 repo-hours, 679 releases; waiting 508 ms; commit 0 ms)
2026-11-08T07:03:54Z [load_day 2024-07-19] 2024-07-19 hour 2: 160959 events in 0 files, snapshot none (task 5914 ms: download 2918 ms overlapping gunzip 804 ms, parse 3411 ms, sort 0 ms, write 0 ms, index 899 ms: 6 candidates, 69207 repo-hours, 1073 releases; waiting 496 ms; commit 0 ms)
2026-11-08T07:03:54Z [load_day 2024-07-19] 2024-07-19 hour 3: 174929 events in 0 files, snapshot none (task 5408 ms: download 2412 ms overlapping gunzip 775 ms, parse 3409 ms, sort 0 ms, write 0 ms, index 776 ms: 3 candidates, 75986 repo-hours, 5707 releases; waiting 202 ms; commit 0 ms)
2026-11-08T07:04:00Z [load_day 2024-07-19] 2024-07-19 hour 4: 145734 events in 0 files, snapshot none (task 6019 ms: download 3041 ms overlapping gunzip 794 ms, parse 3231 ms, sort 0 ms, write 0 ms, index 1235 ms: 5 candidates, 59766 repo-hours, 671 releases; waiting 486 ms; commit 0 ms)
2026-11-08T07:04:01Z [load_day 2024-07-19] 2024-07-19 hour 5: 161057 events in 0 files, snapshot none (task 6463 ms: download 3811 ms overlapping gunzip 920 ms, parse 3933 ms, sort 0 ms, write 0 ms, index 864 ms: 5 candidates, 67106 repo-hours, 844 releases; waiting 476 ms; commit 0 ms)
2026-11-08T07:04:08Z [load_day 2024-07-19] 2024-07-19 hour 6: 196443 events in 0 files, snapshot none (task 6635 ms: download 4028 ms overlapping gunzip 942 ms, parse 4209 ms, sort 0 ms, write 0 ms, index 699 ms: 9 candidates, 91822 repo-hours, 949 releases; waiting 508 ms; commit 0 ms)
2026-11-08T07:04:09Z [load_day 2024-07-19] 2024-07-19 hour 7: 197692 events in 0 files, snapshot none (task 7070 ms: download 4496 ms overlapping gunzip 1157 ms, parse 4571 ms, sort 0 ms, write 0 ms, index 546 ms: 6 candidates, 83018 repo-hours, 1139 releases; waiting 195 ms; commit 0 ms)
2026-11-08T07:04:15Z [load_day 2024-07-19] 2024-07-19 hour 8: 211206 events in 0 files, snapshot none (task 7304 ms: download 4831 ms overlapping gunzip 1141 ms, parse 4510 ms, sort 0 ms, write 0 ms, index 623 ms: 7 candidates, 89166 repo-hours, 1194 releases; waiting 747 ms; commit 0 ms)
2026-11-08T07:04:16Z [load_day 2024-07-19] 2024-07-19 hour 9: 223119 events in 0 files, snapshot none (task 6999 ms: download 4564 ms overlapping gunzip 1084 ms, parse 4468 ms, sort 0 ms, write 0 ms, index 654 ms: 7 candidates, 101954 repo-hours, 1256 releases; waiting 544 ms; commit 0 ms)
2026-11-08T07:04:23Z [load_day 2024-07-19] 2024-07-19 hour 10: 207996 events in 0 files, snapshot none (task 6979 ms: download 4010 ms overlapping gunzip 1040 ms, parse 4440 ms, sort 0 ms, write 0 ms, index 773 ms: 9 candidates, 90470 repo-hours, 1047 releases; waiting 479 ms; commit 0 ms)
2026-11-08T07:04:24Z [load_day 2024-07-19] 2024-07-19 hour 11: 197382 events in 0 files, snapshot none (task 7018 ms: download 3744 ms overlapping gunzip 1096 ms, parse 4589 ms, sort 0 ms, write 0 ms, index 604 ms: 12 candidates, 82682 repo-hours, 1088 releases; waiting 502 ms; commit 0 ms)
2026-11-08T07:04:32Z [load_day 2024-07-19] 2024-07-19 hour 12: 261826 events in 0 files, snapshot none (task 8995 ms: download 5067 ms overlapping gunzip 1286 ms, parse 5676 ms, sort 0 ms, write 0 ms, index 1024 ms: 12 candidates, 126759 repo-hours, 1223 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:04:33Z [load_day 2024-07-19] 2024-07-19 hour 13: 229465 events in 0 files, snapshot none (task 8895 ms: download 5941 ms overlapping gunzip 1366 ms, parse 5786 ms, sort 0 ms, write 0 ms, index 770 ms: 14 candidates, 111290 repo-hours, 1262 releases; waiting 644 ms; commit 0 ms)
2026-11-08T07:04:42Z [load_day 2024-07-19] 2024-07-19 hour 14: 215919 events in 0 files, snapshot none (task 9914 ms: download 6458 ms overlapping gunzip 1632 ms, parse 6740 ms, sort 0 ms, write 0 ms, index 792 ms: 16 candidates, 91408 repo-hours, 1219 releases; waiting 481 ms; commit 0 ms)
2026-11-08T07:04:43Z [load_day 2024-07-19] 2024-07-19 hour 15: 225227 events in 0 files, snapshot none (task 9823 ms: download 6967 ms overlapping gunzip 1631 ms, parse 6691 ms, sort 0 ms, write 0 ms, index 768 ms: 9 candidates, 98558 repo-hours, 1373 releases; waiting 466 ms; commit 0 ms)
2026-11-08T07:04:51Z [load_day 2024-07-19] 2024-07-19 hour 16: 205642 events in 0 files, snapshot none (task 7743 ms: download 5017 ms overlapping gunzip 1207 ms, parse 5260 ms, sort 0 ms, write 0 ms, index 675 ms: 6 candidates, 85936 repo-hours, 1152 releases; waiting 389 ms; commit 0 ms)
2026-11-08T07:04:51Z [load_day 2024-07-19] 2024-07-19 hour 17: 197347 events in 0 files, snapshot none (task 7539 ms: download 5095 ms overlapping gunzip 1198 ms, parse 4970 ms, sort 0 ms, write 0 ms, index 618 ms: 9 candidates, 82613 repo-hours, 940 releases; waiting 500 ms; commit 0 ms)
2026-11-08T07:04:59Z [load_day 2024-07-19] 2024-07-19 hour 18: 205046 events in 0 files, snapshot none (task 8282 ms: download 5079 ms overlapping gunzip 1260 ms, parse 5400 ms, sort 0 ms, write 0 ms, index 752 ms: 10 candidates, 92245 repo-hours, 1224 releases; waiting 594 ms; commit 0 ms)
2026-11-08T07:04:59Z [load_day 2024-07-19] 2024-07-19 hour 19: 184240 events in 0 files, snapshot none (task 6884 ms: download 3926 ms overlapping gunzip 1014 ms, parse 4289 ms, sort 0 ms, write 0 ms, index 820 ms: 6 candidates, 74054 repo-hours, 946 releases; waiting 479 ms; commit 0 ms)
2026-11-08T07:05:06Z [load_day 2024-07-19] 2024-07-19 hour 20: 171107 events in 0 files, snapshot none (task 6734 ms: download 3647 ms overlapping gunzip 1063 ms, parse 4304 ms, sort 0 ms, write 0 ms, index 575 ms: 9 candidates, 68472 repo-hours, 896 releases; waiting 494 ms; commit 0 ms)
2026-11-08T07:05:06Z [load_day 2024-07-19] 2024-07-19 hour 21: 159774 events in 0 files, snapshot none (task 6067 ms: download 2731 ms overlapping gunzip 908 ms, parse 3930 ms, sort 0 ms, write 0 ms, index 644 ms: 6 candidates, 65783 repo-hours, 987 releases; waiting 238 ms; commit 0 ms)
2026-11-08T07:05:12Z [load_day 2024-07-19] 2024-07-19 hour 22: 140018 events in 0 files, snapshot none (task 4981 ms: download 2332 ms overlapping gunzip 737 ms, parse 3125 ms, sort 0 ms, write 0 ms, index 346 ms: 4 candidates, 54352 repo-hours, 951 releases; waiting 524 ms; commit 0 ms)
2026-11-08T07:05:12Z [load_day 2024-07-19] 2024-07-19 hour 23: 129010 events in 0 files, snapshot none (task 4542 ms: download 2024 ms overlapping gunzip 627 ms, parse 2678 ms, sort 0 ms, write 0 ms, index 479 ms: 6 candidates, 51405 repo-hours, 693 releases; waiting 543 ms; commit 0 ms)
2026-11-08T07:05:20Z [load_day 2024-07-19] 2024-07-19: repo_hour merged from 24 files to 1 (1967646 rows, 8235 ms)
2026-11-08T07:05:23Z [load_day 2024-07-19] 2024-07-19: index committed in 11037 ms (24 + 1 + 24 files)
2026-11-08T07:05:23Z [load_day 2024-07-19] 2024-07-19: 4499360 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:05:23Z [load_day 2024-07-19] attempt 1 succeeded