orcaLog in

Runs · run 2936

load_day 2024-09-08, attempt 1 succeeded

Host
73ccef5e07c2:174824
Started
2026-11-08T07:49:29Z
Ended
2026-11-08T07:50:57Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
648 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
112.3 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2936/load_day/2024-09-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:49:29Z [load_day 2024-09-08] attempt 1 started
2026-11-08T07:49:30Z [load_day 2024-09-08] 2024-09-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:49:36Z [load_day 2024-09-08] 2024-09-08 hour 0: 147155 events in 0 files, snapshot none (task 5268 ms: download 2600 ms overlapping gunzip 723 ms, parse 3153 ms, sort 0 ms, write 0 ms, index 585 ms: 6 candidates, 75831 repo-hours, 1038 releases; waiting 489 ms; commit 0 ms)
2026-11-08T07:49:36Z [load_day 2024-09-08] 2024-09-08 hour 1: 165036 events in 0 files, snapshot none (task 5957 ms: download 2905 ms overlapping gunzip 767 ms, parse 3708 ms, sort 0 ms, write 0 ms, index 660 ms: 8 candidates, 94631 repo-hours, 790 releases; waiting 511 ms; commit 0 ms)
2026-11-08T07:49:40Z [load_day 2024-09-08] 2024-09-08 hour 2: 129303 events in 0 files, snapshot none (task 3709 ms: download 2332 ms overlapping gunzip 453 ms, parse 1954 ms, sort 0 ms, write 0 ms, index 404 ms: 9 candidates, 57605 repo-hours, 666 releases; waiting 570 ms; commit 0 ms)
2026-11-08T07:49:41Z [load_day 2024-09-08] 2024-09-08 hour 3: 147448 events in 0 files, snapshot none (task 3731 ms: download 2183 ms overlapping gunzip 462 ms, parse 2034 ms, sort 0 ms, write 0 ms, index 380 ms: 2 candidates, 56800 repo-hours, 3946 releases; waiting 573 ms; commit 0 ms)
2026-11-08T07:49:44Z [load_day 2024-09-08] 2024-09-08 hour 4: 130360 events in 0 files, snapshot none (task 3473 ms: download 2265 ms overlapping gunzip 429 ms, parse 1859 ms, sort 0 ms, write 0 ms, index 340 ms: 3 candidates, 46910 repo-hours, 635 releases; waiting 532 ms; commit 0 ms)
2026-11-08T07:49:46Z [load_day 2024-09-08] 2024-09-08 hour 5: 135662 events in 0 files, snapshot none (task 4457 ms: download 2539 ms overlapping gunzip 465 ms, parse 1983 ms, sort 0 ms, write 0 ms, index 344 ms: 3 candidates, 49464 repo-hours, 743 releases; waiting 1411 ms; commit 0 ms)
2026-11-08T07:49:49Z [load_day 2024-09-08] 2024-09-08 hour 6: 157919 events in 0 files, snapshot none (task 4167 ms: download 2330 ms overlapping gunzip 519 ms, parse 2351 ms, sort 0 ms, write 0 ms, index 509 ms: 4 candidates, 67649 repo-hours, 778 releases; waiting 502 ms; commit 0 ms)
2026-11-08T07:49:51Z [load_day 2024-09-08] 2024-09-08 hour 7: 150656 events in 0 files, snapshot none (task 5141 ms: download 1847 ms overlapping gunzip 531 ms, parse 2209 ms, sort 0 ms, write 0 ms, index 1817 ms: 7 candidates, 54728 repo-hours, 670 releases; waiting 294 ms; commit 0 ms)
2026-11-08T07:50:03Z [load_day 2024-09-08] 2024-09-08 hour 8: 157397 events in 0 files, snapshot none (task 5633 ms: download 2837 ms overlapping gunzip 673 ms, parse 2864 ms, sort 0 ms, write 0 ms, index 752 ms: 5 candidates, 60552 repo-hours, 698 releases; waiting 950 ms; commit 0 ms)
2026-11-08T07:50:05Z [load_day 2024-09-08] 2024-09-08 hour 9: 169890 events in 0 files, snapshot none (task 5160 ms: download 2334 ms overlapping gunzip 734 ms, parse 3031 ms, sort 0 ms, write 0 ms, index 649 ms: 7 candidates, 66970 repo-hours, 885 releases; waiting 216 ms; commit 0 ms)
2026-11-08T07:50:08Z [load_day 2024-09-08] 2024-09-08 hour 10: 159264 events in 0 files, snapshot none (task 4471 ms: download 3220 ms overlapping gunzip 664 ms, parse 2705 ms, sort 0 ms, write 0 ms, index 524 ms: 8 candidates, 62141 repo-hours, 771 releases; waiting 244 ms; commit 0 ms)
2026-11-08T07:50:10Z [load_day 2024-09-08] 2024-09-08 hour 11: 160132 events in 0 files, snapshot none (task 4315 ms: download 2113 ms overlapping gunzip 569 ms, parse 2402 ms, sort 0 ms, write 0 ms, index 564 ms: 5 candidates, 59189 repo-hours, 799 releases; waiting 490 ms; commit 0 ms)
2026-11-08T07:50:16Z [load_day 2024-09-08] 2024-09-08 hour 12: 233622 events in 0 files, snapshot none (task 7403 ms: download 4012 ms overlapping gunzip 938 ms, parse 4229 ms, sort 0 ms, write 0 ms, index 910 ms: 4 candidates, 118051 repo-hours, 891 releases; waiting 1030 ms; commit 0 ms)
2026-11-08T07:50:17Z [load_day 2024-09-08] 2024-09-08 hour 13: 199895 events in 0 files, snapshot none (task 6134 ms: download 3630 ms overlapping gunzip 880 ms, parse 3857 ms, sort 0 ms, write 0 ms, index 727 ms: 13 candidates, 95460 repo-hours, 873 releases; waiting 418 ms; commit 0 ms)
2026-11-08T07:50:23Z [load_day 2024-09-08] 2024-09-08 hour 14: 187076 events in 0 files, snapshot none (task 6196 ms: download 3403 ms overlapping gunzip 922 ms, parse 3905 ms, sort 0 ms, write 0 ms, index 548 ms: 8 candidates, 71987 repo-hours, 947 releases; waiting 466 ms; commit 0 ms)
2026-11-08T07:50:24Z [load_day 2024-09-08] 2024-09-08 hour 15: 193380 events in 0 files, snapshot none (task 6028 ms: download 3515 ms overlapping gunzip 864 ms, parse 3782 ms, sort 0 ms, write 0 ms, index 591 ms: 11 candidates, 81231 repo-hours, 1040 releases; waiting 500 ms; commit 0 ms)
2026-11-08T07:50:31Z [load_day 2024-09-08] 2024-09-08 hour 16: 181687 events in 0 files, snapshot none (task 6973 ms: download 3882 ms overlapping gunzip 1055 ms, parse 4508 ms, sort 0 ms, write 0 ms, index 643 ms: 5 candidates, 73098 repo-hours, 904 releases; waiting 491 ms; commit 0 ms)
2026-11-08T07:50:31Z [load_day 2024-09-08] 2024-09-08 hour 17: 175355 events in 0 files, snapshot none (task 6891 ms: download 3316 ms overlapping gunzip 1009 ms, parse 4389 ms, sort 0 ms, write 0 ms, index 716 ms: 12 candidates, 67699 repo-hours, 762 releases; waiting 495 ms; commit 0 ms)
2026-11-08T07:50:37Z [load_day 2024-09-08] 2024-09-08 hour 18: 193081 events in 0 files, snapshot none (task 5662 ms: download 3001 ms overlapping gunzip 811 ms, parse 3471 ms, sort 0 ms, write 0 ms, index 649 ms: 11 candidates, 85951 repo-hours, 1007 releases; waiting 500 ms; commit 0 ms)
2026-11-08T07:50:37Z [load_day 2024-09-08] 2024-09-08 hour 19: 165326 events in 0 files, snapshot none (task 5356 ms: download 2662 ms overlapping gunzip 749 ms, parse 3346 ms, sort 0 ms, write 0 ms, index 479 ms: 8 candidates, 59923 repo-hours, 912 releases; waiting 469 ms; commit 0 ms)
2026-11-08T07:50:42Z [load_day 2024-09-08] 2024-09-08 hour 20: 159978 events in 0 files, snapshot none (task 5179 ms: download 2552 ms overlapping gunzip 774 ms, parse 3382 ms, sort 0 ms, write 0 ms, index 449 ms: 4 candidates, 59851 repo-hours, 904 releases; waiting 222 ms; commit 0 ms)
2026-11-08T07:50:42Z [load_day 2024-09-08] 2024-09-08 hour 21: 156902 events in 0 files, snapshot none (task 5022 ms: download 2330 ms overlapping gunzip 681 ms, parse 3109 ms, sort 0 ms, write 0 ms, index 425 ms: 8 candidates, 60652 repo-hours, 906 releases; waiting 474 ms; commit 0 ms)
2026-11-08T07:50:47Z [load_day 2024-09-08] 2024-09-08 hour 22: 134880 events in 0 files, snapshot none (task 4481 ms: download 2177 ms overlapping gunzip 606 ms, parse 2600 ms, sort 0 ms, write 0 ms, index 441 ms: 4 candidates, 47735 repo-hours, 867 releases; waiting 547 ms; commit 0 ms)
2026-11-08T07:50:48Z [load_day 2024-09-08] 2024-09-08 hour 23: 133914 events in 0 files, snapshot none (task 4935 ms: download 2163 ms overlapping gunzip 719 ms, parse 3007 ms, sort 0 ms, write 0 ms, index 519 ms: 4 candidates, 49153 repo-hours, 732 releases; waiting 377 ms; commit 0 ms)
2026-11-08T07:50:55Z [load_day 2024-09-08] 2024-09-08: repo_hour merged from 24 files to 1 (1623261 rows, 6821 ms)
2026-11-08T07:50:57Z [load_day 2024-09-08] 2024-09-08: index committed in 9143 ms (24 + 1 + 24 files)
2026-11-08T07:50:57Z [load_day 2024-09-08] 2024-09-08: 3925318 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:50:57Z [load_day 2024-09-08] attempt 1 succeeded