orcaLog in

Runs · run 2555

load_day 2024-06-07, attempt 1 succeeded

Host
73ccef5e07c2:132575
Started
2026-11-08T06:26:03Z
Ended
2026-11-08T06:27:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
692 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
162.9 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2555/load_day/2024-06-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:26:03Z [load_day 2024-06-07] attempt 1 started
2026-11-08T06:26:04Z [load_day 2024-06-07] 2024-06-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:26:10Z [load_day 2024-06-07] 2024-06-07 hour 0: 183154 events in 0 files, snapshot none (task 5680 ms: download 2868 ms overlapping gunzip 932 ms, parse 3832 ms, sort 0 ms, write 0 ms, index 709 ms: 7 candidates, 88773 repo-hours, 1050 releases; waiting 15 ms; commit 0 ms)
2026-11-08T06:26:13Z [load_day 2024-06-07] 2024-06-07 hour 1: 199681 events in 0 files, snapshot none (task 6695 ms: download 3383 ms overlapping gunzip 951 ms, parse 4109 ms, sort 0 ms, write 0 ms, index 1403 ms: 8 candidates, 104537 repo-hours, 877 releases; waiting 4 ms; commit 0 ms)
2026-11-08T06:26:18Z [load_day 2024-06-07] 2024-06-07 hour 2: 161314 events in 0 files, snapshot none (task 7170 ms: download 2979 ms overlapping gunzip 1117 ms, parse 4899 ms, sort 0 ms, write 0 ms, index 934 ms: 9 candidates, 67240 repo-hours, 832 releases; waiting 12 ms; commit 0 ms)
2026-11-08T06:26:21Z [load_day 2024-06-07] 2024-06-07 hour 3: 181328 events in 0 files, snapshot none (task 7464 ms: download 3821 ms overlapping gunzip 1271 ms, parse 5054 ms, sort 0 ms, write 0 ms, index 906 ms: 7 candidates, 75079 repo-hours, 4051 releases; waiting 29 ms; commit 0 ms)
2026-11-08T06:26:24Z [load_day 2024-06-07] 2024-06-07 hour 4: 151962 events in 0 files, snapshot none (task 5255 ms: download 2291 ms overlapping gunzip 859 ms, parse 3459 ms, sort 0 ms, write 0 ms, index 732 ms: 7 candidates, 59323 repo-hours, 655 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:26:27Z [load_day 2024-06-07] 2024-06-07 hour 5: 167491 events in 0 files, snapshot none (task 5771 ms: download 2453 ms overlapping gunzip 909 ms, parse 3865 ms, sort 0 ms, write 0 ms, index 807 ms: 12 candidates, 66967 repo-hours, 852 releases; waiting 2 ms; commit 0 ms)
2026-11-08T06:26:31Z [load_day 2024-06-07] 2024-06-07 hour 6: 203574 events in 0 files, snapshot none (task 6771 ms: download 3837 ms overlapping gunzip 1139 ms, parse 4659 ms, sort 0 ms, write 0 ms, index 761 ms: 4 candidates, 90905 repo-hours, 1049 releases; waiting 17 ms; commit 0 ms)
2026-11-08T06:26:35Z [load_day 2024-06-07] 2024-06-07 hour 7: 212461 events in 0 files, snapshot none (task 7780 ms: download 4166 ms overlapping gunzip 1260 ms, parse 5419 ms, sort 0 ms, write 0 ms, index 878 ms: 7 candidates, 84825 repo-hours, 1048 releases; waiting 13 ms; commit 0 ms)
2026-11-08T06:26:40Z [load_day 2024-06-07] 2024-06-07 hour 8: 219983 events in 0 files, snapshot none (task 8561 ms: download 5887 ms overlapping gunzip 1466 ms, parse 6122 ms, sort 0 ms, write 0 ms, index 769 ms: 12 candidates, 90355 repo-hours, 1265 releases; waiting 0 ms; commit 0 ms)
2026-11-08T06:26:44Z [load_day 2024-06-07] 2024-06-07 hour 9: 233119 events in 0 files, snapshot none (task 8861 ms: download 5020 ms overlapping gunzip 1421 ms, parse 6230 ms, sort 0 ms, write 0 ms, index 990 ms: 8 candidates, 97554 repo-hours, 1363 releases; waiting 19 ms; commit 0 ms)
2026-11-08T06:26:49Z [load_day 2024-06-07] 2024-06-07 hour 10: 224382 events in 0 files, snapshot none (task 7634 ms: download 4850 ms overlapping gunzip 1310 ms, parse 5331 ms, sort 0 ms, write 0 ms, index 767 ms: 10 candidates, 86968 repo-hours, 1376 releases; waiting 3 ms; commit 0 ms)
2026-11-08T06:26:52Z [load_day 2024-06-07] 2024-06-07 hour 11: 211665 events in 0 files, snapshot none (task 7415 ms: download 3987 ms overlapping gunzip 1244 ms, parse 5104 ms, sort 0 ms, write 0 ms, index 835 ms: 8 candidates, 82028 repo-hours, 1094 releases; waiting 6 ms; commit 0 ms)
2026-11-08T06:26:57Z [load_day 2024-06-07] 2024-06-07 hour 12: 262258 events in 0 files, snapshot none (task 8015 ms: download 5228 ms overlapping gunzip 1280 ms, parse 5661 ms, sort 0 ms, write 0 ms, index 852 ms: 11 candidates, 124738 repo-hours, 1250 releases; waiting 22 ms; commit 0 ms)
2026-11-08T06:27:00Z [load_day 2024-06-07] 2024-06-07 hour 13: 242231 events in 0 files, snapshot none (task 7188 ms: download 4395 ms overlapping gunzip 1183 ms, parse 4899 ms, sort 0 ms, write 0 ms, index 876 ms: 7 candidates, 110968 repo-hours, 1312 releases; waiting 7 ms; commit 0 ms)
2026-11-08T06:27:05Z [load_day 2024-06-07] 2024-06-07 hour 14: 235514 events in 0 files, snapshot none (task 7855 ms: download 5401 ms overlapping gunzip 1295 ms, parse 5620 ms, sort 0 ms, write 0 ms, index 717 ms: 6 candidates, 100385 repo-hours, 1308 releases; waiting 22 ms; commit 0 ms)
2026-11-08T06:27:07Z [load_day 2024-06-07] 2024-06-07 hour 15: 236006 events in 0 files, snapshot none (task 6720 ms: download 4294 ms overlapping gunzip 1117 ms, parse 4707 ms, sort 0 ms, write 0 ms, index 687 ms: 11 candidates, 103397 repo-hours, 1368 releases; waiting 1 ms; commit 0 ms)
2026-11-08T06:27:13Z [load_day 2024-06-07] 2024-06-07 hour 16: 236550 events in 0 files, snapshot none (task 7090 ms: download 3502 ms overlapping gunzip 1228 ms, parse 5021 ms, sort 0 ms, write 0 ms, index 634 ms: 9 candidates, 88478 repo-hours, 1033 releases; waiting 8 ms; commit 0 ms)
2026-11-08T06:27:14Z [load_day 2024-06-07] 2024-06-07 hour 17: 221497 events in 0 files, snapshot none (task 6270 ms: download 3596 ms overlapping gunzip 961 ms, parse 4432 ms, sort 0 ms, write 0 ms, index 678 ms: 10 candidates, 78141 repo-hours, 885 releases; waiting 12 ms; commit 0 ms)
2026-11-08T06:27:21Z [load_day 2024-06-07] 2024-06-07 hour 18: 215226 events in 0 files, snapshot none (task 7831 ms: download 4722 ms overlapping gunzip 1152 ms, parse 5237 ms, sort 0 ms, write 0 ms, index 1219 ms: 12 candidates, 92207 repo-hours, 1139 releases; waiting 15 ms; commit 0 ms)
2026-11-08T06:27:21Z [load_day 2024-06-07] 2024-06-07 hour 19: 188480 events in 0 files, snapshot none (task 6635 ms: download 4021 ms overlapping gunzip 1087 ms, parse 4536 ms, sort 0 ms, write 0 ms, index 817 ms: 9 candidates, 71800 repo-hours, 1084 releases; waiting 9 ms; commit 0 ms)
2026-11-08T06:27:29Z [load_day 2024-06-07] 2024-06-07 hour 20: 178054 events in 0 files, snapshot none (task 6556 ms: download 3850 ms overlapping gunzip 1112 ms, parse 4650 ms, sort 0 ms, write 0 ms, index 589 ms: 8 candidates, 70340 repo-hours, 964 releases; waiting 14 ms; commit 0 ms)
2026-11-08T06:27:29Z [load_day 2024-06-07] 2024-06-07 hour 21: 177296 events in 0 files, snapshot none (task 6608 ms: download 3673 ms overlapping gunzip 1167 ms, parse 4623 ms, sort 0 ms, write 0 ms, index 620 ms: 10 candidates, 69932 repo-hours, 959 releases; waiting 12 ms; commit 0 ms)
2026-11-08T06:27:34Z [load_day 2024-06-07] 2024-06-07 hour 22: 147956 events in 0 files, snapshot none (task 4765 ms: download 2566 ms overlapping gunzip 849 ms, parse 3341 ms, sort 0 ms, write 0 ms, index 373 ms: 8 candidates, 54418 repo-hours, 1043 releases; waiting 14 ms; commit 0 ms)
2026-11-08T06:27:34Z [load_day 2024-06-07] 2024-06-07 hour 23: 136914 events in 0 files, snapshot none (task 4440 ms: download 2084 ms overlapping gunzip 729 ms, parse 3129 ms, sort 0 ms, write 0 ms, index 379 ms: 4 candidates, 50431 repo-hours, 667 releases; waiting 13 ms; commit 0 ms)
2026-11-08T06:27:43Z [load_day 2024-06-07] 2024-06-07: repo_hour merged from 24 files to 1 (2009789 rows, 8809 ms)
2026-11-08T06:27:45Z [load_day 2024-06-07] 2024-06-07: index committed in 11439 ms (24 + 1 + 24 files)
2026-11-08T06:27:45Z [load_day 2024-06-07] 2024-06-07: 4828096 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:27:45Z [load_day 2024-06-07] attempt 1 succeeded