orcaLog in

Runs · run 2725

load_day 2024-07-17, attempt 1 succeeded

Host
73ccef5e07c2:150774
Started
2026-11-08T07:01:40Z
Ended
2026-11-08T07:03:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
900 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
182.5 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2725/load_day/2024-07-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:01:40Z [load_day 2024-07-17] attempt 1 started
2026-11-08T07:01:41Z [load_day 2024-07-17] 2024-07-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:01:49Z [load_day 2024-07-17] 2024-07-17 hour 0: 179917 events in 0 files, snapshot none (task 7364 ms: download 4538 ms overlapping gunzip 1072 ms, parse 4597 ms, sort 0 ms, write 0 ms, index 942 ms: 13 candidates, 94714 repo-hours, 1109 releases; waiting 481 ms; commit 0 ms)
2026-11-08T07:01:49Z [load_day 2024-07-17] 2024-07-17 hour 1: 193170 events in 0 files, snapshot none (task 7456 ms: download 4289 ms overlapping gunzip 1034 ms, parse 4516 ms, sort 0 ms, write 0 ms, index 1145 ms: 11 candidates, 110102 repo-hours, 816 releases; waiting 532 ms; commit 0 ms)
2026-11-08T07:01:56Z [load_day 2024-07-17] 2024-07-17 hour 2: 162386 events in 0 files, snapshot none (task 6813 ms: download 4115 ms overlapping gunzip 1044 ms, parse 4328 ms, sort 0 ms, write 0 ms, index 604 ms: 7 candidates, 72362 repo-hours, 806 releases; waiting 538 ms; commit 0 ms)
2026-11-08T07:01:56Z [load_day 2024-07-17] 2024-07-17 hour 3: 179063 events in 0 files, snapshot none (task 7214 ms: download 4396 ms overlapping gunzip 1094 ms, parse 4535 ms, sort 0 ms, write 0 ms, index 630 ms: 7 candidates, 78291 repo-hours, 5364 releases; waiting 729 ms; commit 0 ms)
2026-11-08T07:02:03Z [load_day 2024-07-17] 2024-07-17 hour 4: 151203 events in 0 files, snapshot none (task 6318 ms: download 3149 ms overlapping gunzip 982 ms, parse 4093 ms, sort 0 ms, write 0 ms, index 606 ms: 7 candidates, 61987 repo-hours, 678 releases; waiting 333 ms; commit 0 ms)
2026-11-08T07:02:04Z [load_day 2024-07-17] 2024-07-17 hour 5: 172026 events in 0 files, snapshot none (task 7517 ms: download 5134 ms overlapping gunzip 1244 ms, parse 5000 ms, sort 0 ms, write 0 ms, index 514 ms: 6 candidates, 70142 repo-hours, 870 releases; waiting 501 ms; commit 0 ms)
2026-11-08T07:02:11Z [load_day 2024-07-17] 2024-07-17 hour 6: 205925 events in 0 files, snapshot none (task 7818 ms: download 5132 ms overlapping gunzip 1203 ms, parse 4964 ms, sort 0 ms, write 0 ms, index 725 ms: 7 candidates, 97705 repo-hours, 971 releases; waiting 700 ms; commit 0 ms)
2026-11-08T07:02:13Z [load_day 2024-07-17] 2024-07-17 hour 7: 209879 events in 0 files, snapshot none (task 7943 ms: download 5361 ms overlapping gunzip 1189 ms, parse 5320 ms, sort 0 ms, write 0 ms, index 672 ms: 9 candidates, 89101 repo-hours, 1039 releases; waiting 493 ms; commit 0 ms)
2026-11-08T07:02:20Z [load_day 2024-07-17] 2024-07-17 hour 8: 222391 events in 0 files, snapshot none (task 8031 ms: download 5320 ms overlapping gunzip 1200 ms, parse 5066 ms, sort 0 ms, write 0 ms, index 810 ms: 9 candidates, 95896 repo-hours, 1196 releases; waiting 630 ms; commit 0 ms)
2026-11-08T07:02:21Z [load_day 2024-07-17] 2024-07-17 hour 9: 228941 events in 0 files, snapshot none (task 7455 ms: download 4957 ms overlapping gunzip 1164 ms, parse 4818 ms, sort 0 ms, write 0 ms, index 674 ms: 7 candidates, 101269 repo-hours, 1217 releases; waiting 513 ms; commit 0 ms)
2026-11-08T07:02:27Z [load_day 2024-07-17] 2024-07-17 hour 10: 214407 events in 0 files, snapshot none (task 6837 ms: download 4381 ms overlapping gunzip 1036 ms, parse 4377 ms, sort 0 ms, write 0 ms, index 628 ms: 10 candidates, 90978 repo-hours, 1149 releases; waiting 523 ms; commit 0 ms)
2026-11-08T07:02:28Z [load_day 2024-07-17] 2024-07-17 hour 11: 210200 events in 0 files, snapshot none (task 6805 ms: download 4237 ms overlapping gunzip 1035 ms, parse 4329 ms, sort 0 ms, write 0 ms, index 707 ms: 10 candidates, 88258 repo-hours, 1255 releases; waiting 511 ms; commit 0 ms)
2026-11-08T07:02:39Z [load_day 2024-07-17] 2024-07-17 hour 12: 265106 events in 0 files, snapshot none (task 11660 ms: download 7396 ms overlapping gunzip 1837 ms, parse 8149 ms, sort 0 ms, write 0 ms, index 1175 ms: 12 candidates, 135541 repo-hours, 1176 releases; waiting 255 ms; commit 0 ms)
2026-11-08T07:02:40Z [load_day 2024-07-17] 2024-07-17 hour 13: 255011 events in 0 files, snapshot none (task 11656 ms: download 7876 ms overlapping gunzip 1864 ms, parse 8031 ms, sort 0 ms, write 0 ms, index 954 ms: 7 candidates, 124818 repo-hours, 1323 releases; waiting 511 ms; commit 0 ms)
2026-11-08T07:02:49Z [load_day 2024-07-17] 2024-07-17 hour 14: 245273 events in 0 files, snapshot none (task 9295 ms: download 6475 ms overlapping gunzip 1503 ms, parse 6440 ms, sort 0 ms, write 0 ms, index 726 ms: 20 candidates, 112538 repo-hours, 1232 releases; waiting 383 ms; commit 0 ms)
2026-11-08T07:02:51Z [load_day 2024-07-17] 2024-07-17 hour 15: 243669 events in 0 files, snapshot none (task 9812 ms: download 7062 ms overlapping gunzip 1493 ms, parse 6553 ms, sort 0 ms, write 0 ms, index 995 ms: 14 candidates, 116177 repo-hours, 1224 releases; waiting 547 ms; commit 0 ms)
2026-11-08T07:02:58Z [load_day 2024-07-17] 2024-07-17 hour 16: 210960 events in 0 files, snapshot none (task 8606 ms: download 5932 ms overlapping gunzip 1381 ms, parse 6046 ms, sort 0 ms, write 0 ms, index 686 ms: 13 candidates, 95118 repo-hours, 1049 releases; waiting 211 ms; commit 0 ms)
2026-11-08T07:02:59Z [load_day 2024-07-17] 2024-07-17 hour 17: 211682 events in 0 files, snapshot none (task 8079 ms: download 5414 ms overlapping gunzip 1210 ms, parse 5185 ms, sort 0 ms, write 0 ms, index 895 ms: 6 candidates, 89931 repo-hours, 1030 releases; waiting 545 ms; commit 0 ms)
2026-11-08T07:03:07Z [load_day 2024-07-17] 2024-07-17 hour 18: 225540 events in 0 files, snapshot none (task 8437 ms: download 5720 ms overlapping gunzip 1313 ms, parse 5530 ms, sort 0 ms, write 0 ms, index 734 ms: 7 candidates, 110717 repo-hours, 1147 releases; waiting 501 ms; commit 0 ms)
2026-11-08T07:03:08Z [load_day 2024-07-17] 2024-07-17 hour 19: 193172 events in 0 files, snapshot none (task 7805 ms: download 5381 ms overlapping gunzip 1218 ms, parse 5303 ms, sort 0 ms, write 0 ms, index 561 ms: 7 candidates, 78906 repo-hours, 985 releases; waiting 457 ms; commit 0 ms)
2026-11-08T07:03:15Z [load_day 2024-07-17] 2024-07-17 hour 20: 186688 events in 0 files, snapshot none (task 7321 ms: download 4668 ms overlapping gunzip 1172 ms, parse 4632 ms, sort 0 ms, write 0 ms, index 593 ms: 14 candidates, 76591 repo-hours, 966 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:03:15Z [load_day 2024-07-17] 2024-07-17 hour 21: 177757 events in 0 files, snapshot none (task 7241 ms: download 4672 ms overlapping gunzip 1108 ms, parse 4735 ms, sort 0 ms, write 0 ms, index 539 ms: 10 candidates, 75835 repo-hours, 1185 releases; waiting 505 ms; commit 0 ms)
2026-11-08T07:03:22Z [load_day 2024-07-17] 2024-07-17 hour 22: 152736 events in 0 files, snapshot none (task 6043 ms: download 3236 ms overlapping gunzip 903 ms, parse 3716 ms, sort 0 ms, write 0 ms, index 515 ms: 13 candidates, 59105 repo-hours, 1099 releases; waiting 593 ms; commit 0 ms)
2026-11-08T07:03:22Z [load_day 2024-07-17] 2024-07-17 hour 23: 139464 events in 0 files, snapshot none (task 5651 ms: download 2635 ms overlapping gunzip 882 ms, parse 3595 ms, sort 0 ms, write 0 ms, index 516 ms: 8 candidates, 54375 repo-hours, 783 releases; waiting 326 ms; commit 0 ms)
2026-11-08T07:03:31Z [load_day 2024-07-17] 2024-07-17: repo_hour merged from 24 files to 1 (2180457 rows, 9322 ms)
2026-11-08T07:03:39Z [load_day 2024-07-17] 2024-07-17: index committed in 17352 ms (24 + 1 + 24 files)
2026-11-08T07:03:39Z [load_day 2024-07-17] 2024-07-17: 4836566 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:03:39Z [load_day 2024-07-17] attempt 1 succeeded