orcaLog in

Runs · run 3173

load_day 2024-11-06, attempt 1 succeeded

Host
73ccef5e07c2:203616
Started
2026-11-08T08:41:05Z
Ended
2026-11-08T08:43:19Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
821 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
214.0 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3173/load_day/2024-11-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:41:05Z [load_day 2024-11-06] attempt 1 started
2026-11-08T08:41:06Z [load_day 2024-11-06] 2024-11-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:41:15Z [load_day 2024-11-06] 2024-11-06 hour 0: 198018 events in 0 files, snapshot none (task 8259 ms: download 4119 ms overlapping gunzip 1207 ms, parse 5266 ms, sort 0 ms, write 0 ms, index 1046 ms: 11 candidates, 96282 repo-hours, 1138 releases; waiting 202 ms; commit 0 ms)
2026-11-08T08:41:15Z [load_day 2024-11-06] 2024-11-06 hour 1: 205231 events in 0 files, snapshot none (task 6890 ms: download 3662 ms overlapping gunzip 954 ms, parse 4143 ms, sort 0 ms, write 0 ms, index 1208 ms: 10 candidates, 110641 repo-hours, 897 releases; waiting 333 ms; commit 0 ms)
2026-11-08T08:41:23Z [load_day 2024-11-06] 2024-11-06 hour 2: 184305 events in 0 files, snapshot none (task 7557 ms: download 4430 ms overlapping gunzip 1126 ms, parse 4803 ms, sort 0 ms, write 0 ms, index 857 ms: 4 candidates, 80682 repo-hours, 832 releases; waiting 502 ms; commit 0 ms)
2026-11-08T08:41:24Z [load_day 2024-11-06] 2024-11-06 hour 3: 202668 events in 0 files, snapshot none (task 7893 ms: download 4541 ms overlapping gunzip 1200 ms, parse 5057 ms, sort 0 ms, write 0 ms, index 848 ms: 2 candidates, 78915 repo-hours, 3877 releases; waiting 512 ms; commit 0 ms)
2026-11-08T08:41:31Z [load_day 2024-11-06] 2024-11-06 hour 4: 175984 events in 0 files, snapshot none (task 6743 ms: download 4406 ms overlapping gunzip 1055 ms, parse 4388 ms, sort 0 ms, write 0 ms, index 488 ms: 5 candidates, 65068 repo-hours, 571 releases; waiting 501 ms; commit 0 ms)
2026-11-08T08:41:32Z [load_day 2024-11-06] 2024-11-06 hour 5: 188009 events in 0 files, snapshot none (task 7558 ms: download 5154 ms overlapping gunzip 1316 ms, parse 4922 ms, sort 0 ms, write 0 ms, index 580 ms: 2 candidates, 68688 repo-hours, 766 releases; waiting 445 ms; commit 0 ms)
2026-11-08T08:41:37Z [load_day 2024-11-06] 2024-11-06 hour 6: 211872 events in 0 files, snapshot none (task 6183 ms: download 3610 ms overlapping gunzip 980 ms, parse 4068 ms, sort 0 ms, write 0 ms, index 680 ms: 5 candidates, 88542 repo-hours, 869 releases; waiting 182 ms; commit 0 ms)
2026-11-08T08:41:39Z [load_day 2024-11-06] 2024-11-06 hour 7: 211449 events in 0 files, snapshot none (task 7099 ms: download 4812 ms overlapping gunzip 1131 ms, parse 4545 ms, sort 0 ms, write 0 ms, index 610 ms: 3 candidates, 80084 repo-hours, 915 releases; waiting 549 ms; commit 0 ms)
2026-11-08T08:41:45Z [load_day 2024-11-06] 2024-11-06 hour 8: 227549 events in 0 files, snapshot none (task 7530 ms: download 4925 ms overlapping gunzip 1186 ms, parse 4872 ms, sort 0 ms, write 0 ms, index 842 ms: 10 candidates, 92659 repo-hours, 1083 releases; waiting 366 ms; commit 0 ms)
2026-11-08T08:41:49Z [load_day 2024-11-06] 2024-11-06 hour 9: 245911 events in 0 files, snapshot none (task 9454 ms: download 6223 ms overlapping gunzip 1628 ms, parse 6075 ms, sort 0 ms, write 0 ms, index 973 ms: 2 candidates, 100427 repo-hours, 1411 releases; waiting 534 ms; commit 0 ms)
2026-11-08T08:41:57Z [load_day 2024-11-06] 2024-11-06 hour 10: 242485 events in 0 files, snapshot none (task 11211 ms: download 7517 ms overlapping gunzip 1877 ms, parse 7562 ms, sort 0 ms, write 0 ms, index 974 ms: 4 candidates, 94197 repo-hours, 1217 releases; waiting 483 ms; commit 0 ms)
2026-11-08T08:42:00Z [load_day 2024-11-06] 2024-11-06 hour 11: 237625 events in 0 files, snapshot none (task 9821 ms: download 6986 ms overlapping gunzip 1514 ms, parse 6471 ms, sort 0 ms, write 0 ms, index 1009 ms: 10 candidates, 89630 repo-hours, 1071 releases; waiting 505 ms; commit 0 ms)
2026-11-08T08:42:08Z [load_day 2024-11-06] 2024-11-06 hour 12: 268114 events in 0 files, snapshot none (task 10248 ms: download 5233 ms overlapping gunzip 1450 ms, parse 6352 ms, sort 0 ms, write 0 ms, index 1713 ms: 12 candidates, 134308 repo-hours, 1200 releases; waiting 508 ms; commit 0 ms)
2026-11-08T08:42:12Z [load_day 2024-11-06] 2024-11-06 hour 13: 267266 events in 0 files, snapshot none (task 11660 ms: download 8583 ms overlapping gunzip 1897 ms, parse 7757 ms, sort 0 ms, write 0 ms, index 1224 ms: 10 candidates, 116776 repo-hours, 1303 releases; waiting 491 ms; commit 0 ms)
2026-11-08T08:42:19Z [load_day 2024-11-06] 2024-11-06 hour 14: 263095 events in 0 files, snapshot none (task 10744 ms: download 7785 ms overlapping gunzip 1802 ms, parse 7181 ms, sort 0 ms, write 0 ms, index 955 ms: 8 candidates, 104902 repo-hours, 1286 releases; waiting 523 ms; commit 0 ms)
2026-11-08T08:42:25Z [load_day 2024-11-06] 2024-11-06 hour 15: 270629 events in 0 files, snapshot none (task 12365 ms: download 8294 ms overlapping gunzip 2022 ms, parse 7953 ms, sort 0 ms, write 0 ms, index 1506 ms: 10 candidates, 112152 repo-hours, 1301 releases; waiting 512 ms; commit 0 ms)
2026-11-08T08:42:31Z [load_day 2024-11-06] 2024-11-06 hour 16: 259609 events in 0 files, snapshot none (task 12110 ms: download 9176 ms overlapping gunzip 2156 ms, parse 8096 ms, sort 0 ms, write 0 ms, index 851 ms: 14 candidates, 102883 repo-hours, 1149 releases; waiting 687 ms; commit 0 ms)
2026-11-08T08:42:37Z [load_day 2024-11-06] 2024-11-06 hour 17: 244486 events in 0 files, snapshot none (task 10980 ms: download 7219 ms overlapping gunzip 1848 ms, parse 7179 ms, sort 0 ms, write 0 ms, index 1118 ms: 3 candidates, 93721 repo-hours, 1204 releases; waiting 490 ms; commit 0 ms)
2026-11-08T08:42:44Z [load_day 2024-11-06] 2024-11-06 hour 18: 250257 events in 0 files, snapshot none (task 11879 ms: download 8682 ms overlapping gunzip 2013 ms, parse 8185 ms, sort 0 ms, write 0 ms, index 938 ms: 11 candidates, 104443 repo-hours, 1272 releases; waiting 461 ms; commit 0 ms)
2026-11-08T08:42:47Z [load_day 2024-11-06] 2024-11-06 hour 19: 229258 events in 0 files, snapshot none (task 10118 ms: download 6976 ms overlapping gunzip 1775 ms, parse 6632 ms, sort 0 ms, write 0 ms, index 1012 ms: 7 candidates, 82486 repo-hours, 1412 releases; waiting 387 ms; commit 0 ms)
2026-11-08T08:42:56Z [load_day 2024-11-06] 2024-11-06 hour 20: 231497 events in 0 files, snapshot none (task 11271 ms: download 8841 ms overlapping gunzip 2052 ms, parse 7801 ms, sort 0 ms, write 0 ms, index 697 ms: 5 candidates, 82879 repo-hours, 1325 releases; waiting 505 ms; commit 0 ms)
2026-11-08T08:42:58Z [load_day 2024-11-06] 2024-11-06 hour 21: 226055 events in 0 files, snapshot none (task 9717 ms: download 7097 ms overlapping gunzip 1613 ms, parse 6439 ms, sort 0 ms, write 0 ms, index 933 ms: 6 candidates, 79458 repo-hours, 1695 releases; waiting 423 ms; commit 0 ms)
2026-11-08T08:43:06Z [load_day 2024-11-06] 2024-11-06 hour 22: 201878 events in 0 files, snapshot none (task 9342 ms: download 6076 ms overlapping gunzip 1636 ms, parse 6310 ms, sort 0 ms, write 0 ms, index 763 ms: 6 candidates, 69039 repo-hours, 1399 releases; waiting 285 ms; commit 0 ms)
2026-11-08T08:43:07Z [load_day 2024-11-06] 2024-11-06 hour 23: 192036 events in 0 files, snapshot none (task 8605 ms: download 5987 ms overlapping gunzip 1342 ms, parse 5738 ms, sort 0 ms, write 0 ms, index 669 ms: 3 candidates, 65931 repo-hours, 930 releases; waiting 521 ms; commit 0 ms)
2026-11-08T08:43:16Z [load_day 2024-11-06] 2024-11-06: repo_hour merged from 24 files to 1 (2194793 rows, 9670 ms)
2026-11-08T08:43:19Z [load_day 2024-11-06] 2024-11-06: index committed in 12111 ms (24 + 1 + 24 files)
2026-11-08T08:43:19Z [load_day 2024-11-06] 2024-11-06: 5435286 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:43:19Z [load_day 2024-11-06] attempt 1 succeeded