orcaLog in

Runs · run 3766

load_day 2025-04-08, attempt 1 succeeded

Host
73ccef5e07c2:284414
Started
2026-11-08T11:17:18Z
Ended
2026-11-08T11:19:41Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
886 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
219.8 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3766/load_day/2025-04-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:17:18Z [load_day 2025-04-08] attempt 1 started
2026-11-08T11:17:19Z [load_day 2025-04-08] 2025-04-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:17:29Z [load_day 2025-04-08] 2025-04-08 hour 0: 222816 events in 0 files, snapshot none (task 9463 ms: download 6670 ms overlapping gunzip 1540 ms, parse 6204 ms, sort 0 ms, write 0 ms, index 942 ms: 9 candidates, 101170 repo-hours, 1167 releases; waiting 516 ms; commit 0 ms)
2026-11-08T11:17:29Z [load_day 2025-04-08] 2025-04-08 hour 1: 245866 events in 0 files, snapshot none (task 9687 ms: download 6640 ms overlapping gunzip 1515 ms, parse 6301 ms, sort 0 ms, write 0 ms, index 993 ms: 7 candidates, 131737 repo-hours, 999 releases; waiting 523 ms; commit 0 ms)
2026-11-08T11:17:39Z [load_day 2025-04-08] 2025-04-08 hour 2: 224971 events in 0 files, snapshot none (task 9659 ms: download 6823 ms overlapping gunzip 1613 ms, parse 6390 ms, sort 0 ms, write 0 ms, index 791 ms: 12 candidates, 96984 repo-hours, 883 releases; waiting 525 ms; commit 0 ms)
2026-11-08T11:17:39Z [load_day 2025-04-08] 2025-04-08 hour 3: 220703 events in 0 files, snapshot none (task 8429 ms: download 5826 ms overlapping gunzip 1350 ms, parse 5681 ms, sort 0 ms, write 0 ms, index 662 ms: 7 candidates, 90897 repo-hours, 2933 releases; waiting 439 ms; commit 0 ms)
2026-11-08T11:17:48Z [load_day 2025-04-08] 2025-04-08 hour 4: 201349 events in 0 files, snapshot none (task 7733 ms: download 4946 ms overlapping gunzip 1225 ms, parse 4999 ms, sort 0 ms, write 0 ms, index 697 ms: 1 candidates, 77758 repo-hours, 869 releases; waiting 524 ms; commit 0 ms)
2026-11-08T11:17:50Z [load_day 2025-04-08] 2025-04-08 hour 5: 220884 events in 0 files, snapshot none (task 9475 ms: download 6523 ms overlapping gunzip 1553 ms, parse 6203 ms, sort 0 ms, write 0 ms, index 983 ms: 7 candidates, 85005 repo-hours, 1032 releases; waiting 491 ms; commit 0 ms)
2026-11-08T11:17:58Z [load_day 2025-04-08] 2025-04-08 hour 6: 244473 events in 0 files, snapshot none (task 9784 ms: download 6720 ms overlapping gunzip 1524 ms, parse 6750 ms, sort 0 ms, write 0 ms, index 796 ms: 5 candidates, 107965 repo-hours, 1113 releases; waiting 168 ms; commit 0 ms)
2026-11-08T11:18:00Z [load_day 2025-04-08] 2025-04-08 hour 7: 253435 events in 0 files, snapshot none (task 9797 ms: download 7015 ms overlapping gunzip 1471 ms, parse 6583 ms, sort 0 ms, write 0 ms, index 978 ms: 12 candidates, 102814 repo-hours, 1130 releases; waiting 474 ms; commit 0 ms)
2026-11-08T11:18:11Z [load_day 2025-04-08] 2025-04-08 hour 8: 262405 events in 0 files, snapshot none (task 12023 ms: download 8474 ms overlapping gunzip 2064 ms, parse 7938 ms, sort 0 ms, write 0 ms, index 1217 ms: 8 candidates, 113007 repo-hours, 1227 releases; waiting 556 ms; commit 0 ms)
2026-11-08T11:18:12Z [load_day 2025-04-08] 2025-04-08 hour 9: 266437 events in 0 files, snapshot none (task 11309 ms: download 8524 ms overlapping gunzip 1936 ms, parse 7981 ms, sort 0 ms, write 0 ms, index 793 ms: 7 candidates, 115640 repo-hours, 1573 releases; waiting 287 ms; commit 0 ms)
2026-11-08T11:18:22Z [load_day 2025-04-08] 2025-04-08 hour 10: 254138 events in 0 files, snapshot none (task 10965 ms: download 7322 ms overlapping gunzip 1775 ms, parse 7391 ms, sort 0 ms, write 0 ms, index 1037 ms: 7 candidates, 105709 repo-hours, 1183 releases; waiting 478 ms; commit 0 ms)
2026-11-08T11:18:24Z [load_day 2025-04-08] 2025-04-08 hour 11: 258642 events in 0 files, snapshot none (task 10828 ms: download 8036 ms overlapping gunzip 1661 ms, parse 7628 ms, sort 0 ms, write 0 ms, index 770 ms: 5 candidates, 104602 repo-hours, 1130 releases; waiting 503 ms; commit 0 ms)
2026-11-08T11:18:35Z [load_day 2025-04-08] 2025-04-08 hour 12: 280620 events in 0 files, snapshot none (task 12009 ms: download 7614 ms overlapping gunzip 1868 ms, parse 7535 ms, sort 0 ms, write 0 ms, index 1486 ms: 13 candidates, 143849 repo-hours, 1520 releases; waiting 542 ms; commit 0 ms)
2026-11-08T11:18:36Z [load_day 2025-04-08] 2025-04-08 hour 13: 272937 events in 0 files, snapshot none (task 12296 ms: download 9089 ms overlapping gunzip 1967 ms, parse 8388 ms, sort 0 ms, write 0 ms, index 1112 ms: 11 candidates, 131614 repo-hours, 1291 releases; waiting 533 ms; commit 0 ms)
2026-11-08T11:18:47Z [load_day 2025-04-08] 2025-04-08 hour 14: 267246 events in 0 files, snapshot none (task 12000 ms: download 8055 ms overlapping gunzip 1867 ms, parse 7934 ms, sort 0 ms, write 0 ms, index 1388 ms: 15 candidates, 118265 repo-hours, 1299 releases; waiting 579 ms; commit 0 ms)
2026-11-08T11:18:49Z [load_day 2025-04-08] 2025-04-08 hour 15: 271023 events in 0 files, snapshot none (task 12393 ms: download 8954 ms overlapping gunzip 1950 ms, parse 8251 ms, sort 0 ms, write 0 ms, index 1107 ms: 2 candidates, 121873 repo-hours, 1407 releases; waiting 747 ms; commit 0 ms)
2026-11-08T11:18:58Z [load_day 2025-04-08] 2025-04-08 hour 16: 261579 events in 0 files, snapshot none (task 10235 ms: download 6625 ms overlapping gunzip 1626 ms, parse 6668 ms, sort 0 ms, write 0 ms, index 1087 ms: 5 candidates, 114184 repo-hours, 1268 releases; waiting 498 ms; commit 0 ms)
2026-11-08T11:19:00Z [load_day 2025-04-08] 2025-04-08 hour 17: 261937 events in 0 files, snapshot none (task 10248 ms: download 7243 ms overlapping gunzip 1602 ms, parse 6872 ms, sort 0 ms, write 0 ms, index 953 ms: 6 candidates, 108537 repo-hours, 1186 releases; waiting 514 ms; commit 0 ms)
2026-11-08T11:19:08Z [load_day 2025-04-08] 2025-04-08 hour 18: 264244 events in 0 files, snapshot none (task 9548 ms: download 5966 ms overlapping gunzip 1515 ms, parse 6310 ms, sort 0 ms, write 0 ms, index 1057 ms: 5 candidates, 116926 repo-hours, 1360 releases; waiting 362 ms; commit 0 ms)
2026-11-08T11:19:10Z [load_day 2025-04-08] 2025-04-08 hour 19: 243610 events in 0 files, snapshot none (task 9101 ms: download 6358 ms overlapping gunzip 1460 ms, parse 6033 ms, sort 0 ms, write 0 ms, index 849 ms: 6 candidates, 96615 repo-hours, 1238 releases; waiting 523 ms; commit 0 ms)
2026-11-08T11:19:17Z [load_day 2025-04-08] 2025-04-08 hour 20: 246735 events in 0 files, snapshot none (task 8436 ms: download 5670 ms overlapping gunzip 1278 ms, parse 5243 ms, sort 0 ms, write 0 ms, index 829 ms: 11 candidates, 93080 repo-hours, 1213 releases; waiting 797 ms; commit 0 ms)
2026-11-08T11:19:19Z [load_day 2025-04-08] 2025-04-08 hour 21: 237633 events in 0 files, snapshot none (task 8573 ms: download 5675 ms overlapping gunzip 1237 ms, parse 5261 ms, sort 0 ms, write 0 ms, index 853 ms: 9 candidates, 89034 repo-hours, 1272 releases; waiting 926 ms; commit 0 ms)
2026-11-08T11:19:25Z [load_day 2025-04-08] 2025-04-08 hour 22: 205590 events in 0 files, snapshot none (task 7759 ms: download 4904 ms overlapping gunzip 1097 ms, parse 5236 ms, sort 0 ms, write 0 ms, index 580 ms: 6 candidates, 78363 repo-hours, 1189 releases; waiting 500 ms; commit 0 ms)
2026-11-08T11:19:27Z [load_day 2025-04-08] 2025-04-08 hour 23: 196434 events in 0 files, snapshot none (task 7204 ms: download 4690 ms overlapping gunzip 1114 ms, parse 4652 ms, sort 0 ms, write 0 ms, index 630 ms: 7 candidates, 73832 repo-hours, 1093 releases; waiting 500 ms; commit 0 ms)
2026-11-08T11:19:38Z [load_day 2025-04-08] 2025-04-08: repo_hour merged from 24 files to 1 (2519460 rows, 11122 ms)
2026-11-08T11:19:40Z [load_day 2025-04-08] 2025-04-08: index committed in 13932 ms (24 + 1 + 24 files)
2026-11-08T11:19:40Z [load_day 2025-04-08] 2025-04-08: 5885707 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:19:40Z [load_day 2025-04-08] attempt 1 succeeded