orcaLog in

Runs · run 3836

load_day 2025-04-28, attempt 1 succeeded

Host
73ccef5e07c2:295016
Started
2026-11-08T11:38:46Z
Ended
2026-11-08T11:41:07Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
878 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
225.7 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3836/load_day/2025-04-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:38:46Z [load_day 2025-04-28] attempt 1 started
2026-11-08T11:38:47Z [load_day 2025-04-28] 2025-04-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:38:55Z [load_day 2025-04-28] 2025-04-28 hour 0: 195409 events in 0 files, snapshot none (task 7508 ms: download 4894 ms overlapping gunzip 1206 ms, parse 4749 ms, sort 0 ms, write 0 ms, index 775 ms: 4 candidates, 86866 repo-hours, 1268 releases; waiting 499 ms; commit 0 ms)
2026-11-08T11:38:55Z [load_day 2025-04-28] 2025-04-28 hour 1: 226725 events in 0 files, snapshot none (task 7754 ms: download 4878 ms overlapping gunzip 1217 ms, parse 5062 ms, sort 0 ms, write 0 ms, index 990 ms: 9 candidates, 121602 repo-hours, 970 releases; waiting 211 ms; commit 0 ms)
2026-11-08T11:39:03Z [load_day 2025-04-28] 2025-04-28 hour 2: 207361 events in 0 files, snapshot none (task 8199 ms: download 5605 ms overlapping gunzip 1320 ms, parse 5192 ms, sort 0 ms, write 0 ms, index 755 ms: 7 candidates, 90101 repo-hours, 1003 releases; waiting 594 ms; commit 0 ms)
2026-11-08T11:39:04Z [load_day 2025-04-28] 2025-04-28 hour 3: 214718 events in 0 files, snapshot none (task 8288 ms: download 5543 ms overlapping gunzip 1349 ms, parse 5421 ms, sort 0 ms, write 0 ms, index 750 ms: 9 candidates, 90328 repo-hours, 2896 releases; waiting 494 ms; commit 0 ms)
2026-11-08T11:39:12Z [load_day 2025-04-28] 2025-04-28 hour 4: 201302 events in 0 files, snapshot none (task 7677 ms: download 4980 ms overlapping gunzip 1267 ms, parse 4934 ms, sort 0 ms, write 0 ms, index 625 ms: 4 candidates, 75483 repo-hours, 857 releases; waiting 531 ms; commit 0 ms)
2026-11-08T11:39:13Z [load_day 2025-04-28] 2025-04-28 hour 5: 205843 events in 0 files, snapshot none (task 8314 ms: download 5317 ms overlapping gunzip 1357 ms, parse 5174 ms, sort 0 ms, write 0 ms, index 940 ms: 8 candidates, 83104 repo-hours, 897 releases; waiting 501 ms; commit 0 ms)
2026-11-08T11:39:23Z [load_day 2025-04-28] 2025-04-28 hour 6: 236398 events in 0 files, snapshot none (task 10215 ms: download 6680 ms overlapping gunzip 1745 ms, parse 6858 ms, sort 0 ms, write 0 ms, index 1029 ms: 1 candidates, 104947 repo-hours, 1086 releases; waiting 298 ms; commit 0 ms)
2026-11-08T11:39:23Z [load_day 2025-04-28] 2025-04-28 hour 7: 233657 events in 0 files, snapshot none (task 10059 ms: download 6812 ms overlapping gunzip 1636 ms, parse 6666 ms, sort 0 ms, write 0 ms, index 834 ms: 4 candidates, 100157 repo-hours, 1144 releases; waiting 536 ms; commit 0 ms)
2026-11-08T11:39:33Z [load_day 2025-04-28] 2025-04-28 hour 8: 240933 events in 0 files, snapshot none (task 10422 ms: download 7659 ms overlapping gunzip 1746 ms, parse 7306 ms, sort 0 ms, write 0 ms, index 766 ms: 8 candidates, 105105 repo-hours, 1127 releases; waiting 245 ms; commit 0 ms)
2026-11-08T11:39:34Z [load_day 2025-04-28] 2025-04-28 hour 9: 242223 events in 0 files, snapshot none (task 10452 ms: download 7681 ms overlapping gunzip 1675 ms, parse 7188 ms, sort 0 ms, write 0 ms, index 742 ms: 6 candidates, 102194 repo-hours, 1376 releases; waiting 398 ms; commit 0 ms)
2026-11-08T11:39:43Z [load_day 2025-04-28] 2025-04-28 hour 10: 237977 events in 0 files, snapshot none (task 9193 ms: download 6609 ms overlapping gunzip 1533 ms, parse 6144 ms, sort 0 ms, write 0 ms, index 722 ms: 10 candidates, 102457 repo-hours, 1284 releases; waiting 471 ms; commit 0 ms)
2026-11-08T11:39:44Z [load_day 2025-04-28] 2025-04-28 hour 11: 250193 events in 0 files, snapshot none (task 9446 ms: download 6917 ms overlapping gunzip 1559 ms, parse 6386 ms, sort 0 ms, write 0 ms, index 771 ms: 10 candidates, 104937 repo-hours, 1263 releases; waiting 494 ms; commit 0 ms)
2026-11-08T11:39:53Z [load_day 2025-04-28] 2025-04-28 hour 12: 275021 events in 0 files, snapshot none (task 9300 ms: download 6318 ms overlapping gunzip 1388 ms, parse 5822 ms, sort 0 ms, write 0 ms, index 1056 ms: 9 candidates, 140692 repo-hours, 1372 releases; waiting 696 ms; commit 0 ms)
2026-11-08T11:39:54Z [load_day 2025-04-28] 2025-04-28 hour 13: 275260 events in 0 files, snapshot none (task 9461 ms: download 6636 ms overlapping gunzip 1516 ms, parse 6145 ms, sort 0 ms, write 0 ms, index 1017 ms: 7 candidates, 132196 repo-hours, 1249 releases; waiting 511 ms; commit 0 ms)
2026-11-08T11:40:08Z [load_day 2025-04-28] 2025-04-28 hour 14: 269805 events in 0 files, snapshot none (task 14467 ms: download 10732 ms overlapping gunzip 2499 ms, parse 10176 ms, sort 0 ms, write 0 ms, index 1029 ms: 10 candidates, 116455 repo-hours, 1527 releases; waiting 521 ms; commit 0 ms)
2026-11-08T11:40:10Z [load_day 2025-04-28] 2025-04-28 hour 15: 270671 events in 0 files, snapshot none (task 15183 ms: download 11716 ms overlapping gunzip 2483 ms, parse 10503 ms, sort 0 ms, write 0 ms, index 1374 ms: 12 candidates, 115846 repo-hours, 1407 releases; waiting 527 ms; commit 0 ms)
2026-11-08T11:40:20Z [load_day 2025-04-28] 2025-04-28 hour 16: 263798 events in 0 files, snapshot none (task 11394 ms: download 8633 ms overlapping gunzip 1883 ms, parse 7769 ms, sort 0 ms, write 0 ms, index 916 ms: 14 candidates, 110783 repo-hours, 1172 releases; waiting 508 ms; commit 0 ms)
2026-11-08T11:40:21Z [load_day 2025-04-28] 2025-04-28 hour 17: 259256 events in 0 files, snapshot none (task 10357 ms: download 7019 ms overlapping gunzip 1585 ms, parse 6511 ms, sort 0 ms, write 0 ms, index 1208 ms: 11 candidates, 105855 repo-hours, 1029 releases; waiting 554 ms; commit 0 ms)
2026-11-08T11:40:33Z [load_day 2025-04-28] 2025-04-28 hour 18: 258297 events in 0 files, snapshot none (task 11642 ms: download 7757 ms overlapping gunzip 1946 ms, parse 7752 ms, sort 0 ms, write 0 ms, index 1165 ms: 17 candidates, 112477 repo-hours, 1359 releases; waiting 474 ms; commit 0 ms)
2026-11-08T11:40:33Z [load_day 2025-04-28] 2025-04-28 hour 19: 245442 events in 0 files, snapshot none (task 10827 ms: download 7013 ms overlapping gunzip 1779 ms, parse 7217 ms, sort 0 ms, write 0 ms, index 985 ms: 17 candidates, 95698 repo-hours, 1222 releases; waiting 534 ms; commit 0 ms)
2026-11-08T11:40:43Z [load_day 2025-04-28] 2025-04-28 hour 20: 238926 events in 0 files, snapshot none (task 9323 ms: download 5800 ms overlapping gunzip 1423 ms, parse 5982 ms, sort 0 ms, write 0 ms, index 1055 ms: 7 candidates, 95908 repo-hours, 1178 releases; waiting 541 ms; commit 0 ms)
2026-11-08T11:40:43Z [load_day 2025-04-28] 2025-04-28 hour 21: 224989 events in 0 files, snapshot none (task 9090 ms: download 6105 ms overlapping gunzip 1474 ms, parse 5963 ms, sort 0 ms, write 0 ms, index 855 ms: 10 candidates, 87188 repo-hours, 1241 releases; waiting 538 ms; commit 0 ms)
2026-11-08T11:40:52Z [load_day 2025-04-28] 2025-04-28 hour 22: 204819 events in 0 files, snapshot none (task 9019 ms: download 6154 ms overlapping gunzip 1516 ms, parse 5959 ms, sort 0 ms, write 0 ms, index 970 ms: 9 candidates, 78218 repo-hours, 1258 releases; waiting 352 ms; commit 0 ms)
2026-11-08T11:40:52Z [load_day 2025-04-28] 2025-04-28 hour 23: 202995 events in 0 files, snapshot none (task 9263 ms: download 6178 ms overlapping gunzip 1504 ms, parse 6156 ms, sort 0 ms, write 0 ms, index 702 ms: 6 candidates, 77840 repo-hours, 998 releases; waiting 551 ms; commit 0 ms)
2026-11-08T11:41:04Z [load_day 2025-04-28] 2025-04-28: repo_hour merged from 24 files to 1 (2436437 rows, 11494 ms)
2026-11-08T11:41:07Z [load_day 2025-04-28] 2025-04-28: index committed in 14598 ms (24 + 1 + 24 files)
2026-11-08T11:41:07Z [load_day 2025-04-28] 2025-04-28: 5682018 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:41:07Z [load_day 2025-04-28] attempt 1 succeeded