orcaLog in

Runs · run 3822

load_day 2025-04-24, attempt 1 succeeded

Host
73ccef5e07c2:292964
Started
2026-11-08T11:34:43Z
Ended
2026-11-08T11:37:06Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
775 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
219.6 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3822/load_day/2025-04-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:34:43Z [load_day 2025-04-24] attempt 1 started
2026-11-08T11:34:44Z [load_day 2025-04-24] 2025-04-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:34:52Z [load_day 2025-04-24] 2025-04-24 hour 0: 206543 events in 0 files, snapshot none (task 7653 ms: download 4748 ms overlapping gunzip 1189 ms, parse 4970 ms, sort 0 ms, write 0 ms, index 888 ms: 4 candidates, 94704 repo-hours, 1275 releases; waiting 368 ms; commit 0 ms)
2026-11-08T11:34:53Z [load_day 2025-04-24] 2025-04-24 hour 1: 233953 events in 0 files, snapshot none (task 8197 ms: download 5043 ms overlapping gunzip 1177 ms, parse 5228 ms, sort 0 ms, write 0 ms, index 1034 ms: 5 candidates, 126810 repo-hours, 1025 releases; waiting 483 ms; commit 0 ms)
2026-11-08T11:35:02Z [load_day 2025-04-24] 2025-04-24 hour 2: 201638 events in 0 files, snapshot none (task 8691 ms: download 5489 ms overlapping gunzip 1484 ms, parse 6033 ms, sort 0 ms, write 0 ms, index 777 ms: 3 candidates, 88507 repo-hours, 968 releases; waiting 183 ms; commit 0 ms)
2026-11-08T11:35:02Z [load_day 2025-04-24] 2025-04-24 hour 3: 215468 events in 0 files, snapshot none (task 8447 ms: download 5399 ms overlapping gunzip 1310 ms, parse 5734 ms, sort 0 ms, write 0 ms, index 687 ms: 4 candidates, 91616 repo-hours, 2993 releases; waiting 410 ms; commit 0 ms)
2026-11-08T11:35:11Z [load_day 2025-04-24] 2025-04-24 hour 4: 199219 events in 0 files, snapshot none (task 8649 ms: download 5675 ms overlapping gunzip 1212 ms, parse 5084 ms, sort 0 ms, write 0 ms, index 751 ms: 7 candidates, 77371 repo-hours, 864 releases; waiting 1291 ms; commit 0 ms)
2026-11-08T11:35:11Z [load_day 2025-04-24] 2025-04-24 hour 5: 214615 events in 0 files, snapshot none (task 7662 ms: download 4601 ms overlapping gunzip 1310 ms, parse 5139 ms, sort 0 ms, write 0 ms, index 748 ms: 4 candidates, 83494 repo-hours, 883 releases; waiting 178 ms; commit 0 ms)
2026-11-08T11:35:21Z [load_day 2025-04-24] 2025-04-24 hour 6: 240865 events in 0 files, snapshot none (task 9122 ms: download 4965 ms overlapping gunzip 1423 ms, parse 5945 ms, sort 0 ms, write 0 ms, index 1256 ms: 4 candidates, 107716 repo-hours, 1008 releases; waiting 198 ms; commit 0 ms)
2026-11-08T11:35:22Z [load_day 2025-04-24] 2025-04-24 hour 7: 245931 events in 0 files, snapshot none (task 10351 ms: download 6831 ms overlapping gunzip 1636 ms, parse 7101 ms, sort 0 ms, write 0 ms, index 1031 ms: 5 candidates, 100150 repo-hours, 1200 releases; waiting 302 ms; commit 0 ms)
2026-11-08T11:35:32Z [load_day 2025-04-24] 2025-04-24 hour 8: 250440 events in 0 files, snapshot none (task 10573 ms: download 6466 ms overlapping gunzip 1642 ms, parse 7017 ms, sort 0 ms, write 0 ms, index 1069 ms: 4 candidates, 107199 repo-hours, 1350 releases; waiting 520 ms; commit 0 ms)
2026-11-08T11:35:34Z [load_day 2025-04-24] 2025-04-24 hour 9: 254041 events in 0 files, snapshot none (task 11867 ms: download 8135 ms overlapping gunzip 1708 ms, parse 7724 ms, sort 0 ms, write 0 ms, index 1369 ms: 5 candidates, 110141 repo-hours, 1743 releases; waiting 773 ms; commit 0 ms)
2026-11-08T11:35:42Z [load_day 2025-04-24] 2025-04-24 hour 10: 246930 events in 0 files, snapshot none (task 9924 ms: download 5973 ms overlapping gunzip 1504 ms, parse 6718 ms, sort 0 ms, write 0 ms, index 1056 ms: 11 candidates, 104086 repo-hours, 1492 releases; waiting 328 ms; commit 0 ms)
2026-11-08T11:35:45Z [load_day 2025-04-24] 2025-04-24 hour 11: 245662 events in 0 files, snapshot none (task 10094 ms: download 7334 ms overlapping gunzip 1602 ms, parse 6823 ms, sort 0 ms, write 0 ms, index 765 ms: 5 candidates, 100626 repo-hours, 1322 releases; waiting 617 ms; commit 0 ms)
2026-11-08T11:35:53Z [load_day 2025-04-24] 2025-04-24 hour 12: 274742 events in 0 files, snapshot none (task 10640 ms: download 7307 ms overlapping gunzip 1493 ms, parse 6077 ms, sort 0 ms, write 0 ms, index 1223 ms: 11 candidates, 140244 repo-hours, 1396 releases; waiting 1561 ms; commit 0 ms)
2026-11-08T11:35:55Z [load_day 2025-04-24] 2025-04-24 hour 13: 269833 events in 0 files, snapshot none (task 9464 ms: download 6542 ms overlapping gunzip 1443 ms, parse 6155 ms, sort 0 ms, write 0 ms, index 916 ms: 11 candidates, 129516 repo-hours, 1360 releases; waiting 666 ms; commit 0 ms)
2026-11-08T11:36:04Z [load_day 2025-04-24] 2025-04-24 hour 14: 267309 events in 0 files, snapshot none (task 9793 ms: download 6108 ms overlapping gunzip 1461 ms, parse 6087 ms, sort 0 ms, write 0 ms, index 1411 ms: 9 candidates, 117040 repo-hours, 1446 releases; waiting 523 ms; commit 0 ms)
2026-11-08T11:36:06Z [load_day 2025-04-24] 2025-04-24 hour 15: 270831 events in 0 files, snapshot none (task 10432 ms: download 6386 ms overlapping gunzip 1658 ms, parse 6808 ms, sort 0 ms, write 0 ms, index 1209 ms: 5 candidates, 119601 repo-hours, 1454 releases; waiting 534 ms; commit 0 ms)
2026-11-08T11:36:17Z [load_day 2025-04-24] 2025-04-24 hour 16: 263367 events in 0 files, snapshot none (task 12710 ms: download 9119 ms overlapping gunzip 2190 ms, parse 8696 ms, sort 0 ms, write 0 ms, index 1038 ms: 15 candidates, 116718 repo-hours, 1305 releases; waiting 486 ms; commit 0 ms)
2026-11-08T11:36:20Z [load_day 2025-04-24] 2025-04-24 hour 17: 268131 events in 0 files, snapshot none (task 12945 ms: download 10129 ms overlapping gunzip 2263 ms, parse 8950 ms, sort 0 ms, write 0 ms, index 852 ms: 8 candidates, 117012 repo-hours, 1149 releases; waiting 482 ms; commit 0 ms)
2026-11-08T11:36:30Z [load_day 2025-04-24] 2025-04-24 hour 18: 268592 events in 0 files, snapshot none (task 13145 ms: download 9901 ms overlapping gunzip 2109 ms, parse 8240 ms, sort 0 ms, write 0 ms, index 1217 ms: 9 candidates, 119051 repo-hours, 1263 releases; waiting 1234 ms; commit 0 ms)
2026-11-08T11:36:31Z [load_day 2025-04-24] 2025-04-24 hour 19: 249404 events in 0 files, snapshot none (task 10256 ms: download 6953 ms overlapping gunzip 1591 ms, parse 6567 ms, sort 0 ms, write 0 ms, index 1278 ms: 5 candidates, 97155 repo-hours, 1265 releases; waiting 488 ms; commit 0 ms)
2026-11-08T11:36:40Z [load_day 2025-04-24] 2025-04-24 hour 20: 239755 events in 0 files, snapshot none (task 9250 ms: download 6536 ms overlapping gunzip 1436 ms, parse 6105 ms, sort 0 ms, write 0 ms, index 929 ms: 6 candidates, 94020 repo-hours, 1126 releases; waiting 537 ms; commit 0 ms)
2026-11-08T11:36:40Z [load_day 2025-04-24] 2025-04-24 hour 21: 219510 events in 0 files, snapshot none (task 8651 ms: download 5759 ms overlapping gunzip 1369 ms, parse 5413 ms, sort 0 ms, write 0 ms, index 959 ms: 7 candidates, 86766 repo-hours, 1187 releases; waiting 493 ms; commit 0 ms)
2026-11-08T11:36:49Z [load_day 2025-04-24] 2025-04-24 hour 22: 203639 events in 0 files, snapshot none (task 8247 ms: download 5637 ms overlapping gunzip 1262 ms, parse 5621 ms, sort 0 ms, write 0 ms, index 623 ms: 5 candidates, 76648 repo-hours, 1157 releases; waiting 511 ms; commit 0 ms)
2026-11-08T11:36:50Z [load_day 2025-04-24] 2025-04-24 hour 23: 200870 events in 0 files, snapshot none (task 8432 ms: download 5757 ms overlapping gunzip 1407 ms, parse 5628 ms, sort 0 ms, write 0 ms, index 603 ms: 6 candidates, 76737 repo-hours, 1146 releases; waiting 224 ms; commit 0 ms)
2026-11-08T11:37:02Z [load_day 2025-04-24] 2025-04-24: repo_hour merged from 24 files to 1 (2482928 rows, 12063 ms)
2026-11-08T11:37:06Z [load_day 2025-04-24] 2025-04-24: index committed in 16455 ms (24 + 1 + 24 files)
2026-11-08T11:37:06Z [load_day 2025-04-24] 2025-04-24: 5751288 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:37:06Z [load_day 2025-04-24] attempt 1 succeeded