orcaLog in

Runs · run 3575

load_day 2025-02-18, attempt 1 succeeded

Host
73ccef5e07c2:257110
Started
2026-11-08T10:24:05Z
Ended
2026-11-08T10:26:18Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
830 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
207.1 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3575/load_day/2025-02-18/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:24:05Z [load_day 2025-02-18] attempt 1 started
2026-11-08T10:24:06Z [load_day 2025-02-18] 2025-02-18: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:24:14Z [load_day 2025-02-18] 2025-02-18 hour 0: 215556 events in 0 files, snapshot none (task 7652 ms: download 4219 ms overlapping gunzip 1108 ms, parse 4574 ms, sort 0 ms, write 0 ms, index 1191 ms: 14 candidates, 101400 repo-hours, 1325 releases; waiting 509 ms; commit 0 ms)
2026-11-08T10:24:14Z [load_day 2025-02-18] 2025-02-18 hour 1: 232795 events in 0 files, snapshot none (task 8113 ms: download 4421 ms overlapping gunzip 1187 ms, parse 4809 ms, sort 0 ms, write 0 ms, index 1332 ms: 5 candidates, 122431 repo-hours, 1050 releases; waiting 491 ms; commit 0 ms)
2026-11-08T10:24:22Z [load_day 2025-02-18] 2025-02-18 hour 2: 207237 events in 0 files, snapshot none (task 7665 ms: download 4730 ms overlapping gunzip 1205 ms, parse 4756 ms, sort 0 ms, write 0 ms, index 810 ms: 9 candidates, 91294 repo-hours, 856 releases; waiting 520 ms; commit 0 ms)
2026-11-08T10:24:23Z [load_day 2025-02-18] 2025-02-18 hour 3: 220803 events in 0 files, snapshot none (task 7757 ms: download 5195 ms overlapping gunzip 1196 ms, parse 5045 ms, sort 0 ms, write 0 ms, index 703 ms: 5 candidates, 88049 repo-hours, 3910 releases; waiting 487 ms; commit 0 ms)
2026-11-08T10:24:32Z [load_day 2025-02-18] 2025-02-18 hour 4: 201726 events in 0 files, snapshot none (task 9174 ms: download 5180 ms overlapping gunzip 1418 ms, parse 6146 ms, sort 0 ms, write 0 ms, index 932 ms: 9 candidates, 75582 repo-hours, 762 releases; waiting 457 ms; commit 0 ms)
2026-11-08T10:24:34Z [load_day 2025-02-18] 2025-02-18 hour 5: 211753 events in 0 files, snapshot none (task 10163 ms: download 6298 ms overlapping gunzip 1609 ms, parse 6559 ms, sort 0 ms, write 0 ms, index 1037 ms: 4 candidates, 79928 repo-hours, 857 releases; waiting 591 ms; commit 0 ms)
2026-11-08T10:24:41Z [load_day 2025-02-18] 2025-02-18 hour 6: 236913 events in 0 files, snapshot none (task 8820 ms: download 4852 ms overlapping gunzip 1244 ms, parse 5370 ms, sort 0 ms, write 0 ms, index 1430 ms: 6 candidates, 103081 repo-hours, 1202 releases; waiting 465 ms; commit 0 ms)
2026-11-08T10:24:45Z [load_day 2025-02-18] 2025-02-18 hour 7: 236719 events in 0 files, snapshot none (task 10954 ms: download 6233 ms overlapping gunzip 1527 ms, parse 6719 ms, sort 0 ms, write 0 ms, index 1720 ms: 7 candidates, 92585 repo-hours, 940 releases; waiting 601 ms; commit 0 ms)
2026-11-08T10:24:52Z [load_day 2025-02-18] 2025-02-18 hour 8: 248354 events in 0 files, snapshot none (task 10297 ms: download 6967 ms overlapping gunzip 1573 ms, parse 6883 ms, sort 0 ms, write 0 ms, index 1040 ms: 12 candidates, 103470 repo-hours, 1179 releases; waiting 489 ms; commit 0 ms)
2026-11-08T10:24:57Z [load_day 2025-02-18] 2025-02-18 hour 9: 262746 events in 0 files, snapshot none (task 11536 ms: download 7512 ms overlapping gunzip 1834 ms, parse 7846 ms, sort 0 ms, write 0 ms, index 1125 ms: 13 candidates, 112542 repo-hours, 1510 releases; waiting 464 ms; commit 0 ms)
2026-11-08T10:25:03Z [load_day 2025-02-18] 2025-02-18 hour 10: 257443 events in 0 files, snapshot none (task 10024 ms: download 7021 ms overlapping gunzip 1631 ms, parse 6770 ms, sort 0 ms, write 0 ms, index 792 ms: 11 candidates, 106286 repo-hours, 1289 releases; waiting 506 ms; commit 0 ms)
2026-11-08T10:25:07Z [load_day 2025-02-18] 2025-02-18 hour 11: 254138 events in 0 files, snapshot none (task 8794 ms: download 5582 ms overlapping gunzip 1355 ms, parse 5718 ms, sort 0 ms, write 0 ms, index 974 ms: 9 candidates, 100371 repo-hours, 1346 releases; waiting 446 ms; commit 0 ms)
2026-11-08T10:25:16Z [load_day 2025-02-18] 2025-02-18 hour 12: 285486 events in 0 files, snapshot none (task 12234 ms: download 9165 ms overlapping gunzip 1542 ms, parse 7002 ms, sort 0 ms, write 0 ms, index 1096 ms: 9 candidates, 141284 repo-hours, 1437 releases; waiting 2244 ms; commit 0 ms)
2026-11-08T10:25:17Z [load_day 2025-02-18] 2025-02-18 hour 13: 273677 events in 0 files, snapshot none (task 9922 ms: download 6774 ms overlapping gunzip 1524 ms, parse 6480 ms, sort 0 ms, write 0 ms, index 1184 ms: 7 candidates, 126039 repo-hours, 1292 releases; waiting 465 ms; commit 0 ms)
2026-11-08T10:25:26Z [load_day 2025-02-18] 2025-02-18 hour 14: 264697 events in 0 files, snapshot none (task 10171 ms: download 7544 ms overlapping gunzip 1607 ms, parse 6831 ms, sort 0 ms, write 0 ms, index 830 ms: 8 candidates, 114209 repo-hours, 1468 releases; waiting 679 ms; commit 0 ms)
2026-11-08T10:25:27Z [load_day 2025-02-18] 2025-02-18 hour 15: 270191 events in 0 files, snapshot none (task 9349 ms: download 6646 ms overlapping gunzip 1518 ms, parse 6186 ms, sort 0 ms, write 0 ms, index 880 ms: 11 candidates, 120299 repo-hours, 1490 releases; waiting 473 ms; commit 0 ms)
2026-11-08T10:25:35Z [load_day 2025-02-18] 2025-02-18 hour 16: 265555 events in 0 files, snapshot none (task 8631 ms: download 5950 ms overlapping gunzip 1342 ms, parse 5590 ms, sort 0 ms, write 0 ms, index 865 ms: 8 candidates, 114929 repo-hours, 1379 releases; waiting 550 ms; commit 0 ms)
2026-11-08T10:25:36Z [load_day 2025-02-18] 2025-02-18 hour 17: 255677 events in 0 files, snapshot none (task 8202 ms: download 5539 ms overlapping gunzip 1291 ms, parse 5433 ms, sort 0 ms, write 0 ms, index 771 ms: 9 candidates, 104865 repo-hours, 1276 releases; waiting 353 ms; commit 0 ms)
2026-11-08T10:25:45Z [load_day 2025-02-18] 2025-02-18 hour 18: 260001 events in 0 files, snapshot none (task 9072 ms: download 5410 ms overlapping gunzip 1444 ms, parse 5917 ms, sort 0 ms, write 0 ms, index 1092 ms: 14 candidates, 117507 repo-hours, 1502 releases; waiting 349 ms; commit 0 ms)
2026-11-08T10:25:46Z [load_day 2025-02-18] 2025-02-18 hour 19: 242885 events in 0 files, snapshot none (task 9586 ms: download 6456 ms overlapping gunzip 1569 ms, parse 6458 ms, sort 0 ms, write 0 ms, index 772 ms: 4 candidates, 95757 repo-hours, 1220 releases; waiting 497 ms; commit 0 ms)
2026-11-08T10:25:54Z [load_day 2025-02-18] 2025-02-18 hour 20: 233388 events in 0 files, snapshot none (task 8923 ms: download 5412 ms overlapping gunzip 1381 ms, parse 5892 ms, sort 0 ms, write 0 ms, index 912 ms: 7 candidates, 92260 repo-hours, 1399 releases; waiting 496 ms; commit 0 ms)
2026-11-08T10:25:55Z [load_day 2025-02-18] 2025-02-18 hour 21: 228565 events in 0 files, snapshot none (task 8511 ms: download 5515 ms overlapping gunzip 1306 ms, parse 5739 ms, sort 0 ms, write 0 ms, index 702 ms: 14 candidates, 90890 repo-hours, 1225 releases; waiting 504 ms; commit 0 ms)
2026-11-08T10:26:04Z [load_day 2025-02-18] 2025-02-18 hour 22: 216644 events in 0 files, snapshot none (task 8808 ms: download 5923 ms overlapping gunzip 1430 ms, parse 5811 ms, sort 0 ms, write 0 ms, index 704 ms: 15 candidates, 82209 repo-hours, 1340 releases; waiting 574 ms; commit 0 ms)
2026-11-08T10:26:04Z [load_day 2025-02-18] 2025-02-18 hour 23: 205163 events in 0 files, snapshot none (task 8691 ms: download 5779 ms overlapping gunzip 1443 ms, parse 5943 ms, sort 0 ms, write 0 ms, index 698 ms: 11 candidates, 77221 repo-hours, 1037 releases; waiting 329 ms; commit 0 ms)
2026-11-08T10:26:15Z [load_day 2025-02-18] 2025-02-18: repo_hour merged from 24 files to 1 (2454488 rows, 11026 ms)
2026-11-08T10:26:18Z [load_day 2025-02-18] 2025-02-18: index committed in 13836 ms (24 + 1 + 24 files)
2026-11-08T10:26:18Z [load_day 2025-02-18] 2025-02-18: 5788112 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:26:18Z [load_day 2025-02-18] attempt 1 succeeded