orcaLog in

Runs · run 3921

load_day 2025-05-19, attempt 1 succeeded

Host
73ccef5e07c2:307967
Started
2026-11-08T12:01:25Z
Ended
2026-11-08T12:03:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
774 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
234.9 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3921/load_day/2025-05-19/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:01:25Z [load_day 2025-05-19] attempt 1 started
2026-11-08T12:01:26Z [load_day 2025-05-19] 2025-05-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:01:35Z [load_day 2025-05-19] 2025-05-19 hour 0: 189520 events in 0 files, snapshot none (task 7694 ms: download 4204 ms overlapping gunzip 1165 ms, parse 4642 ms, sort 0 ms, write 0 ms, index 1039 ms: 13 candidates, 84079 repo-hours, 1397 releases; waiting 492 ms; commit 0 ms)
2026-11-08T12:01:39Z [load_day 2025-05-19] 2025-05-19 hour 1: 223584 events in 0 files, snapshot none (task 11739 ms: download 8070 ms overlapping gunzip 1351 ms, parse 5616 ms, sort 0 ms, write 0 ms, index 1067 ms: 11 candidates, 119174 repo-hours, 979 releases; waiting 3143 ms; commit 0 ms)
2026-11-08T12:01:44Z [load_day 2025-05-19] 2025-05-19 hour 2: 206909 events in 0 files, snapshot none (task 8732 ms: download 5089 ms overlapping gunzip 1309 ms, parse 5134 ms, sort 0 ms, write 0 ms, index 1309 ms: 5 candidates, 93110 repo-hours, 998 releases; waiting 661 ms; commit 0 ms)
2026-11-08T12:01:48Z [load_day 2025-05-19] 2025-05-19 hour 3: 209143 events in 0 files, snapshot none (task 8998 ms: download 5992 ms overlapping gunzip 1459 ms, parse 5936 ms, sort 0 ms, write 0 ms, index 705 ms: 7 candidates, 87184 repo-hours, 2617 releases; waiting 573 ms; commit 0 ms)
2026-11-08T12:01:53Z [load_day 2025-05-19] 2025-05-19 hour 4: 199264 events in 0 files, snapshot none (task 8096 ms: download 4268 ms overlapping gunzip 1358 ms, parse 5313 ms, sort 0 ms, write 0 ms, index 868 ms: 7 candidates, 76320 repo-hours, 1048 releases; waiting 193 ms; commit 0 ms)
2026-11-08T12:01:57Z [load_day 2025-05-19] 2025-05-19 hour 5: 212027 events in 0 files, snapshot none (task 8454 ms: download 5945 ms overlapping gunzip 1453 ms, parse 5682 ms, sort 0 ms, write 0 ms, index 652 ms: 10 candidates, 82637 repo-hours, 877 releases; waiting 347 ms; commit 0 ms)
2026-11-08T12:02:03Z [load_day 2025-05-19] 2025-05-19 hour 6: 240033 events in 0 files, snapshot none (task 9456 ms: download 6257 ms overlapping gunzip 1553 ms, parse 6014 ms, sort 0 ms, write 0 ms, index 765 ms: 5 candidates, 107049 repo-hours, 1067 releases; waiting 829 ms; commit 0 ms)
2026-11-08T12:02:12Z [load_day 2025-05-19] 2025-05-19 hour 7: 249994 events in 0 files, snapshot none (task 14340 ms: download 11287 ms overlapping gunzip 1983 ms, parse 8032 ms, sort 0 ms, write 0 ms, index 747 ms: 13 candidates, 103047 repo-hours, 1147 releases; waiting 3214 ms; commit 0 ms)
2026-11-08T12:02:15Z [load_day 2025-05-19] 2025-05-19 hour 8: 267831 events in 0 files, snapshot none (task 11258 ms: download 8665 ms overlapping gunzip 1965 ms, parse 7695 ms, sort 0 ms, write 0 ms, index 805 ms: 5 candidates, 110920 repo-hours, 1289 releases; waiting 488 ms; commit 0 ms)
2026-11-08T12:02:22Z [load_day 2025-05-19] 2025-05-19 hour 9: 264567 events in 0 files, snapshot none (task 9446 ms: download 6635 ms overlapping gunzip 1464 ms, parse 6152 ms, sort 0 ms, write 0 ms, index 847 ms: 5 candidates, 110693 repo-hours, 1353 releases; waiting 618 ms; commit 0 ms)
2026-11-08T12:02:24Z [load_day 2025-05-19] 2025-05-19 hour 10: 258767 events in 0 files, snapshot none (task 8532 ms: download 5884 ms overlapping gunzip 1415 ms, parse 5486 ms, sort 0 ms, write 0 ms, index 821 ms: 10 candidates, 107082 repo-hours, 1087 releases; waiting 501 ms; commit 0 ms)
2026-11-08T12:02:34Z [load_day 2025-05-19] 2025-05-19 hour 11: 261462 events in 0 files, snapshot none (task 11477 ms: download 8603 ms overlapping gunzip 2028 ms, parse 7703 ms, sort 0 ms, write 0 ms, index 763 ms: 6 candidates, 102928 repo-hours, 1376 releases; waiting 584 ms; commit 0 ms)
2026-11-08T12:02:37Z [load_day 2025-05-19] 2025-05-19 hour 12: 281447 events in 0 files, snapshot none (task 12981 ms: download 9270 ms overlapping gunzip 2002 ms, parse 8352 ms, sort 0 ms, write 0 ms, index 1833 ms: 8 candidates, 146466 repo-hours, 1366 releases; waiting 547 ms; commit 0 ms)
2026-11-08T12:02:49Z [load_day 2025-05-19] 2025-05-19 hour 13: 276385 events in 0 files, snapshot none (task 13586 ms: download 8989 ms overlapping gunzip 2173 ms, parse 9339 ms, sort 0 ms, write 0 ms, index 1296 ms: 7 candidates, 134900 repo-hours, 1282 releases; waiting 475 ms; commit 0 ms)
2026-11-08T12:02:51Z [load_day 2025-05-19] 2025-05-19 hour 14: 270089 events in 0 files, snapshot none (task 13375 ms: download 10251 ms overlapping gunzip 2165 ms, parse 9220 ms, sort 0 ms, write 0 ms, index 984 ms: 11 candidates, 119407 repo-hours, 1282 releases; waiting 730 ms; commit 0 ms)
2026-11-08T12:03:01Z [load_day 2025-05-19] 2025-05-19 hour 15: 272863 events in 0 files, snapshot none (task 11526 ms: download 7881 ms overlapping gunzip 1909 ms, parse 8045 ms, sort 0 ms, write 0 ms, index 1123 ms: 15 candidates, 121487 repo-hours, 1493 releases; waiting 213 ms; commit 0 ms)
2026-11-08T12:03:04Z [load_day 2025-05-19] 2025-05-19 hour 16: 266250 events in 0 files, snapshot none (task 11859 ms: download 9026 ms overlapping gunzip 1939 ms, parse 8116 ms, sort 0 ms, write 0 ms, index 1015 ms: 15 candidates, 114348 repo-hours, 1492 releases; waiting 501 ms; commit 0 ms)
2026-11-08T12:03:12Z [load_day 2025-05-19] 2025-05-19 hour 17: 263686 events in 0 files, snapshot none (task 11154 ms: download 7466 ms overlapping gunzip 1764 ms, parse 7449 ms, sort 0 ms, write 0 ms, index 1074 ms: 21 candidates, 109939 repo-hours, 1100 releases; waiting 542 ms; commit 0 ms)
2026-11-08T12:03:15Z [load_day 2025-05-19] 2025-05-19 hour 18: 266596 events in 0 files, snapshot none (task 10429 ms: download 7464 ms overlapping gunzip 1591 ms, parse 6792 ms, sort 0 ms, write 0 ms, index 1093 ms: 20 candidates, 118512 repo-hours, 1247 releases; waiting 643 ms; commit 0 ms)
2026-11-08T12:03:23Z [load_day 2025-05-19] 2025-05-19 hour 19: 250461 events in 0 files, snapshot none (task 10361 ms: download 6921 ms overlapping gunzip 1634 ms, parse 6601 ms, sort 0 ms, write 0 ms, index 1344 ms: 13 candidates, 98704 repo-hours, 1237 releases; waiting 493 ms; commit 0 ms)
2026-11-08T12:03:29Z [load_day 2025-05-19] 2025-05-19 hour 20: 248236 events in 0 files, snapshot none (task 13503 ms: download 9486 ms overlapping gunzip 2070 ms, parse 8385 ms, sort 0 ms, write 0 ms, index 1003 ms: 19 candidates, 100379 repo-hours, 1200 releases; waiting 1621 ms; commit 0 ms)
2026-11-08T12:03:34Z [load_day 2025-05-19] 2025-05-19 hour 21: 231577 events in 0 files, snapshot none (task 10575 ms: download 6854 ms overlapping gunzip 1772 ms, parse 6911 ms, sort 0 ms, write 0 ms, index 1006 ms: 11 candidates, 92439 repo-hours, 1293 releases; waiting 511 ms; commit 0 ms)
2026-11-08T12:03:41Z [load_day 2025-05-19] 2025-05-19 hour 22: 210678 events in 0 files, snapshot none (task 11579 ms: download 7279 ms overlapping gunzip 1913 ms, parse 7816 ms, sort 0 ms, write 0 ms, index 833 ms: 16 candidates, 78821 repo-hours, 1184 releases; waiting 665 ms; commit 0 ms)
2026-11-08T12:03:44Z [load_day 2025-05-19] 2025-05-19 hour 23: 200468 events in 0 files, snapshot none (task 9222 ms: download 6641 ms overlapping gunzip 1460 ms, parse 6365 ms, sort 0 ms, write 0 ms, index 577 ms: 11 candidates, 75352 repo-hours, 1035 releases; waiting 524 ms; commit 0 ms)
2026-11-08T12:03:55Z [load_day 2025-05-19] 2025-05-19: repo_hour merged from 24 files to 1 (2494977 rows, 10611 ms)
2026-11-08T12:03:58Z [load_day 2025-05-19] 2025-05-19: index committed in 13679 ms (24 + 1 + 24 files)
2026-11-08T12:03:58Z [load_day 2025-05-19] 2025-05-19: 5821837 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:03:58Z [load_day 2025-05-19] attempt 1 succeeded