orcaLog in

Runs · run 5136

load_day 2025-06-12, attempt 1 succeeded

Host
53a32e35684c:17133
Started
2026-11-08T16:38:33Z
Ended
2026-11-08T16:39:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
660 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
134.1 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/5136/load_day/2025-06-12/1.log
Code
pipelines/gharchive.mojo:151

Log

2026-11-08T16:38:33Z [load_day 2025-06-12] attempt 1 started
2026-11-08T16:38:34Z [load_day 2025-06-12] 2025-06-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T16:38:39Z [load_day 2025-06-12] 2025-06-12 hour 0: 149995 events in 0 files, snapshot none (task 4907 ms: download 2577 ms overlapping gunzip 862 ms, parse 3254 ms, sort 0 ms, write 0 ms, index 567 ms: 6 candidates, 72268 repo-hours, 965 releases; waiting 12 ms; commit 0 ms)
2026-11-08T16:38:39Z [load_day 2025-06-12] 2025-06-12 hour 1: 155343 events in 0 files, snapshot none (task 4433 ms: download 1826 ms overlapping gunzip 658 ms, parse 2773 ms, sort 0 ms, write 0 ms, index 692 ms: 3 candidates, 92601 repo-hours, 855 releases; waiting 7 ms; commit 0 ms)
2026-11-08T16:38:44Z [load_day 2025-06-12] 2025-06-12 hour 2: 146944 events in 0 files, snapshot none (task 4512 ms: download 2154 ms overlapping gunzip 700 ms, parse 2978 ms, sort 0 ms, write 0 ms, index 600 ms: 9 candidates, 74064 repo-hours, 830 releases; waiting 11 ms; commit 0 ms)
2026-11-08T16:38:44Z [load_day 2025-06-12] 2025-06-12 hour 3: 145329 events in 0 files, snapshot none (task 4411 ms: download 2095 ms overlapping gunzip 710 ms, parse 2934 ms, sort 0 ms, write 0 ms, index 536 ms: 9 candidates, 69868 repo-hours, 1855 releases; waiting 0 ms; commit 0 ms)
2026-11-08T16:38:49Z [load_day 2025-06-12] 2025-06-12 hour 4: 145856 events in 0 files, snapshot none (task 4575 ms: download 2230 ms overlapping gunzip 721 ms, parse 3034 ms, sort 0 ms, write 0 ms, index 598 ms: 4 candidates, 64285 repo-hours, 767 releases; waiting 21 ms; commit 0 ms)
2026-11-08T16:38:49Z [load_day 2025-06-12] 2025-06-12 hour 5: 152258 events in 0 files, snapshot none (task 4513 ms: download 2275 ms overlapping gunzip 750 ms, parse 3007 ms, sort 0 ms, write 0 ms, index 527 ms: 7 candidates, 67505 repo-hours, 695 releases; waiting 20 ms; commit 0 ms)
2026-11-08T16:38:54Z [load_day 2025-06-12] 2025-06-12 hour 6: 153912 events in 0 files, snapshot none (task 4408 ms: download 2142 ms overlapping gunzip 731 ms, parse 2894 ms, sort 0 ms, write 0 ms, index 541 ms: 7 candidates, 79078 repo-hours, 812 releases; waiting 17 ms; commit 0 ms)
2026-11-08T16:38:55Z [load_day 2025-06-12] 2025-06-12 hour 7: 157047 events in 0 files, snapshot none (task 4952 ms: download 2530 ms overlapping gunzip 794 ms, parse 3273 ms, sort 0 ms, write 0 ms, index 584 ms: 6 candidates, 76285 repo-hours, 738 releases; waiting 16 ms; commit 0 ms)
2026-11-08T16:39:00Z [load_day 2025-06-12] 2025-06-12 hour 8: 161553 events in 0 files, snapshot none (task 5170 ms: download 2795 ms overlapping gunzip 853 ms, parse 3474 ms, sort 0 ms, write 0 ms, index 613 ms: 18 candidates, 80679 repo-hours, 813 releases; waiting 14 ms; commit 0 ms)
2026-11-08T16:39:01Z [load_day 2025-06-12] 2025-06-12 hour 9: 156303 events in 0 files, snapshot none (task 5031 ms: download 2645 ms overlapping gunzip 820 ms, parse 3346 ms, sort 0 ms, write 0 ms, index 617 ms: 8 candidates, 79441 repo-hours, 950 releases; waiting 19 ms; commit 0 ms)
2026-11-08T16:39:06Z [load_day 2025-06-12] 2025-06-12 hour 10: 160515 events in 0 files, snapshot none (task 5064 ms: download 2726 ms overlapping gunzip 853 ms, parse 3388 ms, sort 0 ms, write 0 ms, index 577 ms: 8 candidates, 79722 repo-hours, 886 releases; waiting 20 ms; commit 0 ms)
2026-11-08T16:39:06Z [load_day 2025-06-12] 2025-06-12 hour 11: 160492 events in 0 files, snapshot none (task 5154 ms: download 2752 ms overlapping gunzip 856 ms, parse 3468 ms, sort 0 ms, write 0 ms, index 587 ms: 10 candidates, 76926 repo-hours, 869 releases; waiting 17 ms; commit 0 ms)
2026-11-08T16:39:11Z [load_day 2025-06-12] 2025-06-12 hour 12: 171583 events in 0 files, snapshot none (task 5128 ms: download 2658 ms overlapping gunzip 802 ms, parse 3444 ms, sort 0 ms, write 0 ms, index 661 ms: 9 candidates, 100306 repo-hours, 928 releases; waiting 11 ms; commit 0 ms)
2026-11-08T16:39:12Z [load_day 2025-06-12] 2025-06-12 hour 13: 164987 events in 0 files, snapshot none (task 5152 ms: download 2759 ms overlapping gunzip 820 ms, parse 3400 ms, sort 0 ms, write 0 ms, index 685 ms: 13 candidates, 93270 repo-hours, 842 releases; waiting 17 ms; commit 0 ms)
2026-11-08T16:39:16Z [load_day 2025-06-12] 2025-06-12 hour 14: 164345 events in 0 files, snapshot none (task 5123 ms: download 2796 ms overlapping gunzip 858 ms, parse 3411 ms, sort 0 ms, write 0 ms, index 624 ms: 17 candidates, 84895 repo-hours, 855 releases; waiting 14 ms; commit 0 ms)
2026-11-08T16:39:18Z [load_day 2025-06-12] 2025-06-12 hour 15: 170201 events in 0 files, snapshot none (task 5169 ms: download 2872 ms overlapping gunzip 860 ms, parse 3471 ms, sort 0 ms, write 0 ms, index 602 ms: 11 candidates, 87960 repo-hours, 1003 releases; waiting 14 ms; commit 0 ms)
2026-11-08T16:39:22Z [load_day 2025-06-12] 2025-06-12 hour 16: 159837 events in 0 files, snapshot none (task 4894 ms: download 2576 ms overlapping gunzip 807 ms, parse 3259 ms, sort 0 ms, write 0 ms, index 600 ms: 17 candidates, 80010 repo-hours, 757 releases; waiting 13 ms; commit 0 ms)
2026-11-08T16:39:22Z [load_day 2025-06-12] 2025-06-12 hour 17: GH Archive has no file for it (HTTP 404, https://data.gharchive.org/2025-06-12-17.json.gz); the day goes on without it
2026-11-08T16:39:23Z [load_day 2025-06-12] 2025-06-12 hour 18: GH Archive has no file for it (HTTP 404, https://data.gharchive.org/2025-06-12-18.json.gz); the day goes on without it
2026-11-08T16:39:27Z [load_day 2025-06-12] 2025-06-12 hour 19: 148774 events in 0 files, snapshot none (task 5044 ms: download 2879 ms overlapping gunzip 737 ms, parse 3012 ms, sort 0 ms, write 0 ms, index 504 ms: 13 candidates, 66779 repo-hours, 589 releases; waiting 494 ms; commit 0 ms)
2026-11-08T16:39:28Z [load_day 2025-06-12] 2025-06-12 hour 20: 151015 events in 0 files, snapshot none (task 5454 ms: download 3485 ms overlapping gunzip 782 ms, parse 3164 ms, sort 0 ms, write 0 ms, index 509 ms: 8 candidates, 70055 repo-hours, 797 releases; waiting 583 ms; commit 0 ms)
2026-11-08T16:39:33Z [load_day 2025-06-12] 2025-06-12 hour 21: 147225 events in 0 files, snapshot none (task 5581 ms: download 3727 ms overlapping gunzip 765 ms, parse 3093 ms, sort 0 ms, write 0 ms, index 626 ms: 9 candidates, 65546 repo-hours, 930 releases; waiting 788 ms; commit 0 ms)
2026-11-08T16:39:34Z [load_day 2025-06-12] 2025-06-12 hour 22: 144552 events in 0 files, snapshot none (task 5579 ms: download 3927 ms overlapping gunzip 788 ms, parse 3070 ms, sort 0 ms, write 0 ms, index 527 ms: 7 candidates, 61827 repo-hours, 1019 releases; waiting 862 ms; commit 0 ms)
2026-11-08T16:39:39Z [load_day 2025-06-12] 2025-06-12 hour 23: 137056 events in 0 files, snapshot none (task 4878 ms: download 2817 ms overlapping gunzip 724 ms, parse 2903 ms, sort 0 ms, write 0 ms, index 484 ms: 8 candidates, 58751 repo-hours, 837 releases; waiting 485 ms; commit 0 ms)
2026-11-08T16:39:39Z [load_day 2025-06-12] 2025-06-12: loaded without 2 hours GH Archive never published (17, 18)
2026-11-08T16:39:46Z [load_day 2025-06-12] 2025-06-12: repo_hour merged from 22 files to 1 (1682121 rows, 7399 ms)
2026-11-08T16:39:49Z [load_day 2025-06-12] 2025-06-12: index committed in 10447 ms (22 + 1 + 22 files)
2026-11-08T16:39:49Z [load_day 2025-06-12] 2025-06-12: 3405122 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T16:39:49Z [load_day 2025-06-12] attempt 1 succeeded