orcaLog in

Runs · run 1882

load_day 2023-12-21, attempt 1 succeeded

Host
73ccef5e07c2:11612
Started
2026-11-08T03:51:02Z
Ended
2026-11-08T03:52:38Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
744 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
149.8 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1882/load_day/2023-12-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T03:51:02Z [load_day 2023-12-21] attempt 1 started
2026-11-08T03:51:03Z [load_day 2023-12-21] 2023-12-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T03:51:10Z [load_day 2023-12-21] 2023-12-21 hour 0: 155294 events in 0 files, snapshot none (task 6773 ms: download 3345 ms overlapping gunzip 1027 ms, parse 4218 ms, sort 0 ms, write 0 ms, index 678 ms: 10 candidates, 81702 repo-hours, 1399 releases; waiting 504 ms; commit 0 ms)
2026-11-08T03:51:10Z [load_day 2023-12-21] 2023-12-21 hour 1: 158337 events in 0 files, snapshot none (task 6693 ms: download 3272 ms overlapping gunzip 973 ms, parse 4038 ms, sort 0 ms, write 0 ms, index 810 ms: 6 candidates, 88258 repo-hours, 1036 releases; waiting 522 ms; commit 0 ms)
2026-11-08T03:51:16Z [load_day 2023-12-21] 2023-12-21 hour 2: 133863 events in 0 files, snapshot none (task 5124 ms: download 3190 ms overlapping gunzip 718 ms, parse 3042 ms, sort 0 ms, write 0 ms, index 698 ms: 5 candidates, 58172 repo-hours, 720 releases; waiting 336 ms; commit 0 ms)
2026-11-08T03:51:16Z [load_day 2023-12-21] 2023-12-21 hour 3: 131820 events in 0 files, snapshot none (task 5394 ms: download 2968 ms overlapping gunzip 791 ms, parse 3187 ms, sort 0 ms, write 0 ms, index 578 ms: 5 candidates, 56052 repo-hours, 835 releases; waiting 532 ms; commit 0 ms)
2026-11-08T03:51:21Z [load_day 2023-12-21] 2023-12-21 hour 4: 127753 events in 0 files, snapshot none (task 4771 ms: download 2425 ms overlapping gunzip 709 ms, parse 2911 ms, sort 0 ms, write 0 ms, index 358 ms: 5 candidates, 53000 repo-hours, 609 releases; waiting 515 ms; commit 0 ms)
2026-11-08T03:51:22Z [load_day 2023-12-21] 2023-12-21 hour 5: 140063 events in 0 files, snapshot none (task 5140 ms: download 2961 ms overlapping gunzip 791 ms, parse 3208 ms, sort 0 ms, write 0 ms, index 432 ms: 8 candidates, 58521 repo-hours, 709 releases; waiting 501 ms; commit 0 ms)
2026-11-08T03:51:28Z [load_day 2023-12-21] 2023-12-21 hour 6: 158748 events in 0 files, snapshot none (task 5825 ms: download 3271 ms overlapping gunzip 887 ms, parse 3643 ms, sort 0 ms, write 0 ms, index 547 ms: 6 candidates, 72020 repo-hours, 825 releases; waiting 489 ms; commit 0 ms)
2026-11-08T03:51:28Z [load_day 2023-12-21] 2023-12-21 hour 7: 166544 events in 0 files, snapshot none (task 5893 ms: download 3498 ms overlapping gunzip 880 ms, parse 3667 ms, sort 0 ms, write 0 ms, index 574 ms: 6 candidates, 70704 repo-hours, 910 releases; waiting 485 ms; commit 0 ms)
2026-11-08T03:51:35Z [load_day 2023-12-21] 2023-12-21 hour 8: 180923 events in 0 files, snapshot none (task 7283 ms: download 4601 ms overlapping gunzip 1134 ms, parse 4772 ms, sort 0 ms, write 0 ms, index 568 ms: 10 candidates, 79106 repo-hours, 990 releases; waiting 505 ms; commit 0 ms)
2026-11-08T03:51:36Z [load_day 2023-12-21] 2023-12-21 hour 9: 190396 events in 0 files, snapshot none (task 7153 ms: download 4656 ms overlapping gunzip 1081 ms, parse 4617 ms, sort 0 ms, write 0 ms, index 565 ms: 7 candidates, 81896 repo-hours, 1280 releases; waiting 530 ms; commit 0 ms)
2026-11-08T03:51:42Z [load_day 2023-12-21] 2023-12-21 hour 10: 186285 events in 0 files, snapshot none (task 6659 ms: download 4429 ms overlapping gunzip 942 ms, parse 3895 ms, sort 0 ms, write 0 ms, index 581 ms: 10 candidates, 81238 repo-hours, 1150 releases; waiting 915 ms; commit 0 ms)
2026-11-08T03:51:42Z [load_day 2023-12-21] 2023-12-21 hour 11: 182873 events in 0 files, snapshot none (task 5685 ms: download 3347 ms overlapping gunzip 855 ms, parse 3517 ms, sort 0 ms, write 0 ms, index 546 ms: 10 candidates, 75485 repo-hours, 1054 releases; waiting 526 ms; commit 0 ms)
2026-11-08T03:51:50Z [load_day 2023-12-21] 2023-12-21 hour 12: 233458 events in 0 files, snapshot none (task 6972 ms: download 3811 ms overlapping gunzip 903 ms, parse 4072 ms, sort 0 ms, write 0 ms, index 1175 ms: 10 candidates, 106213 repo-hours, 1695 releases; waiting 521 ms; commit 0 ms)
2026-11-08T03:51:50Z [load_day 2023-12-21] 2023-12-21 hour 13: 213159 events in 0 files, snapshot none (task 7211 ms: download 4150 ms overlapping gunzip 1001 ms, parse 4312 ms, sort 0 ms, write 0 ms, index 1010 ms: 9 candidates, 99716 repo-hours, 2015 releases; waiting 528 ms; commit 0 ms)
2026-11-08T03:51:59Z [load_day 2023-12-21] 2023-12-21 hour 14: 210182 events in 0 files, snapshot none (task 8649 ms: download 5812 ms overlapping gunzip 1398 ms, parse 5790 ms, sort 0 ms, write 0 ms, index 730 ms: 9 candidates, 88955 repo-hours, 1320 releases; waiting 500 ms; commit 0 ms)
2026-11-08T03:51:59Z [load_day 2023-12-21] 2023-12-21 hour 15: 209792 events in 0 files, snapshot none (task 8101 ms: download 4948 ms overlapping gunzip 1221 ms, parse 5189 ms, sort 0 ms, write 0 ms, index 952 ms: 12 candidates, 89263 repo-hours, 1508 releases; waiting 452 ms; commit 0 ms)
2026-11-08T03:52:08Z [load_day 2023-12-21] 2023-12-21 hour 16: 201971 events in 0 files, snapshot none (task 8207 ms: download 5610 ms overlapping gunzip 1202 ms, parse 5180 ms, sort 0 ms, write 0 ms, index 711 ms: 10 candidates, 84799 repo-hours, 1224 releases; waiting 763 ms; commit 0 ms)
2026-11-08T03:52:08Z [load_day 2023-12-21] 2023-12-21 hour 17: 189213 events in 0 files, snapshot none (task 7509 ms: download 4753 ms overlapping gunzip 1127 ms, parse 4597 ms, sort 0 ms, write 0 ms, index 626 ms: 5 candidates, 76482 repo-hours, 1975 releases; waiting 539 ms; commit 0 ms)
2026-11-08T03:52:15Z [load_day 2023-12-21] 2023-12-21 hour 18: 194465 events in 0 files, snapshot none (task 7325 ms: download 4403 ms overlapping gunzip 1145 ms, parse 4759 ms, sort 0 ms, write 0 ms, index 629 ms: 11 candidates, 80317 repo-hours, 1235 releases; waiting 535 ms; commit 0 ms)
2026-11-08T03:52:15Z [load_day 2023-12-21] 2023-12-21 hour 19: 175751 events in 0 files, snapshot none (task 6643 ms: download 3541 ms overlapping gunzip 1000 ms, parse 4086 ms, sort 0 ms, write 0 ms, index 708 ms: 9 candidates, 66948 repo-hours, 984 releases; waiting 522 ms; commit 0 ms)
2026-11-08T03:52:21Z [load_day 2023-12-21] 2023-12-21 hour 20: 166759 events in 0 files, snapshot none (task 5368 ms: download 2986 ms overlapping gunzip 875 ms, parse 3531 ms, sort 0 ms, write 0 ms, index 489 ms: 8 candidates, 64572 repo-hours, 895 releases; waiting 178 ms; commit 0 ms)
2026-11-08T03:52:21Z [load_day 2023-12-21] 2023-12-21 hour 21: 154660 events in 0 files, snapshot none (task 5717 ms: download 3532 ms overlapping gunzip 886 ms, parse 3608 ms, sort 0 ms, write 0 ms, index 421 ms: 5 candidates, 58905 repo-hours, 985 releases; waiting 512 ms; commit 0 ms)
2026-11-08T03:52:27Z [load_day 2023-12-21] 2023-12-21 hour 22: 145130 events in 0 files, snapshot none (task 5860 ms: download 3737 ms overlapping gunzip 906 ms, parse 3795 ms, sort 0 ms, write 0 ms, index 384 ms: 6 candidates, 53805 repo-hours, 1066 releases; waiting 509 ms; commit 0 ms)
2026-11-08T03:52:27Z [load_day 2023-12-21] 2023-12-21 hour 23: 133293 events in 0 files, snapshot none (task 4572 ms: download 2424 ms overlapping gunzip 756 ms, parse 2974 ms, sort 0 ms, write 0 ms, index 359 ms: 4 candidates, 50463 repo-hours, 803 releases; waiting 210 ms; commit 0 ms)
2026-11-08T03:52:35Z [load_day 2023-12-21] 2023-12-21: repo_hour merged from 24 files to 1 (1776592 rows, 8029 ms)
2026-11-08T03:52:38Z [load_day 2023-12-21] 2023-12-21: index committed in 10290 ms (24 + 1 + 24 files)
2026-11-08T03:52:38Z [load_day 2023-12-21] 2023-12-21: 4140732 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T03:52:38Z [load_day 2023-12-21] attempt 1 succeeded