orcaLog in

Runs · run 4542

load_day 2025-10-25, attempt 1 succeeded

Host
73ccef5e07c2:397293
Started
2026-11-08T14:18:25Z
Ended
2026-11-08T14:19:19Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
631 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
61.3 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4542/load_day/2025-10-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:18:25Z [load_day 2025-10-25] attempt 1 started
2026-11-08T14:18:26Z [load_day 2025-10-25] 2025-10-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:18:30Z [load_day 2025-10-25] 2025-10-25 hour 0: 142649 events in 0 files, snapshot none (task 2838 ms: download 1755 ms overlapping gunzip 340 ms, parse 1107 ms, sort 0 ms, write 0 ms, index 549 ms: 6 candidates, 71112 repo-hours, 819 releases; waiting 610 ms; commit 0 ms)
2026-11-08T14:18:30Z [load_day 2025-10-25] 2025-10-25 hour 1: 146920 events in 0 files, snapshot none (task 3096 ms: download 2088 ms overlapping gunzip 336 ms, parse 1102 ms, sort 0 ms, write 0 ms, index 588 ms: 3 candidates, 84739 repo-hours, 721 releases; waiting 807 ms; commit 0 ms)
2026-11-08T14:18:33Z [load_day 2025-10-25] 2025-10-25 hour 2: 134109 events in 0 files, snapshot none (task 3223 ms: download 2156 ms overlapping gunzip 376 ms, parse 1176 ms, sort 0 ms, write 0 ms, index 472 ms: 2 candidates, 58347 repo-hours, 577 releases; waiting 738 ms; commit 0 ms)
2026-11-08T14:18:33Z [load_day 2025-10-25] 2025-10-25 hour 3: 141894 events in 0 files, snapshot none (task 2882 ms: download 1870 ms overlapping gunzip 303 ms, parse 983 ms, sort 0 ms, write 0 ms, index 473 ms: 3 candidates, 59636 repo-hours, 1701 releases; waiting 769 ms; commit 0 ms)
2026-11-08T14:18:37Z [load_day 2025-10-25] 2025-10-25 hour 4: 141992 events in 0 files, snapshot none (task 3030 ms: download 2158 ms overlapping gunzip 329 ms, parse 1061 ms, sort 0 ms, write 0 ms, index 415 ms: 4 candidates, 57500 repo-hours, 451 releases; waiting 918 ms; commit 0 ms)
2026-11-08T14:18:37Z [load_day 2025-10-25] 2025-10-25 hour 5: 137861 events in 0 files, snapshot none (task 3229 ms: download 2424 ms overlapping gunzip 408 ms, parse 1173 ms, sort 0 ms, write 0 ms, index 478 ms: 2 candidates, 57499 repo-hours, 487 releases; waiting 910 ms; commit 0 ms)
2026-11-08T14:18:40Z [load_day 2025-10-25] 2025-10-25 hour 6: 140446 events in 0 files, snapshot none (task 2886 ms: download 1861 ms overlapping gunzip 392 ms, parse 1190 ms, sort 0 ms, write 0 ms, index 454 ms: 3 candidates, 63801 repo-hours, 649 releases; waiting 532 ms; commit 0 ms)
2026-11-08T14:18:40Z [load_day 2025-10-25] 2025-10-25 hour 7: 142368 events in 0 files, snapshot none (task 2801 ms: download 1686 ms overlapping gunzip 323 ms, parse 1115 ms, sort 0 ms, write 0 ms, index 437 ms: 5 candidates, 58869 repo-hours, 518 releases; waiting 555 ms; commit 0 ms)
2026-11-08T14:18:44Z [load_day 2025-10-25] 2025-10-25 hour 8: 146562 events in 0 files, snapshot none (task 2872 ms: download 1615 ms overlapping gunzip 350 ms, parse 1080 ms, sort 0 ms, write 0 ms, index 448 ms: 4 candidates, 64028 repo-hours, 584 releases; waiting 694 ms; commit 0 ms)
2026-11-08T14:18:45Z [load_day 2025-10-25] 2025-10-25 hour 9: 145458 events in 0 files, snapshot none (task 3575 ms: download 2262 ms overlapping gunzip 342 ms, parse 1180 ms, sort 0 ms, write 0 ms, index 451 ms: 2 candidates, 62798 repo-hours, 635 releases; waiting 1303 ms; commit 0 ms)
2026-11-08T14:18:47Z [load_day 2025-10-25] 2025-10-25 hour 10: 144715 events in 0 files, snapshot none (task 2993 ms: download 1704 ms overlapping gunzip 356 ms, parse 1071 ms, sort 0 ms, write 0 ms, index 477 ms: 5 candidates, 63107 repo-hours, 505 releases; waiting 604 ms; commit 0 ms)
2026-11-08T14:18:48Z [load_day 2025-10-25] 2025-10-25 hour 11: 147647 events in 0 files, snapshot none (task 2805 ms: download 1862 ms overlapping gunzip 388 ms, parse 1139 ms, sort 0 ms, write 0 ms, index 460 ms: 4 candidates, 62056 repo-hours, 488 releases; waiting 490 ms; commit 0 ms)
2026-11-08T14:18:51Z [load_day 2025-10-25] 2025-10-25 hour 12: 159801 events in 0 files, snapshot none (task 3218 ms: download 1905 ms overlapping gunzip 344 ms, parse 1148 ms, sort 0 ms, write 0 ms, index 708 ms: 10 candidates, 90538 repo-hours, 605 releases; waiting 728 ms; commit 0 ms)
2026-11-08T14:18:52Z [load_day 2025-10-25] 2025-10-25 hour 13: 149293 events in 0 files, snapshot none (task 3313 ms: download 2265 ms overlapping gunzip 359 ms, parse 1127 ms, sort 0 ms, write 0 ms, index 579 ms: 4 candidates, 77199 repo-hours, 466 releases; waiting 854 ms; commit 0 ms)
2026-11-08T14:18:55Z [load_day 2025-10-25] 2025-10-25 hour 14: 145039 events in 0 files, snapshot none (task 3380 ms: download 2217 ms overlapping gunzip 376 ms, parse 1309 ms, sort 0 ms, write 0 ms, index 601 ms: 7 candidates, 67153 repo-hours, 526 releases; waiting 788 ms; commit 0 ms)
2026-11-08T14:18:55Z [load_day 2025-10-25] 2025-10-25 hour 15: 144925 events in 0 files, snapshot none (task 2929 ms: download 1983 ms overlapping gunzip 367 ms, parse 1090 ms, sort 0 ms, write 0 ms, index 538 ms: 6 candidates, 68157 repo-hours, 540 releases; waiting 586 ms; commit 0 ms)
2026-11-08T14:18:58Z [load_day 2025-10-25] 2025-10-25 hour 16: 147228 events in 0 files, snapshot none (task 3121 ms: download 1879 ms overlapping gunzip 471 ms, parse 1354 ms, sort 0 ms, write 0 ms, index 560 ms: 10 candidates, 69077 repo-hours, 554 releases; waiting 314 ms; commit 0 ms)
2026-11-08T14:18:58Z [load_day 2025-10-25] 2025-10-25 hour 17: 145726 events in 0 files, snapshot none (task 2859 ms: download 1642 ms overlapping gunzip 440 ms, parse 1354 ms, sort 0 ms, write 0 ms, index 527 ms: 8 candidates, 66185 repo-hours, 470 releases; waiting 217 ms; commit 0 ms)
2026-11-08T14:19:02Z [load_day 2025-10-25] 2025-10-25 hour 18: 147319 events in 0 files, snapshot none (task 3316 ms: download 2020 ms overlapping gunzip 478 ms, parse 1409 ms, sort 0 ms, write 0 ms, index 550 ms: 5 candidates, 70972 repo-hours, 592 releases; waiting 556 ms; commit 0 ms)
2026-11-08T14:19:02Z [load_day 2025-10-25] 2025-10-25 hour 19: 141520 events in 0 files, snapshot none (task 2884 ms: download 1518 ms overlapping gunzip 447 ms, parse 1422 ms, sort 0 ms, write 0 ms, index 528 ms: 4 candidates, 58789 repo-hours, 528 releases; waiting 204 ms; commit 0 ms)
2026-11-08T14:19:06Z [load_day 2025-10-25] 2025-10-25 hour 20: 146240 events in 0 files, snapshot none (task 3249 ms: download 1924 ms overlapping gunzip 443 ms, parse 1412 ms, sort 0 ms, write 0 ms, index 523 ms: 6 candidates, 62794 repo-hours, 552 releases; waiting 524 ms; commit 0 ms)
2026-11-08T14:19:06Z [load_day 2025-10-25] 2025-10-25 hour 21: 144510 events in 0 files, snapshot none (task 3315 ms: download 1820 ms overlapping gunzip 420 ms, parse 1436 ms, sort 0 ms, write 0 ms, index 466 ms: 4 candidates, 61025 repo-hours, 592 releases; waiting 649 ms; commit 0 ms)
2026-11-08T14:19:09Z [load_day 2025-10-25] 2025-10-25 hour 22: 142019 events in 0 files, snapshot none (task 3412 ms: download 2146 ms overlapping gunzip 483 ms, parse 1515 ms, sort 0 ms, write 0 ms, index 451 ms: 3 candidates, 56758 repo-hours, 620 releases; waiting 658 ms; commit 0 ms)
2026-11-08T14:19:09Z [load_day 2025-10-25] 2025-10-25 hour 23: 136918 events in 0 files, snapshot none (task 3185 ms: download 1866 ms overlapping gunzip 423 ms, parse 1502 ms, sort 0 ms, write 0 ms, index 431 ms: 7 candidates, 51643 repo-hours, 641 releases; waiting 534 ms; commit 0 ms)
2026-11-08T14:19:16Z [load_day 2025-10-25] 2025-10-25: repo_hour merged from 24 files to 1 (1563782 rows, 7126 ms)
2026-11-08T14:19:19Z [load_day 2025-10-25] 2025-10-25: index committed in 9918 ms (24 + 1 + 24 files)
2026-11-08T14:19:19Z [load_day 2025-10-25] 2025-10-25: 3463159 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:19:19Z [load_day 2025-10-25] attempt 1 succeeded