orcaLog in

Runs · run 4395

load_day 2025-09-16, attempt 1 succeeded

Host
73ccef5e07c2:379723
Started
2026-11-08T13:51:51Z
Ended
2026-11-08T13:53:42Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
691 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
159.7 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4395/load_day/2025-09-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:51:51Z [load_day 2025-09-16] attempt 1 started
2026-11-08T13:51:52Z [load_day 2025-09-16] 2025-09-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:51:58Z [load_day 2025-09-16] 2025-09-16 hour 0: 152289 events in 0 files, snapshot none (task 5279 ms: download 3640 ms overlapping gunzip 782 ms, parse 3085 ms, sort 0 ms, write 0 ms, index 591 ms: 6 candidates, 75354 repo-hours, 988 releases; waiting 595 ms; commit 0 ms)
2026-11-08T13:51:58Z [load_day 2025-09-16] 2025-09-16 hour 1: 163813 events in 0 files, snapshot none (task 5469 ms: download 3033 ms overlapping gunzip 814 ms, parse 3233 ms, sort 0 ms, write 0 ms, index 667 ms: 7 candidates, 95149 repo-hours, 794 releases; waiting 505 ms; commit 0 ms)
2026-11-08T13:52:06Z [load_day 2025-09-16] 2025-09-16 hour 2: 154446 events in 0 files, snapshot none (task 7851 ms: download 5556 ms overlapping gunzip 900 ms, parse 3495 ms, sort 0 ms, write 0 ms, index 548 ms: 4 candidates, 72972 repo-hours, 835 releases; waiting 2678 ms; commit 0 ms)
2026-11-08T13:52:06Z [load_day 2025-09-16] 2025-09-16 hour 3: 157927 events in 0 files, snapshot none (task 6947 ms: download 4583 ms overlapping gunzip 850 ms, parse 3342 ms, sort 0 ms, write 0 ms, index 540 ms: 10 candidates, 70383 repo-hours, 2001 releases; waiting 1918 ms; commit 0 ms)
2026-11-08T13:52:14Z [load_day 2025-09-16] 2025-09-16 hour 4: 148297 events in 0 files, snapshot none (task 6685 ms: download 3937 ms overlapping gunzip 1097 ms, parse 4284 ms, sort 0 ms, write 0 ms, index 559 ms: 10 candidates, 64562 repo-hours, 710 releases; waiting 514 ms; commit 0 ms)
2026-11-08T13:52:14Z [load_day 2025-09-16] 2025-09-16 hour 5: 154828 events in 0 files, snapshot none (task 6845 ms: download 4410 ms overlapping gunzip 1170 ms, parse 4623 ms, sort 0 ms, write 0 ms, index 522 ms: 4 candidates, 67013 repo-hours, 632 releases; waiting 327 ms; commit 0 ms)
2026-11-08T13:52:21Z [load_day 2025-09-16] 2025-09-16 hour 6: 159662 events in 0 files, snapshot none (task 7315 ms: download 4511 ms overlapping gunzip 1249 ms, parse 4819 ms, sort 0 ms, write 0 ms, index 664 ms: 3 candidates, 80254 repo-hours, 787 releases; waiting 311 ms; commit 0 ms)
2026-11-08T13:52:22Z [load_day 2025-09-16] 2025-09-16 hour 7: 166113 events in 0 files, snapshot none (task 7894 ms: download 5357 ms overlapping gunzip 1317 ms, parse 5158 ms, sort 0 ms, write 0 ms, index 600 ms: 10 candidates, 78303 repo-hours, 792 releases; waiting 534 ms; commit 0 ms)
2026-11-08T13:52:31Z [load_day 2025-09-16] 2025-09-16 hour 8: 165020 events in 0 files, snapshot none (task 9283 ms: download 6271 ms overlapping gunzip 1532 ms, parse 6319 ms, sort 0 ms, write 0 ms, index 714 ms: 2 candidates, 80979 repo-hours, 751 releases; waiting 471 ms; commit 0 ms)
2026-11-08T13:52:32Z [load_day 2025-09-16] 2025-09-16 hour 9: 168832 events in 0 files, snapshot none (task 9355 ms: download 6460 ms overlapping gunzip 1623 ms, parse 6342 ms, sort 0 ms, write 0 ms, index 668 ms: 4 candidates, 82675 repo-hours, 919 releases; waiting 479 ms; commit 0 ms)
2026-11-08T13:52:40Z [load_day 2025-09-16] 2025-09-16 hour 10: 167529 events in 0 files, snapshot none (task 8273 ms: download 5818 ms overlapping gunzip 1362 ms, parse 5333 ms, sort 0 ms, write 0 ms, index 598 ms: 8 candidates, 80434 repo-hours, 911 releases; waiting 733 ms; commit 0 ms)
2026-11-08T13:52:41Z [load_day 2025-09-16] 2025-09-16 hour 11: 162726 events in 0 files, snapshot none (task 8281 ms: download 5736 ms overlapping gunzip 1393 ms, parse 5461 ms, sort 0 ms, write 0 ms, index 642 ms: 3 candidates, 76359 repo-hours, 670 releases; waiting 463 ms; commit 0 ms)
2026-11-08T13:52:48Z [load_day 2025-09-16] 2025-09-16 hour 12: 165534 events in 0 files, snapshot none (task 7635 ms: download 4605 ms overlapping gunzip 1158 ms, parse 4601 ms, sort 0 ms, write 0 ms, index 926 ms: 8 candidates, 97098 repo-hours, 775 releases; waiting 661 ms; commit 0 ms)
2026-11-08T13:52:49Z [load_day 2025-09-16] 2025-09-16 hour 13: 168211 events in 0 files, snapshot none (task 7810 ms: download 5283 ms overlapping gunzip 1192 ms, parse 5090 ms, sort 0 ms, write 0 ms, index 739 ms: 11 candidates, 93006 repo-hours, 753 releases; waiting 534 ms; commit 0 ms)
2026-11-08T13:52:57Z [load_day 2025-09-16] 2025-09-16 hour 14: 170422 events in 0 files, snapshot none (task 8294 ms: download 5236 ms overlapping gunzip 1250 ms, parse 5453 ms, sort 0 ms, write 0 ms, index 825 ms: 10 candidates, 88293 repo-hours, 917 releases; waiting 525 ms; commit 0 ms)
2026-11-08T13:52:58Z [load_day 2025-09-16] 2025-09-16 hour 15: 168737 events in 0 files, snapshot none (task 8068 ms: download 5235 ms overlapping gunzip 1304 ms, parse 5175 ms, sort 0 ms, write 0 ms, index 768 ms: 11 candidates, 86449 repo-hours, 985 releases; waiting 509 ms; commit 0 ms)
2026-11-08T13:53:05Z [load_day 2025-09-16] 2025-09-16 hour 16: 168909 events in 0 files, snapshot none (task 7192 ms: download 4435 ms overlapping gunzip 1137 ms, parse 4726 ms, sort 0 ms, write 0 ms, index 731 ms: 8 candidates, 85282 repo-hours, 1072 releases; waiting 207 ms; commit 0 ms)
2026-11-08T13:53:06Z [load_day 2025-09-16] 2025-09-16 hour 17: 163262 events in 0 files, snapshot none (task 6971 ms: download 4310 ms overlapping gunzip 1064 ms, parse 4492 ms, sort 0 ms, write 0 ms, index 626 ms: 10 candidates, 78193 repo-hours, 763 releases; waiting 503 ms; commit 0 ms)
2026-11-08T13:53:13Z [load_day 2025-09-16] 2025-09-16 hour 18: 162411 events in 0 files, snapshot none (task 7022 ms: download 4170 ms overlapping gunzip 1052 ms, parse 4312 ms, sort 0 ms, write 0 ms, index 809 ms: 11 candidates, 82625 repo-hours, 870 releases; waiting 542 ms; commit 0 ms)
2026-11-08T13:53:13Z [load_day 2025-09-16] 2025-09-16 hour 19: 164345 events in 0 files, snapshot none (task 7188 ms: download 4661 ms overlapping gunzip 1083 ms, parse 4502 ms, sort 0 ms, write 0 ms, index 628 ms: 14 candidates, 74940 repo-hours, 1007 releases; waiting 690 ms; commit 0 ms)
2026-11-08T13:53:21Z [load_day 2025-09-16] 2025-09-16 hour 20: 156953 events in 0 files, snapshot none (task 7665 ms: download 4483 ms overlapping gunzip 1179 ms, parse 5015 ms, sort 0 ms, write 0 ms, index 663 ms: 13 candidates, 73363 repo-hours, 953 releases; waiting 580 ms; commit 0 ms)
2026-11-08T13:53:23Z [load_day 2025-09-16] 2025-09-16 hour 21: 156655 events in 0 files, snapshot none (task 8936 ms: download 6296 ms overlapping gunzip 1007 ms, parse 4368 ms, sort 0 ms, write 0 ms, index 776 ms: 6 candidates, 67319 repo-hours, 837 releases; waiting 2497 ms; commit 0 ms)
2026-11-08T13:53:28Z [load_day 2025-09-16] 2025-09-16 hour 22: 150259 events in 0 files, snapshot none (task 6107 ms: download 3650 ms overlapping gunzip 947 ms, parse 3824 ms, sort 0 ms, write 0 ms, index 707 ms: 3 candidates, 65446 repo-hours, 882 releases; waiting 388 ms; commit 0 ms)
2026-11-08T13:53:31Z [load_day 2025-09-16] 2025-09-16 hour 23: 145864 events in 0 files, snapshot none (task 7417 ms: download 4935 ms overlapping gunzip 914 ms, parse 3660 ms, sort 0 ms, write 0 ms, index 480 ms: 7 candidates, 59435 repo-hours, 641 releases; waiting 2043 ms; commit 0 ms)
2026-11-08T13:53:39Z [load_day 2025-09-16] 2025-09-16: repo_hour merged from 24 files to 1 (1875886 rows, 8473 ms)
2026-11-08T13:53:42Z [load_day 2025-09-16] 2025-09-16: index committed in 11256 ms (24 + 1 + 24 files)
2026-11-08T13:53:42Z [load_day 2025-09-16] 2025-09-16: 3863044 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:53:42Z [load_day 2025-09-16] attempt 1 succeeded