orcaLog in

Runs · run 2833

load_day 2024-08-12, attempt 1 succeeded

Host
73ccef5e07c2:162837
Started
2026-11-08T07:24:32Z
Ended
2026-11-08T07:26:35Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
709 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
194.7 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2833/load_day/2024-08-12/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:24:32Z [load_day 2024-08-12] attempt 1 started
2026-11-08T07:24:33Z [load_day 2024-08-12] 2024-08-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:24:40Z [load_day 2024-08-12] 2024-08-12 hour 0: 163406 events in 0 files, snapshot none (task 6277 ms: download 3452 ms overlapping gunzip 964 ms, parse 3858 ms, sort 0 ms, write 0 ms, index 586 ms: 7 candidates, 80459 repo-hours, 1007 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:24:41Z [load_day 2024-08-12] 2024-08-12 hour 1: 180918 events in 0 files, snapshot none (task 6875 ms: download 4364 ms overlapping gunzip 1018 ms, parse 4123 ms, sort 0 ms, write 0 ms, index 794 ms: 5 candidates, 98440 repo-hours, 841 releases; waiting 696 ms; commit 0 ms)
2026-11-08T07:24:47Z [load_day 2024-08-12] 2024-08-12 hour 2: 158898 events in 0 files, snapshot none (task 6284 ms: download 3880 ms overlapping gunzip 1066 ms, parse 4243 ms, sort 0 ms, write 0 ms, index 481 ms: 6 candidates, 65939 repo-hours, 831 releases; waiting 180 ms; commit 0 ms)
2026-11-08T07:24:48Z [load_day 2024-08-12] 2024-08-12 hour 3: 180428 events in 0 files, snapshot none (task 6809 ms: download 4534 ms overlapping gunzip 1079 ms, parse 4519 ms, sort 0 ms, write 0 ms, index 546 ms: 5 candidates, 73265 repo-hours, 5350 releases; waiting 443 ms; commit 0 ms)
2026-11-08T07:24:54Z [load_day 2024-08-12] 2024-08-12 hour 4: 158565 events in 0 files, snapshot none (task 6449 ms: download 3990 ms overlapping gunzip 1042 ms, parse 4134 ms, sort 0 ms, write 0 ms, index 480 ms: 9 candidates, 59227 repo-hours, 699 releases; waiting 516 ms; commit 0 ms)
2026-11-08T07:24:55Z [load_day 2024-08-12] 2024-08-12 hour 5: 172867 events in 0 files, snapshot none (task 6832 ms: download 4233 ms overlapping gunzip 1058 ms, parse 4175 ms, sort 0 ms, write 0 ms, index 747 ms: 5 candidates, 66679 repo-hours, 787 releases; waiting 515 ms; commit 0 ms)
2026-11-08T07:25:03Z [load_day 2024-08-12] 2024-08-12 hour 6: 205037 events in 0 files, snapshot none (task 9094 ms: download 5301 ms overlapping gunzip 1469 ms, parse 6120 ms, sort 0 ms, write 0 ms, index 1063 ms: 10 candidates, 90695 repo-hours, 1019 releases; waiting 183 ms; commit 0 ms)
2026-11-08T07:25:06Z [load_day 2024-08-12] 2024-08-12 hour 7: 206380 events in 0 files, snapshot none (task 9911 ms: download 7030 ms overlapping gunzip 1625 ms, parse 6799 ms, sort 0 ms, write 0 ms, index 725 ms: 8 candidates, 82072 repo-hours, 1040 releases; waiting 498 ms; commit 0 ms)
2026-11-08T07:25:13Z [load_day 2024-08-12] 2024-08-12 hour 8: 219303 events in 0 files, snapshot none (task 9539 ms: download 6847 ms overlapping gunzip 1536 ms, parse 6034 ms, sort 0 ms, write 0 ms, index 724 ms: 22 candidates, 90655 repo-hours, 1157 releases; waiting 901 ms; commit 0 ms)
2026-11-08T07:25:15Z [load_day 2024-08-12] 2024-08-12 hour 9: 225002 events in 0 files, snapshot none (task 8887 ms: download 6323 ms overlapping gunzip 1427 ms, parse 5881 ms, sort 0 ms, write 0 ms, index 754 ms: 15 candidates, 96677 repo-hours, 1360 releases; waiting 483 ms; commit 0 ms)
2026-11-08T07:25:22Z [load_day 2024-08-12] 2024-08-12 hour 10: 210502 events in 0 files, snapshot none (task 7615 ms: download 5164 ms overlapping gunzip 1234 ms, parse 5015 ms, sort 0 ms, write 0 ms, index 577 ms: 13 candidates, 86619 repo-hours, 1206 releases; waiting 528 ms; commit 0 ms)
2026-11-08T07:25:23Z [load_day 2024-08-12] 2024-08-12 hour 11: 211675 events in 0 files, snapshot none (task 7145 ms: download 4729 ms overlapping gunzip 1191 ms, parse 4724 ms, sort 0 ms, write 0 ms, index 591 ms: 12 candidates, 84449 repo-hours, 1107 releases; waiting 294 ms; commit 0 ms)
2026-11-08T07:25:32Z [load_day 2024-08-12] 2024-08-12 hour 12: 263670 events in 0 files, snapshot none (task 9833 ms: download 6672 ms overlapping gunzip 1514 ms, parse 6440 ms, sort 0 ms, write 0 ms, index 971 ms: 6 candidates, 130033 repo-hours, 1184 releases; waiting 580 ms; commit 0 ms)
2026-11-08T07:25:35Z [load_day 2024-08-12] 2024-08-12 hour 13: 244242 events in 0 files, snapshot none (task 11397 ms: download 7960 ms overlapping gunzip 1762 ms, parse 7217 ms, sort 0 ms, write 0 ms, index 1455 ms: 11 candidates, 112048 repo-hours, 1296 releases; waiting 572 ms; commit 0 ms)
2026-11-08T07:25:42Z [load_day 2024-08-12] 2024-08-12 hour 14: 241715 events in 0 files, snapshot none (task 9476 ms: download 6290 ms overlapping gunzip 1565 ms, parse 6092 ms, sort 0 ms, write 0 ms, index 1026 ms: 12 candidates, 100811 repo-hours, 1279 releases; waiting 514 ms; commit 0 ms)
2026-11-08T07:25:45Z [load_day 2024-08-12] 2024-08-12 hour 15: 240926 events in 0 files, snapshot none (task 9822 ms: download 7045 ms overlapping gunzip 1590 ms, parse 6626 ms, sort 0 ms, write 0 ms, index 796 ms: 12 candidates, 105059 repo-hours, 1310 releases; waiting 499 ms; commit 0 ms)
2026-11-08T07:25:54Z [load_day 2024-08-12] 2024-08-12 hour 16: 229978 events in 0 files, snapshot none (task 11103 ms: download 7190 ms overlapping gunzip 1794 ms, parse 7385 ms, sort 0 ms, write 0 ms, index 940 ms: 10 candidates, 92786 repo-hours, 1180 releases; waiting 665 ms; commit 0 ms)
2026-11-08T07:25:55Z [load_day 2024-08-12] 2024-08-12 hour 17: 217260 events in 0 files, snapshot none (task 9870 ms: download 6851 ms overlapping gunzip 1552 ms, parse 6750 ms, sort 0 ms, write 0 ms, index 758 ms: 9 candidates, 90042 repo-hours, 1083 releases; waiting 492 ms; commit 0 ms)
2026-11-08T07:26:05Z [load_day 2024-08-12] 2024-08-12 hour 18: 226713 events in 0 files, snapshot none (task 10832 ms: download 7689 ms overlapping gunzip 1864 ms, parse 7434 ms, sort 0 ms, write 0 ms, index 766 ms: 15 candidates, 102068 repo-hours, 1207 releases; waiting 537 ms; commit 0 ms)
2026-11-08T07:26:06Z [load_day 2024-08-12] 2024-08-12 hour 19: 207663 events in 0 files, snapshot none (task 10043 ms: download 7609 ms overlapping gunzip 1590 ms, parse 7199 ms, sort 0 ms, write 0 ms, index 683 ms: 16 candidates, 83786 repo-hours, 986 releases; waiting 298 ms; commit 0 ms)
2026-11-08T07:26:15Z [load_day 2024-08-12] 2024-08-12 hour 20: 204432 events in 0 files, snapshot none (task 9055 ms: download 6281 ms overlapping gunzip 1576 ms, parse 6166 ms, sort 0 ms, write 0 ms, index 602 ms: 20 candidates, 84363 repo-hours, 989 releases; waiting 492 ms; commit 0 ms)
2026-11-08T07:26:15Z [load_day 2024-08-12] 2024-08-12 hour 21: 202633 events in 0 files, snapshot none (task 8957 ms: download 6434 ms overlapping gunzip 1464 ms, parse 5927 ms, sort 0 ms, write 0 ms, index 707 ms: 33 candidates, 91251 repo-hours, 1051 releases; waiting 518 ms; commit 0 ms)
2026-11-08T07:26:23Z [load_day 2024-08-12] 2024-08-12 hour 22: 172353 events in 0 files, snapshot none (task 8237 ms: download 5655 ms overlapping gunzip 1431 ms, parse 5438 ms, sort 0 ms, write 0 ms, index 519 ms: 32 candidates, 66526 repo-hours, 1038 releases; waiting 516 ms; commit 0 ms)
2026-11-08T07:26:24Z [load_day 2024-08-12] 2024-08-12 hour 23: 176498 events in 0 files, snapshot none (task 8313 ms: download 5659 ms overlapping gunzip 1380 ms, parse 5552 ms, sort 0 ms, write 0 ms, index 571 ms: 31 candidates, 75673 repo-hours, 994 releases; waiting 482 ms; commit 0 ms)
2026-11-08T07:26:33Z [load_day 2024-08-12] 2024-08-12: repo_hour merged from 24 files to 1 (2109622 rows, 8773 ms)
2026-11-08T07:26:35Z [load_day 2024-08-12] 2024-08-12: index committed in 11063 ms (24 + 1 + 24 files)
2026-11-08T07:26:35Z [load_day 2024-08-12] 2024-08-12: 4921064 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:26:35Z [load_day 2024-08-12] attempt 1 succeeded