orcaLog in

Runs · run 2903

load_day 2024-08-29, attempt 1 succeeded

Host
73ccef5e07c2:170819
Started
2026-11-08T07:39:25Z
Ended
2026-11-08T07:41:15Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
820 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
171.9 s, up to 3.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2903/load_day/2024-08-29/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:39:25Z [load_day 2024-08-29] attempt 1 started
2026-11-08T07:39:26Z [load_day 2024-08-29] 2024-08-29: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:39:32Z [load_day 2024-08-29] 2024-08-29 hour 0: 183038 events in 0 files, snapshot none (task 5352 ms: download 2767 ms overlapping gunzip 857 ms, parse 3417 ms, sort 0 ms, write 0 ms, index 690 ms: 13 candidates, 93145 repo-hours, 1114 releases; waiting 171 ms; commit 0 ms)
2026-11-08T07:39:33Z [load_day 2024-08-29] 2024-08-29 hour 1: 190572 events in 0 files, snapshot none (task 6707 ms: download 3661 ms overlapping gunzip 890 ms, parse 3964 ms, sort 0 ms, write 0 ms, index 1120 ms: 8 candidates, 104167 repo-hours, 853 releases; waiting 508 ms; commit 0 ms)
2026-11-08T07:39:39Z [load_day 2024-08-29] 2024-08-29 hour 2: 169443 events in 0 files, snapshot none (task 5968 ms: download 3087 ms overlapping gunzip 879 ms, parse 3743 ms, sort 0 ms, write 0 ms, index 565 ms: 4 candidates, 74072 repo-hours, 856 releases; waiting 508 ms; commit 0 ms)
2026-11-08T07:39:40Z [load_day 2024-08-29] 2024-08-29 hour 3: 180129 events in 0 files, snapshot none (task 6172 ms: download 3362 ms overlapping gunzip 893 ms, parse 3680 ms, sort 0 ms, write 0 ms, index 576 ms: 3 candidates, 74609 repo-hours, 4911 releases; waiting 550 ms; commit 0 ms)
2026-11-08T07:39:45Z [load_day 2024-08-29] 2024-08-29 hour 4: 154874 events in 0 files, snapshot none (task 5540 ms: download 2802 ms overlapping gunzip 777 ms, parse 3034 ms, sort 0 ms, write 0 ms, index 910 ms: 6 candidates, 60595 repo-hours, 673 releases; waiting 538 ms; commit 0 ms)
2026-11-08T07:39:47Z [load_day 2024-08-29] 2024-08-29 hour 5: 157769 events in 0 files, snapshot none (task 5853 ms: download 3457 ms overlapping gunzip 904 ms, parse 3568 ms, sort 0 ms, write 0 ms, index 595 ms: 7 candidates, 63192 repo-hours, 722 releases; waiting 453 ms; commit 0 ms)
2026-11-08T07:39:52Z [load_day 2024-08-29] 2024-08-29 hour 6: 202339 events in 0 files, snapshot none (task 6923 ms: download 3968 ms overlapping gunzip 949 ms, parse 4119 ms, sort 0 ms, write 0 ms, index 901 ms: 1 candidates, 90845 repo-hours, 972 releases; waiting 625 ms; commit 0 ms)
2026-11-08T07:39:55Z [load_day 2024-08-29] 2024-08-29 hour 7: 210564 events in 0 files, snapshot none (task 8070 ms: download 4756 ms overlapping gunzip 1269 ms, parse 5397 ms, sort 0 ms, write 0 ms, index 844 ms: 13 candidates, 83123 repo-hours, 969 releases; waiting 223 ms; commit 0 ms)
2026-11-08T07:40:01Z [load_day 2024-08-29] 2024-08-29 hour 8: 217703 events in 0 files, snapshot none (task 8832 ms: download 6220 ms overlapping gunzip 1334 ms, parse 6044 ms, sort 0 ms, write 0 ms, index 680 ms: 11 candidates, 90038 repo-hours, 1240 releases; waiting 465 ms; commit 0 ms)
2026-11-08T07:40:03Z [load_day 2024-08-29] 2024-08-29 hour 9: 226814 events in 0 files, snapshot none (task 7680 ms: download 5139 ms overlapping gunzip 1194 ms, parse 5039 ms, sort 0 ms, write 0 ms, index 665 ms: 5 candidates, 96656 repo-hours, 1368 releases; waiting 493 ms; commit 0 ms)
2026-11-08T07:40:13Z [load_day 2024-08-29] 2024-08-29 hour 10: 212878 events in 0 files, snapshot none (task 9092 ms: download 6098 ms overlapping gunzip 1428 ms, parse 6138 ms, sort 0 ms, write 0 ms, index 647 ms: 6 candidates, 87300 repo-hours, 1284 releases; waiting 538 ms; commit 0 ms)
2026-11-08T07:40:13Z [load_day 2024-08-29] 2024-08-29 hour 11: 210034 events in 0 files, snapshot none (task 8931 ms: download 6192 ms overlapping gunzip 1387 ms, parse 6100 ms, sort 0 ms, write 0 ms, index 631 ms: 7 candidates, 85853 repo-hours, 1153 releases; waiting 499 ms; commit 0 ms)
2026-11-08T07:40:23Z [load_day 2024-08-29] 2024-08-29 hour 12: 264876 events in 0 files, snapshot none (task 9823 ms: download 6478 ms overlapping gunzip 1398 ms, parse 6330 ms, sort 0 ms, write 0 ms, index 1267 ms: 8 candidates, 132176 repo-hours, 1330 releases; waiting 533 ms; commit 0 ms)
2026-11-08T07:40:23Z [load_day 2024-08-29] 2024-08-29 hour 13: 241355 events in 0 files, snapshot none (task 9369 ms: download 6398 ms overlapping gunzip 1396 ms, parse 6243 ms, sort 0 ms, write 0 ms, index 864 ms: 7 candidates, 112719 repo-hours, 1284 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:40:33Z [load_day 2024-08-29] 2024-08-29 hour 14: 241142 events in 0 files, snapshot none (task 9740 ms: download 7269 ms overlapping gunzip 1570 ms, parse 6658 ms, sort 0 ms, write 0 ms, index 723 ms: 9 candidates, 101903 repo-hours, 1236 releases; waiting 541 ms; commit 0 ms)
2026-11-08T07:40:33Z [load_day 2024-08-29] 2024-08-29 hour 15: 243286 events in 0 files, snapshot none (task 9561 ms: download 6893 ms overlapping gunzip 1530 ms, parse 6409 ms, sort 0 ms, write 0 ms, index 848 ms: 14 candidates, 105584 repo-hours, 1315 releases; waiting 509 ms; commit 0 ms)
2026-11-08T07:40:43Z [load_day 2024-08-29] 2024-08-29 hour 16: 226082 events in 0 files, snapshot none (task 8838 ms: download 6247 ms overlapping gunzip 1372 ms, parse 5904 ms, sort 0 ms, write 0 ms, index 655 ms: 6 candidates, 92471 repo-hours, 1096 releases; waiting 515 ms; commit 0 ms)
2026-11-08T07:40:43Z [load_day 2024-08-29] 2024-08-29 hour 17: 212248 events in 0 files, snapshot none (task 8180 ms: download 5650 ms overlapping gunzip 1239 ms, parse 5547 ms, sort 0 ms, write 0 ms, index 597 ms: 11 candidates, 86801 repo-hours, 1117 releases; waiting 507 ms; commit 0 ms)
2026-11-08T07:40:51Z [load_day 2024-08-29] 2024-08-29 hour 18: 222591 events in 0 files, snapshot none (task 8348 ms: download 5833 ms overlapping gunzip 1208 ms, parse 5510 ms, sort 0 ms, write 0 ms, index 667 ms: 5 candidates, 99712 repo-hours, 1311 releases; waiting 680 ms; commit 0 ms)
2026-11-08T07:40:51Z [load_day 2024-08-29] 2024-08-29 hour 19: 198840 events in 0 files, snapshot none (task 7431 ms: download 4934 ms overlapping gunzip 1182 ms, parse 4922 ms, sort 0 ms, write 0 ms, index 550 ms: 4 candidates, 76844 repo-hours, 1040 releases; waiting 505 ms; commit 0 ms)
2026-11-08T07:40:58Z [load_day 2024-08-29] 2024-08-29 hour 20: 191789 events in 0 files, snapshot none (task 6235 ms: download 3777 ms overlapping gunzip 933 ms, parse 3929 ms, sort 0 ms, write 0 ms, index 561 ms: 9 candidates, 74896 repo-hours, 1067 releases; waiting 523 ms; commit 0 ms)
2026-11-08T07:40:58Z [load_day 2024-08-29] 2024-08-29 hour 21: 184214 events in 0 files, snapshot none (task 5552 ms: download 3318 ms overlapping gunzip 852 ms, parse 3430 ms, sort 0 ms, write 0 ms, index 554 ms: 10 candidates, 72937 repo-hours, 1282 releases; waiting 492 ms; commit 0 ms)
2026-11-08T07:41:04Z [load_day 2024-08-29] 2024-08-29 hour 22: 162975 events in 0 files, snapshot none (task 5062 ms: download 2816 ms overlapping gunzip 753 ms, parse 3070 ms, sort 0 ms, write 0 ms, index 460 ms: 7 candidates, 59965 repo-hours, 1118 releases; waiting 519 ms; commit 0 ms)
2026-11-08T07:41:04Z [load_day 2024-08-29] 2024-08-29 hour 23: 157225 events in 0 files, snapshot none (task 4834 ms: download 2721 ms overlapping gunzip 736 ms, parse 2975 ms, sort 0 ms, write 0 ms, index 414 ms: 10 candidates, 58482 repo-hours, 837 releases; waiting 452 ms; commit 0 ms)
2026-11-08T07:41:13Z [load_day 2024-08-29] 2024-08-29: repo_hour merged from 24 files to 1 (2078085 rows, 8913 ms)
2026-11-08T07:41:15Z [load_day 2024-08-29] 2024-08-29: index committed in 11490 ms (24 + 1 + 24 files)
2026-11-08T07:41:15Z [load_day 2024-08-29] 2024-08-29: 4862780 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:41:15Z [load_day 2024-08-29] attempt 1 succeeded