orcaLog in

Runs · run 2695

load_day 2024-07-09, attempt 1 succeeded

Host
73ccef5e07c2:147301
Started
2026-11-08T06:54:27Z
Ended
2026-11-08T06:56:29Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
903 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
192.3 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2695/load_day/2024-07-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:54:27Z [load_day 2024-07-09] attempt 1 started
2026-11-08T06:54:28Z [load_day 2024-07-09] 2024-07-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:54:36Z [load_day 2024-07-09] 2024-07-09 hour 0: 183109 events in 0 files, snapshot none (task 7288 ms: download 3956 ms overlapping gunzip 1071 ms, parse 4438 ms, sort 0 ms, write 0 ms, index 913 ms: 12 candidates, 91917 repo-hours, 1063 releases; waiting 500 ms; commit 0 ms)
2026-11-08T06:54:36Z [load_day 2024-07-09] 2024-07-09 hour 1: 192965 events in 0 files, snapshot none (task 7758 ms: download 4512 ms overlapping gunzip 1164 ms, parse 4990 ms, sort 0 ms, write 0 ms, index 861 ms: 11 candidates, 106415 repo-hours, 869 releases; waiting 330 ms; commit 0 ms)
2026-11-08T06:54:42Z [load_day 2024-07-09] 2024-07-09 hour 2: 161390 events in 0 files, snapshot none (task 5926 ms: download 4074 ms overlapping gunzip 921 ms, parse 3623 ms, sort 0 ms, write 0 ms, index 554 ms: 9 candidates, 69696 repo-hours, 818 releases; waiting 505 ms; commit 0 ms)
2026-11-08T06:54:43Z [load_day 2024-07-09] 2024-07-09 hour 3: 183626 events in 0 files, snapshot none (task 6239 ms: download 3597 ms overlapping gunzip 895 ms, parse 3759 ms, sort 0 ms, write 0 ms, index 769 ms: 8 candidates, 78366 repo-hours, 5487 releases; waiting 514 ms; commit 0 ms)
2026-11-08T06:54:49Z [load_day 2024-07-09] 2024-07-09 hour 4: 163036 events in 0 files, snapshot none (task 6401 ms: download 3617 ms overlapping gunzip 949 ms, parse 4026 ms, sort 0 ms, write 0 ms, index 583 ms: 11 candidates, 62850 repo-hours, 736 releases; waiting 247 ms; commit 0 ms)
2026-11-08T06:54:51Z [load_day 2024-07-09] 2024-07-09 hour 5: 185201 events in 0 files, snapshot none (task 7414 ms: download 4986 ms overlapping gunzip 1183 ms, parse 4840 ms, sort 0 ms, write 0 ms, index 531 ms: 6 candidates, 74783 repo-hours, 759 releases; waiting 536 ms; commit 0 ms)
2026-11-08T06:54:58Z [load_day 2024-07-09] 2024-07-09 hour 6: 219735 events in 0 files, snapshot none (task 8364 ms: download 5144 ms overlapping gunzip 1262 ms, parse 5348 ms, sort 0 ms, write 0 ms, index 959 ms: 9 candidates, 108324 repo-hours, 901 releases; waiting 493 ms; commit 0 ms)
2026-11-08T06:55:01Z [load_day 2024-07-09] 2024-07-09 hour 7: 214344 events in 0 files, snapshot none (task 9514 ms: download 6780 ms overlapping gunzip 1429 ms, parse 6607 ms, sort 0 ms, write 0 ms, index 691 ms: 13 candidates, 88426 repo-hours, 1026 releases; waiting 498 ms; commit 0 ms)
2026-11-08T06:55:08Z [load_day 2024-07-09] 2024-07-09 hour 8: 229818 events in 0 files, snapshot none (task 9465 ms: download 5567 ms overlapping gunzip 1511 ms, parse 6340 ms, sort 0 ms, write 0 ms, index 794 ms: 13 candidates, 97207 repo-hours, 1178 releases; waiting 494 ms; commit 0 ms)
2026-11-08T06:55:11Z [load_day 2024-07-09] 2024-07-09 hour 9: 237801 events in 0 files, snapshot none (task 9206 ms: download 6310 ms overlapping gunzip 1448 ms, parse 6021 ms, sort 0 ms, write 0 ms, index 836 ms: 7 candidates, 101768 repo-hours, 1471 releases; waiting 492 ms; commit 0 ms)
2026-11-08T06:55:15Z [load_day 2024-07-09] 2024-07-09 hour 10: 229721 events in 0 files, snapshot none (task 6900 ms: download 4298 ms overlapping gunzip 1044 ms, parse 4317 ms, sort 0 ms, write 0 ms, index 748 ms: 10 candidates, 104492 repo-hours, 1189 releases; waiting 503 ms; commit 0 ms)
2026-11-08T06:55:18Z [load_day 2024-07-09] 2024-07-09 hour 11: 228611 events in 0 files, snapshot none (task 7237 ms: download 4646 ms overlapping gunzip 1128 ms, parse 4578 ms, sort 0 ms, write 0 ms, index 666 ms: 13 candidates, 100337 repo-hours, 1202 releases; waiting 540 ms; commit 0 ms)
2026-11-08T06:55:24Z [load_day 2024-07-09] 2024-07-09 hour 12: 275334 events in 0 files, snapshot none (task 7968 ms: download 4630 ms overlapping gunzip 1117 ms, parse 4942 ms, sort 0 ms, write 0 ms, index 1222 ms: 11 candidates, 137781 repo-hours, 1419 releases; waiting 390 ms; commit 0 ms)
2026-11-08T06:55:30Z [load_day 2024-07-09] 2024-07-09 hour 13: 255038 events in 0 files, snapshot none (task 10960 ms: download 5898 ms overlapping gunzip 1577 ms, parse 6963 ms, sort 0 ms, write 0 ms, index 1551 ms: 17 candidates, 119219 repo-hours, 1395 releases; waiting 588 ms; commit 0 ms)
2026-11-08T06:55:35Z [load_day 2024-07-09] 2024-07-09 hour 14: 247594 events in 0 files, snapshot none (task 10554 ms: download 7939 ms overlapping gunzip 1710 ms, parse 7245 ms, sort 0 ms, write 0 ms, index 777 ms: 12 candidates, 103757 repo-hours, 1437 releases; waiting 507 ms; commit 0 ms)
2026-11-08T06:55:41Z [load_day 2024-07-09] 2024-07-09 hour 15: 250617 events in 0 files, snapshot none (task 11189 ms: download 8321 ms overlapping gunzip 1763 ms, parse 7322 ms, sort 0 ms, write 0 ms, index 773 ms: 10 candidates, 110458 repo-hours, 1310 releases; waiting 1058 ms; commit 0 ms)
2026-11-08T06:55:44Z [load_day 2024-07-09] 2024-07-09 hour 16: 229196 events in 0 files, snapshot none (task 8543 ms: download 5882 ms overlapping gunzip 1331 ms, parse 5644 ms, sort 0 ms, write 0 ms, index 822 ms: 15 candidates, 95887 repo-hours, 1118 releases; waiting 493 ms; commit 0 ms)
2026-11-08T06:55:51Z [load_day 2024-07-09] 2024-07-09 hour 17: 222066 events in 0 files, snapshot none (task 8902 ms: download 6364 ms overlapping gunzip 1463 ms, parse 6031 ms, sort 0 ms, write 0 ms, index 678 ms: 15 candidates, 89618 repo-hours, 1150 releases; waiting 503 ms; commit 0 ms)
2026-11-08T06:55:53Z [load_day 2024-07-09] 2024-07-09 hour 18: 234548 events in 0 files, snapshot none (task 9065 ms: download 6089 ms overlapping gunzip 1393 ms, parse 5758 ms, sort 0 ms, write 0 ms, index 1111 ms: 15 candidates, 105109 repo-hours, 1263 releases; waiting 519 ms; commit 0 ms)
2026-11-08T06:56:00Z [load_day 2024-07-09] 2024-07-09 hour 19: 206643 events in 0 files, snapshot none (task 9132 ms: download 6678 ms overlapping gunzip 1551 ms, parse 6220 ms, sort 0 ms, write 0 ms, index 575 ms: 13 candidates, 79822 repo-hours, 1143 releases; waiting 525 ms; commit 0 ms)
2026-11-08T06:56:02Z [load_day 2024-07-09] 2024-07-09 hour 20: 194365 events in 0 files, snapshot none (task 7965 ms: download 5498 ms overlapping gunzip 1256 ms, parse 5277 ms, sort 0 ms, write 0 ms, index 565 ms: 13 candidates, 76396 repo-hours, 993 releases; waiting 480 ms; commit 0 ms)
2026-11-08T06:56:09Z [load_day 2024-07-09] 2024-07-09 hour 21: 198245 events in 0 files, snapshot none (task 8488 ms: download 5771 ms overlapping gunzip 1385 ms, parse 5772 ms, sort 0 ms, write 0 ms, index 675 ms: 15 candidates, 80183 repo-hours, 1114 releases; waiting 383 ms; commit 0 ms)
2026-11-08T06:56:10Z [load_day 2024-07-09] 2024-07-09 hour 22: 173854 events in 0 files, snapshot none (task 7497 ms: download 4923 ms overlapping gunzip 1239 ms, parse 5251 ms, sort 0 ms, write 0 ms, index 541 ms: 13 candidates, 63282 repo-hours, 1040 releases; waiting 183 ms; commit 0 ms)
2026-11-08T06:56:16Z [load_day 2024-07-09] 2024-07-09 hour 23: 156309 events in 0 files, snapshot none (task 6123 ms: download 3225 ms overlapping gunzip 874 ms, parse 3772 ms, sort 0 ms, write 0 ms, index 680 ms: 11 candidates, 58547 repo-hours, 807 releases; waiting 502 ms; commit 0 ms)
2026-11-08T06:56:27Z [load_day 2024-07-09] 2024-07-09: repo_hour merged from 24 files to 1 (2204640 rows, 10750 ms)
2026-11-08T06:56:29Z [load_day 2024-07-09] 2024-07-09: index committed in 13249 ms (24 + 1 + 24 files)
2026-11-08T06:56:29Z [load_day 2024-07-09] 2024-07-09: 5073166 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:56:29Z [load_day 2024-07-09] attempt 1 succeeded