orcaLog in

Runs · run 2762

load_day 2024-07-26, attempt 1 succeeded

Host
73ccef5e07c2:154865
Started
2026-11-08T07:09:43Z
Ended
2026-11-08T07:11:29Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
697 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
166.8 s, up to 3.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2762/load_day/2024-07-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:09:43Z [load_day 2024-07-26] attempt 1 started
2026-11-08T07:09:44Z [load_day 2024-07-26] 2024-07-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:09:52Z [load_day 2024-07-26] 2024-07-26 hour 0: 177134 events in 0 files, snapshot none (task 8081 ms: download 4132 ms overlapping gunzip 1231 ms, parse 5408 ms, sort 0 ms, write 0 ms, index 1009 ms: 7 candidates, 94444 repo-hours, 1185 releases; waiting 178 ms; commit 0 ms)
2026-11-08T07:09:52Z [load_day 2024-07-26] 2024-07-26 hour 1: 188449 events in 0 files, snapshot none (task 8067 ms: download 4398 ms overlapping gunzip 1142 ms, parse 5121 ms, sort 0 ms, write 0 ms, index 1055 ms: 8 candidates, 106248 repo-hours, 877 releases; waiting 487 ms; commit 0 ms)
2026-11-08T07:09:59Z [load_day 2024-07-26] 2024-07-26 hour 2: 155944 events in 0 files, snapshot none (task 6006 ms: download 3207 ms overlapping gunzip 917 ms, parse 3690 ms, sort 0 ms, write 0 ms, index 599 ms: 6 candidates, 67453 repo-hours, 769 releases; waiting 498 ms; commit 0 ms)
2026-11-08T07:09:59Z [load_day 2024-07-26] 2024-07-26 hour 3: 175809 events in 0 files, snapshot none (task 6358 ms: download 3563 ms overlapping gunzip 920 ms, parse 3974 ms, sort 0 ms, write 0 ms, index 600 ms: 5 candidates, 74995 repo-hours, 5404 releases; waiting 551 ms; commit 0 ms)
2026-11-08T07:10:06Z [load_day 2024-07-26] 2024-07-26 hour 4: 153639 events in 0 files, snapshot none (task 6442 ms: download 3537 ms overlapping gunzip 1016 ms, parse 4123 ms, sort 0 ms, write 0 ms, index 470 ms: 4 candidates, 60043 repo-hours, 648 releases; waiting 481 ms; commit 0 ms)
2026-11-08T07:10:06Z [load_day 2024-07-26] 2024-07-26 hour 5: 164038 events in 0 files, snapshot none (task 6877 ms: download 4271 ms overlapping gunzip 1092 ms, parse 4454 ms, sort 0 ms, write 0 ms, index 570 ms: 6 candidates, 66484 repo-hours, 930 releases; waiting 506 ms; commit 0 ms)
2026-11-08T07:10:14Z [load_day 2024-07-26] 2024-07-26 hour 6: 198004 events in 0 files, snapshot none (task 7643 ms: download 4645 ms overlapping gunzip 1176 ms, parse 4869 ms, sort 0 ms, write 0 ms, index 743 ms: 3 candidates, 92024 repo-hours, 994 releases; waiting 518 ms; commit 0 ms)
2026-11-08T07:10:15Z [load_day 2024-07-26] 2024-07-26 hour 7: 197700 events in 0 files, snapshot none (task 8048 ms: download 5487 ms overlapping gunzip 1353 ms, parse 5420 ms, sort 0 ms, write 0 ms, index 642 ms: 10 candidates, 81485 repo-hours, 1083 releases; waiting 388 ms; commit 0 ms)
2026-11-08T07:10:23Z [load_day 2024-07-26] 2024-07-26 hour 8: 209464 events in 0 files, snapshot none (task 8370 ms: download 5548 ms overlapping gunzip 1281 ms, parse 5582 ms, sort 0 ms, write 0 ms, index 660 ms: 10 candidates, 91125 repo-hours, 1130 releases; waiting 516 ms; commit 0 ms)
2026-11-08T07:10:24Z [load_day 2024-07-26] 2024-07-26 hour 9: 213042 events in 0 files, snapshot none (task 8477 ms: download 5851 ms overlapping gunzip 1387 ms, parse 5591 ms, sort 0 ms, write 0 ms, index 710 ms: 7 candidates, 97548 repo-hours, 1320 releases; waiting 522 ms; commit 0 ms)
2026-11-08T07:10:31Z [load_day 2024-07-26] 2024-07-26 hour 10: 199636 events in 0 files, snapshot none (task 7620 ms: download 5209 ms overlapping gunzip 1245 ms, parse 5013 ms, sort 0 ms, write 0 ms, index 609 ms: 9 candidates, 84435 repo-hours, 1129 releases; waiting 521 ms; commit 0 ms)
2026-11-08T07:10:32Z [load_day 2024-07-26] 2024-07-26 hour 11: 201586 events in 0 files, snapshot none (task 7083 ms: download 4708 ms overlapping gunzip 1094 ms, parse 4717 ms, sort 0 ms, write 0 ms, index 587 ms: 7 candidates, 78611 repo-hours, 1225 releases; waiting 458 ms; commit 0 ms)
2026-11-08T07:10:39Z [load_day 2024-07-26] 2024-07-26 hour 12: 267020 events in 0 files, snapshot none (task 7867 ms: download 4828 ms overlapping gunzip 1153 ms, parse 4898 ms, sort 0 ms, write 0 ms, index 855 ms: 5 candidates, 127852 repo-hours, 1330 releases; waiting 523 ms; commit 0 ms)
2026-11-08T07:10:40Z [load_day 2024-07-26] 2024-07-26 hour 13: 234178 events in 0 files, snapshot none (task 7553 ms: download 4914 ms overlapping gunzip 1121 ms, parse 4904 ms, sort 0 ms, write 0 ms, index 808 ms: 9 candidates, 109230 repo-hours, 1291 releases; waiting 501 ms; commit 0 ms)
2026-11-08T07:10:48Z [load_day 2024-07-26] 2024-07-26 hour 14: 221177 events in 0 files, snapshot none (task 8395 ms: download 4965 ms overlapping gunzip 1324 ms, parse 5496 ms, sort 0 ms, write 0 ms, index 799 ms: 7 candidates, 93193 repo-hours, 1305 releases; waiting 506 ms; commit 0 ms)
2026-11-08T07:10:48Z [load_day 2024-07-26] 2024-07-26 hour 15: 222731 events in 0 files, snapshot none (task 7716 ms: download 4668 ms overlapping gunzip 1120 ms, parse 4784 ms, sort 0 ms, write 0 ms, index 1036 ms: 5 candidates, 97147 repo-hours, 1351 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:10:56Z [load_day 2024-07-26] 2024-07-26 hour 16: 206425 events in 0 files, snapshot none (task 7807 ms: download 5081 ms overlapping gunzip 1154 ms, parse 5071 ms, sort 0 ms, write 0 ms, index 829 ms: 5 candidates, 85431 repo-hours, 1164 releases; waiting 487 ms; commit 0 ms)
2026-11-08T07:10:56Z [load_day 2024-07-26] 2024-07-26 hour 17: 192696 events in 0 files, snapshot none (task 7878 ms: download 5289 ms overlapping gunzip 1279 ms, parse 5177 ms, sort 0 ms, write 0 ms, index 655 ms: 7 candidates, 77309 repo-hours, 1019 releases; waiting 450 ms; commit 0 ms)
2026-11-08T07:11:05Z [load_day 2024-07-26] 2024-07-26 hour 18: 206493 events in 0 files, snapshot none (task 7876 ms: download 5080 ms overlapping gunzip 1167 ms, parse 4980 ms, sort 0 ms, write 0 ms, index 958 ms: 4 candidates, 92768 repo-hours, 1193 releases; waiting 490 ms; commit 0 ms)
2026-11-08T07:11:05Z [load_day 2024-07-26] 2024-07-26 hour 19: 178113 events in 0 files, snapshot none (task 7245 ms: download 4701 ms overlapping gunzip 1140 ms, parse 4703 ms, sort 0 ms, write 0 ms, index 678 ms: 12 candidates, 68461 repo-hours, 972 releases; waiting 484 ms; commit 0 ms)
2026-11-08T07:11:12Z [load_day 2024-07-26] 2024-07-26 hour 20: 173857 events in 0 files, snapshot none (task 6685 ms: download 3984 ms overlapping gunzip 1030 ms, parse 4271 ms, sort 0 ms, write 0 ms, index 522 ms: 8 candidates, 67155 repo-hours, 839 releases; waiting 395 ms; commit 0 ms)
2026-11-08T07:11:12Z [load_day 2024-07-26] 2024-07-26 hour 21: 169508 events in 0 files, snapshot none (task 6602 ms: download 3767 ms overlapping gunzip 1072 ms, parse 4271 ms, sort 0 ms, write 0 ms, index 494 ms: 3 candidates, 66408 repo-hours, 858 releases; waiting 500 ms; commit 0 ms)
2026-11-08T07:11:19Z [load_day 2024-07-26] 2024-07-26 hour 22: 145324 events in 0 files, snapshot none (task 5970 ms: download 3754 ms overlapping gunzip 903 ms, parse 3918 ms, sort 0 ms, write 0 ms, index 424 ms: 1 candidates, 54399 repo-hours, 1026 releases; waiting 501 ms; commit 0 ms)
2026-11-08T07:11:19Z [load_day 2024-07-26] 2024-07-26 hour 23: 133842 events in 0 files, snapshot none (task 5278 ms: download 2781 ms overlapping gunzip 820 ms, parse 3337 ms, sort 0 ms, write 0 ms, index 397 ms: 2 candidates, 50314 repo-hours, 880 releases; waiting 504 ms; commit 0 ms)
2026-11-08T07:11:27Z [load_day 2024-07-26] 2024-07-26: repo_hour merged from 24 files to 1 (1984562 rows, 8305 ms)
2026-11-08T07:11:29Z [load_day 2024-07-26] 2024-07-26: index committed in 10865 ms (24 + 1 + 24 files)
2026-11-08T07:11:29Z [load_day 2024-07-26] 2024-07-26: 4585809 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:11:29Z [load_day 2024-07-26] attempt 1 succeeded