orcaLog in

Runs · run 1948

load_day 2024-01-08, attempt 1 succeeded

Host
73ccef5e07c2:16979
Started
2026-11-08T04:03:21Z
Ended
2026-11-08T04:05:19Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
699 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
182.2 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1948/load_day/2024-01-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:03:21Z [load_day 2024-01-08] attempt 1 started
2026-11-08T04:03:22Z [load_day 2024-01-08] 2024-01-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:03:29Z [load_day 2024-01-08] 2024-01-08 hour 0: 180241 events in 0 files, snapshot none (task 6172 ms: download 3343 ms overlapping gunzip 913 ms, parse 3854 ms, sort 0 ms, write 0 ms, index 655 ms: 6 candidates, 75400 repo-hours, 933 releases; waiting 520 ms; commit 0 ms)
2026-11-08T04:03:29Z [load_day 2024-01-08] 2024-01-08 hour 1: 194785 events in 0 files, snapshot none (task 6163 ms: download 3527 ms overlapping gunzip 961 ms, parse 3995 ms, sort 0 ms, write 0 ms, index 616 ms: 6 candidates, 87422 repo-hours, 843 releases; waiting 324 ms; commit 0 ms)
2026-11-08T04:03:36Z [load_day 2024-01-08] 2024-01-08 hour 2: 171239 events in 0 files, snapshot none (task 6656 ms: download 4067 ms overlapping gunzip 1007 ms, parse 4029 ms, sort 0 ms, write 0 ms, index 444 ms: 6 candidates, 57870 repo-hours, 669 releases; waiting 767 ms; commit 0 ms)
2026-11-08T04:03:36Z [load_day 2024-01-08] 2024-01-08 hour 3: 173991 events in 0 files, snapshot none (task 6577 ms: download 3989 ms overlapping gunzip 1062 ms, parse 4197 ms, sort 0 ms, write 0 ms, index 431 ms: 6 candidates, 57466 repo-hours, 848 releases; waiting 516 ms; commit 0 ms)
2026-11-08T04:03:43Z [load_day 2024-01-08] 2024-01-08 hour 4: 178057 events in 0 files, snapshot none (task 6573 ms: download 4106 ms overlapping gunzip 1025 ms, parse 4216 ms, sort 0 ms, write 0 ms, index 526 ms: 3 candidates, 55582 repo-hours, 565 releases; waiting 537 ms; commit 0 ms)
2026-11-08T04:03:43Z [load_day 2024-01-08] 2024-01-08 hour 5: 188086 events in 0 files, snapshot none (task 6825 ms: download 4567 ms overlapping gunzip 1107 ms, parse 4536 ms, sort 0 ms, write 0 ms, index 429 ms: 3 candidates, 59634 repo-hours, 623 releases; waiting 539 ms; commit 0 ms)
2026-11-08T04:03:50Z [load_day 2024-01-08] 2024-01-08 hour 6: 207096 events in 0 files, snapshot none (task 6642 ms: download 4227 ms overlapping gunzip 1046 ms, parse 4177 ms, sort 0 ms, write 0 ms, index 551 ms: 6 candidates, 72489 repo-hours, 835 releases; waiting 514 ms; commit 0 ms)
2026-11-08T04:03:51Z [load_day 2024-01-08] 2024-01-08 hour 7: 211859 events in 0 files, snapshot none (task 7403 ms: download 4836 ms overlapping gunzip 1143 ms, parse 4809 ms, sort 0 ms, write 0 ms, index 653 ms: 9 candidates, 70834 repo-hours, 708 releases; waiting 477 ms; commit 0 ms)
2026-11-08T04:03:57Z [load_day 2024-01-08] 2024-01-08 hour 8: 195626 events in 0 files, snapshot none (task 6618 ms: download 4178 ms overlapping gunzip 1052 ms, parse 4257 ms, sort 0 ms, write 0 ms, index 580 ms: 8 candidates, 81780 repo-hours, 970 releases; waiting 493 ms; commit 0 ms)
2026-11-08T04:03:59Z [load_day 2024-01-08] 2024-01-08 hour 9: 208333 events in 0 files, snapshot none (task 7195 ms: download 4773 ms overlapping gunzip 1151 ms, parse 4582 ms, sort 0 ms, write 0 ms, index 655 ms: 9 candidates, 85454 repo-hours, 1115 releases; waiting 513 ms; commit 0 ms)
2026-11-08T04:04:05Z [load_day 2024-01-08] 2024-01-08 hour 10: 209445 events in 0 files, snapshot none (task 7722 ms: download 5047 ms overlapping gunzip 1154 ms, parse 4637 ms, sort 0 ms, write 0 ms, index 731 ms: 6 candidates, 86137 repo-hours, 953 releases; waiting 760 ms; commit 0 ms)
2026-11-08T04:04:07Z [load_day 2024-01-08] 2024-01-08 hour 11: 206416 events in 0 files, snapshot none (task 7391 ms: download 4433 ms overlapping gunzip 1159 ms, parse 4590 ms, sort 0 ms, write 0 ms, index 897 ms: 6 candidates, 81187 repo-hours, 958 releases; waiting 468 ms; commit 0 ms)
2026-11-08T04:04:16Z [load_day 2024-01-08] 2024-01-08 hour 12: 253646 events in 0 files, snapshot none (task 10057 ms: download 5963 ms overlapping gunzip 1484 ms, parse 6538 ms, sort 0 ms, write 0 ms, index 1240 ms: 8 candidates, 114213 repo-hours, 1029 releases; waiting 454 ms; commit 0 ms)
2026-11-08T04:04:17Z [load_day 2024-01-08] 2024-01-08 hour 13: 237640 events in 0 files, snapshot none (task 9660 ms: download 6599 ms overlapping gunzip 1499 ms, parse 6147 ms, sort 0 ms, write 0 ms, index 829 ms: 11 candidates, 110076 repo-hours, 1218 releases; waiting 849 ms; commit 0 ms)
2026-11-08T04:04:27Z [load_day 2024-01-08] 2024-01-08 hour 14: 231686 events in 0 files, snapshot none (task 10204 ms: download 7612 ms overlapping gunzip 1717 ms, parse 6993 ms, sort 0 ms, write 0 ms, index 745 ms: 8 candidates, 97224 repo-hours, 1218 releases; waiting 514 ms; commit 0 ms)
2026-11-08T04:04:27Z [load_day 2024-01-08] 2024-01-08 hour 15: 232248 events in 0 files, snapshot none (task 9534 ms: download 7029 ms overlapping gunzip 1528 ms, parse 6481 ms, sort 0 ms, write 0 ms, index 726 ms: 12 candidates, 98819 repo-hours, 1277 releases; waiting 503 ms; commit 0 ms)
2026-11-08T04:04:37Z [load_day 2024-01-08] 2024-01-08 hour 16: 232223 events in 0 files, snapshot none (task 9901 ms: download 6930 ms overlapping gunzip 1613 ms, parse 6484 ms, sort 0 ms, write 0 ms, index 879 ms: 12 candidates, 99150 repo-hours, 1177 releases; waiting 564 ms; commit 0 ms)
2026-11-08T04:04:37Z [load_day 2024-01-08] 2024-01-08 hour 17: 218407 events in 0 files, snapshot none (task 9384 ms: download 6415 ms overlapping gunzip 1491 ms, parse 6121 ms, sort 0 ms, write 0 ms, index 870 ms: 7 candidates, 88044 repo-hours, 1050 releases; waiting 515 ms; commit 0 ms)
2026-11-08T04:04:46Z [load_day 2024-01-08] 2024-01-08 hour 18: 213607 events in 0 files, snapshot none (task 8438 ms: download 5639 ms overlapping gunzip 1451 ms, parse 5513 ms, sort 0 ms, write 0 ms, index 719 ms: 8 candidates, 91408 repo-hours, 1119 releases; waiting 488 ms; commit 0 ms)
2026-11-08T04:04:46Z [load_day 2024-01-08] 2024-01-08 hour 19: 201823 events in 0 files, snapshot none (task 8083 ms: download 5362 ms overlapping gunzip 1283 ms, parse 5258 ms, sort 0 ms, write 0 ms, index 708 ms: 9 candidates, 79482 repo-hours, 929 releases; waiting 539 ms; commit 0 ms)
2026-11-08T04:04:54Z [load_day 2024-01-08] 2024-01-08 hour 20: 196307 events in 0 files, snapshot none (task 7685 ms: download 5168 ms overlapping gunzip 1223 ms, parse 4964 ms, sort 0 ms, write 0 ms, index 727 ms: 10 candidates, 78347 repo-hours, 960 releases; waiting 480 ms; commit 0 ms)
2026-11-08T04:04:54Z [load_day 2024-01-08] 2024-01-08 hour 21: 188871 events in 0 files, snapshot none (task 7174 ms: download 4681 ms overlapping gunzip 1159 ms, parse 4632 ms, sort 0 ms, write 0 ms, index 577 ms: 6 candidates, 72529 repo-hours, 1136 releases; waiting 520 ms; commit 0 ms)
2026-11-08T04:05:02Z [load_day 2024-01-08] 2024-01-08 hour 22: 173229 events in 0 files, snapshot none (task 7065 ms: download 4784 ms overlapping gunzip 1153 ms, parse 4664 ms, sort 0 ms, write 0 ms, index 477 ms: 5 candidates, 65395 repo-hours, 1054 releases; waiting 468 ms; commit 0 ms)
2026-11-08T04:05:02Z [load_day 2024-01-08] 2024-01-08 hour 23: 163701 events in 0 files, snapshot none (task 6286 ms: download 4142 ms overlapping gunzip 1049 ms, parse 4266 ms, sort 0 ms, write 0 ms, index 447 ms: 10 candidates, 59482 repo-hours, 950 releases; waiting 248 ms; commit 0 ms)
2026-11-08T04:05:10Z [load_day 2024-01-08] 2024-01-08: repo_hour merged from 24 files to 1 (1925424 rows, 8405 ms)
2026-11-08T04:05:19Z [load_day 2024-01-08] 2024-01-08: index committed in 17500 ms (24 + 1 + 24 files)
2026-11-08T04:05:19Z [load_day 2024-01-08] 2024-01-08: 4868562 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:05:19Z [load_day 2024-01-08] attempt 1 succeeded