orcaLog in

Runs · run 2754

load_day 2024-07-24, attempt 1 succeeded

Host
73ccef5e07c2:154030
Started
2026-11-08T07:07:45Z
Ended
2026-11-08T07:09:42Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
759 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
180.4 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2754/load_day/2024-07-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:07:45Z [load_day 2024-07-24] attempt 1 started
2026-11-08T07:07:46Z [load_day 2024-07-24] 2024-07-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:07:55Z [load_day 2024-07-24] 2024-07-24 hour 0: 173265 events in 0 files, snapshot none (task 8658 ms: download 4730 ms overlapping gunzip 1333 ms, parse 5647 ms, sort 0 ms, write 0 ms, index 843 ms: 7 candidates, 89147 repo-hours, 1130 releases; waiting 476 ms; commit 0 ms)
2026-11-08T07:07:55Z [load_day 2024-07-24] 2024-07-24 hour 1: 185667 events in 0 files, snapshot none (task 8355 ms: download 3854 ms overlapping gunzip 1133 ms, parse 5181 ms, sort 0 ms, write 0 ms, index 1212 ms: 6 candidates, 105129 repo-hours, 888 releases; waiting 462 ms; commit 0 ms)
2026-11-08T07:08:02Z [load_day 2024-07-24] 2024-07-24 hour 2: 156475 events in 0 files, snapshot none (task 5925 ms: download 3380 ms overlapping gunzip 823 ms, parse 3475 ms, sort 0 ms, write 0 ms, index 655 ms: 6 candidates, 67948 repo-hours, 899 releases; waiting 697 ms; commit 0 ms)
2026-11-08T07:08:02Z [load_day 2024-07-24] 2024-07-24 hour 3: 174168 events in 0 files, snapshot none (task 6079 ms: download 3106 ms overlapping gunzip 821 ms, parse 3672 ms, sort 0 ms, write 0 ms, index 867 ms: 2 candidates, 75648 repo-hours, 5476 releases; waiting 509 ms; commit 0 ms)
2026-11-08T07:08:09Z [load_day 2024-07-24] 2024-07-24 hour 4: 152341 events in 0 files, snapshot none (task 6653 ms: download 3701 ms overlapping gunzip 1001 ms, parse 4083 ms, sort 0 ms, write 0 ms, index 856 ms: 4 candidates, 61200 repo-hours, 623 releases; waiting 504 ms; commit 0 ms)
2026-11-08T07:08:10Z [load_day 2024-07-24] 2024-07-24 hour 5: 171390 events in 0 files, snapshot none (task 7172 ms: download 4501 ms overlapping gunzip 1186 ms, parse 4608 ms, sort 0 ms, write 0 ms, index 800 ms: 5 candidates, 67486 repo-hours, 887 releases; waiting 346 ms; commit 0 ms)
2026-11-08T07:08:19Z [load_day 2024-07-24] 2024-07-24 hour 6: 208310 events in 0 files, snapshot none (task 8287 ms: download 5498 ms overlapping gunzip 1344 ms, parse 5449 ms, sort 0 ms, write 0 ms, index 721 ms: 9 candidates, 95191 repo-hours, 985 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:08:19Z [load_day 2024-07-24] 2024-07-24 hour 7: 211537 events in 0 files, snapshot none (task 8519 ms: download 5962 ms overlapping gunzip 1355 ms, parse 5738 ms, sort 0 ms, write 0 ms, index 631 ms: 5 candidates, 86189 repo-hours, 1098 releases; waiting 536 ms; commit 0 ms)
2026-11-08T07:08:29Z [load_day 2024-07-24] 2024-07-24 hour 8: 223347 events in 0 files, snapshot none (task 9503 ms: download 6676 ms overlapping gunzip 1503 ms, parse 6198 ms, sort 0 ms, write 0 ms, index 915 ms: 16 candidates, 94161 repo-hours, 1149 releases; waiting 529 ms; commit 0 ms)
2026-11-08T07:08:29Z [load_day 2024-07-24] 2024-07-24 hour 9: 225561 events in 0 files, snapshot none (task 9198 ms: download 6608 ms overlapping gunzip 1410 ms, parse 6262 ms, sort 0 ms, write 0 ms, index 797 ms: 4 candidates, 98380 repo-hours, 1423 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:08:37Z [load_day 2024-07-24] 2024-07-24 hour 10: 210080 events in 0 files, snapshot none (task 7664 ms: download 5215 ms overlapping gunzip 1200 ms, parse 5049 ms, sort 0 ms, write 0 ms, index 637 ms: 6 candidates, 88323 repo-hours, 1158 releases; waiting 501 ms; commit 0 ms)
2026-11-08T07:08:37Z [load_day 2024-07-24] 2024-07-24 hour 11: 208509 events in 0 files, snapshot none (task 7556 ms: download 4999 ms overlapping gunzip 1119 ms, parse 4700 ms, sort 0 ms, write 0 ms, index 645 ms: 4 candidates, 85482 repo-hours, 1083 releases; waiting 731 ms; commit 0 ms)
2026-11-08T07:08:45Z [load_day 2024-07-24] 2024-07-24 hour 12: 256242 events in 0 files, snapshot none (task 7612 ms: download 4713 ms overlapping gunzip 1078 ms, parse 4808 ms, sort 0 ms, write 0 ms, index 883 ms: 8 candidates, 128085 repo-hours, 1212 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:08:45Z [load_day 2024-07-24] 2024-07-24 hour 13: 238084 events in 0 files, snapshot none (task 7791 ms: download 5225 ms overlapping gunzip 1214 ms, parse 5088 ms, sort 0 ms, write 0 ms, index 782 ms: 12 candidates, 112743 repo-hours, 1339 releases; waiting 443 ms; commit 0 ms)
2026-11-08T07:08:56Z [load_day 2024-07-24] 2024-07-24 hour 14: 238104 events in 0 files, snapshot none (task 10052 ms: download 6743 ms overlapping gunzip 1622 ms, parse 6632 ms, sort 0 ms, write 0 ms, index 787 ms: 11 candidates, 102869 repo-hours, 1419 releases; waiting 624 ms; commit 0 ms)
2026-11-08T07:08:56Z [load_day 2024-07-24] 2024-07-24 hour 15: 233174 events in 0 files, snapshot none (task 9343 ms: download 6114 ms overlapping gunzip 1474 ms, parse 6165 ms, sort 0 ms, write 0 ms, index 902 ms: 12 candidates, 104551 repo-hours, 1505 releases; waiting 520 ms; commit 0 ms)
2026-11-08T07:09:06Z [load_day 2024-07-24] 2024-07-24 hour 16: 224771 events in 0 files, snapshot none (task 10068 ms: download 7201 ms overlapping gunzip 1593 ms, parse 6677 ms, sort 0 ms, write 0 ms, index 837 ms: 12 candidates, 94308 repo-hours, 1144 releases; waiting 539 ms; commit 0 ms)
2026-11-08T07:09:06Z [load_day 2024-07-24] 2024-07-24 hour 17: 214200 events in 0 files, snapshot none (task 9034 ms: download 6269 ms overlapping gunzip 1440 ms, parse 6078 ms, sort 0 ms, write 0 ms, index 707 ms: 9 candidates, 86937 repo-hours, 1022 releases; waiting 513 ms; commit 0 ms)
2026-11-08T07:09:16Z [load_day 2024-07-24] 2024-07-24 hour 18: 219994 events in 0 files, snapshot none (task 9181 ms: download 5646 ms overlapping gunzip 1473 ms, parse 6107 ms, sort 0 ms, write 0 ms, index 753 ms: 7 candidates, 98403 repo-hours, 1275 releases; waiting 491 ms; commit 0 ms)
2026-11-08T07:09:16Z [load_day 2024-07-24] 2024-07-24 hour 19: 198196 events in 0 files, snapshot none (task 8437 ms: download 5395 ms overlapping gunzip 1256 ms, parse 5687 ms, sort 0 ms, write 0 ms, index 744 ms: 14 candidates, 75233 repo-hours, 1116 releases; waiting 472 ms; commit 0 ms)
2026-11-08T07:09:24Z [load_day 2024-07-24] 2024-07-24 hour 20: 194474 events in 0 files, snapshot none (task 7831 ms: download 5101 ms overlapping gunzip 1279 ms, parse 5220 ms, sort 0 ms, write 0 ms, index 622 ms: 9 candidates, 75757 repo-hours, 1194 releases; waiting 410 ms; commit 0 ms)
2026-11-08T07:09:24Z [load_day 2024-07-24] 2024-07-24 hour 21: 181922 events in 0 files, snapshot none (task 7021 ms: download 4036 ms overlapping gunzip 1069 ms, parse 4399 ms, sort 0 ms, write 0 ms, index 769 ms: 8 candidates, 73963 repo-hours, 1162 releases; waiting 535 ms; commit 0 ms)
2026-11-08T07:09:31Z [load_day 2024-07-24] 2024-07-24 hour 22: 156650 events in 0 files, snapshot none (task 6418 ms: download 3838 ms overlapping gunzip 1026 ms, parse 4119 ms, sort 0 ms, write 0 ms, index 517 ms: 6 candidates, 58649 repo-hours, 1080 releases; waiting 541 ms; commit 0 ms)
2026-11-08T07:09:31Z [load_day 2024-07-24] 2024-07-24 hour 23: 146356 events in 0 files, snapshot none (task 5270 ms: download 3270 ms overlapping gunzip 826 ms, parse 3171 ms, sort 0 ms, write 0 ms, index 477 ms: 3 candidates, 55639 repo-hours, 828 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:09:40Z [load_day 2024-07-24] 2024-07-24: repo_hour merged from 24 files to 1 (2081421 rows, 9163 ms)
2026-11-08T07:09:42Z [load_day 2024-07-24] 2024-07-24: index committed in 11613 ms (24 + 1 + 24 files)
2026-11-08T07:09:42Z [load_day 2024-07-24] 2024-07-24: 4802817 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:09:42Z [load_day 2024-07-24] attempt 1 succeeded