orcaLog in

Runs · run 2064

load_day 2024-02-09, attempt 1 succeeded

Host
73ccef5e07c2:84707
Started
2026-11-08T04:34:14Z
Ended
2026-11-08T04:36:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
651 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
165.9 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2064/load_day/2024-02-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:34:14Z [load_day 2024-02-09] attempt 1 started
2026-11-08T04:34:15Z [load_day 2024-02-09] 2024-02-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:34:24Z [load_day 2024-02-09] 2024-02-09 hour 0: 226026 events in 0 files, snapshot none (task 8859 ms: download 5681 ms overlapping gunzip 1334 ms, parse 6026 ms, sort 0 ms, write 0 ms, index 775 ms: 8 candidates, 90310 repo-hours, 1101 releases; waiting 444 ms; commit 0 ms)
2026-11-08T04:34:24Z [load_day 2024-02-09] 2024-02-09 hour 1: 211973 events in 0 files, snapshot none (task 7594 ms: download 4365 ms overlapping gunzip 1106 ms, parse 4843 ms, sort 0 ms, write 0 ms, index 794 ms: 3 candidates, 85857 repo-hours, 764 releases; waiting 451 ms; commit 0 ms)
2026-11-08T04:34:31Z [load_day 2024-02-09] 2024-02-09 hour 2: 179300 events in 0 files, snapshot none (task 6719 ms: download 3534 ms overlapping gunzip 1053 ms, parse 4454 ms, sort 0 ms, write 0 ms, index 452 ms: 4 candidates, 51331 repo-hours, 658 releases; waiting 480 ms; commit 0 ms)
2026-11-08T04:34:31Z [load_day 2024-02-09] 2024-02-09 hour 3: 175760 events in 0 files, snapshot none (task 6443 ms: download 3171 ms overlapping gunzip 1029 ms, parse 4457 ms, sort 0 ms, write 0 ms, index 497 ms: 2 candidates, 51162 repo-hours, 770 releases; waiting 184 ms; commit 0 ms)
2026-11-08T04:34:38Z [load_day 2024-02-09] 2024-02-09 hour 4: 180449 events in 0 files, snapshot none (task 5980 ms: download 3164 ms overlapping gunzip 884 ms, parse 3824 ms, sort 0 ms, write 0 ms, index 492 ms: 1 candidates, 51471 repo-hours, 699 releases; waiting 495 ms; commit 0 ms)
2026-11-08T04:34:38Z [load_day 2024-02-09] 2024-02-09 hour 5: 184801 events in 0 files, snapshot none (task 6259 ms: download 3706 ms overlapping gunzip 944 ms, parse 4126 ms, sort 0 ms, write 0 ms, index 431 ms: 3 candidates, 54520 repo-hours, 641 releases; waiting 515 ms; commit 0 ms)
2026-11-08T04:34:44Z [load_day 2024-02-09] 2024-02-09 hour 6: 195299 events in 0 files, snapshot none (task 5135 ms: download 2803 ms overlapping gunzip 698 ms, parse 3235 ms, sort 0 ms, write 0 ms, index 472 ms: 5 candidates, 62763 repo-hours, 736 releases; waiting 490 ms; commit 0 ms)
2026-11-08T04:34:44Z [load_day 2024-02-09] 2024-02-09 hour 7: 197889 events in 0 files, snapshot none (task 5465 ms: download 3118 ms overlapping gunzip 776 ms, parse 3608 ms, sort 0 ms, write 0 ms, index 525 ms: 5 candidates, 59749 repo-hours, 753 releases; waiting 318 ms; commit 0 ms)
2026-11-08T04:34:51Z [load_day 2024-02-09] 2024-02-09 hour 8: 209193 events in 0 files, snapshot none (task 6731 ms: download 4092 ms overlapping gunzip 1054 ms, parse 4335 ms, sort 0 ms, write 0 ms, index 545 ms: 9 candidates, 67086 repo-hours, 776 releases; waiting 514 ms; commit 0 ms)
2026-11-08T04:34:52Z [load_day 2024-02-09] 2024-02-09 hour 9: 228216 events in 0 files, snapshot none (task 7620 ms: download 5028 ms overlapping gunzip 1159 ms, parse 5043 ms, sort 0 ms, write 0 ms, index 661 ms: 11 candidates, 76352 repo-hours, 1111 releases; waiting 509 ms; commit 0 ms)
2026-11-08T04:35:01Z [load_day 2024-02-09] 2024-02-09 hour 10: 236600 events in 0 files, snapshot none (task 9792 ms: download 6215 ms overlapping gunzip 1547 ms, parse 6958 ms, sort 0 ms, write 0 ms, index 865 ms: 6 candidates, 80760 repo-hours, 1011 releases; waiting 198 ms; commit 0 ms)
2026-11-08T04:35:02Z [load_day 2024-02-09] 2024-02-09 hour 11: 229955 events in 0 files, snapshot none (task 9867 ms: download 7219 ms overlapping gunzip 1569 ms, parse 6903 ms, sort 0 ms, write 0 ms, index 625 ms: 5 candidates, 74367 repo-hours, 969 releases; waiting 512 ms; commit 0 ms)
2026-11-08T04:35:12Z [load_day 2024-02-09] 2024-02-09 hour 12: 297338 events in 0 files, snapshot none (task 10339 ms: download 6597 ms overlapping gunzip 1478 ms, parse 6961 ms, sort 0 ms, write 0 ms, index 1161 ms: 13 candidates, 107863 repo-hours, 1106 releases; waiting 514 ms; commit 0 ms)
2026-11-08T04:35:13Z [load_day 2024-02-09] 2024-02-09 hour 13: 262313 events in 0 files, snapshot none (task 9845 ms: download 6303 ms overlapping gunzip 1550 ms, parse 6659 ms, sort 0 ms, write 0 ms, index 761 ms: 10 candidates, 100335 repo-hours, 1244 releases; waiting 466 ms; commit 0 ms)
2026-11-08T04:35:23Z [load_day 2024-02-09] 2024-02-09 hour 14: 256846 events in 0 files, snapshot none (task 10036 ms: download 6487 ms overlapping gunzip 1512 ms, parse 6260 ms, sort 0 ms, write 0 ms, index 1543 ms: 9 candidates, 88672 repo-hours, 1104 releases; waiting 470 ms; commit 0 ms)
2026-11-08T04:35:23Z [load_day 2024-02-09] 2024-02-09 hour 15: 265381 events in 0 files, snapshot none (task 9960 ms: download 6808 ms overlapping gunzip 1576 ms, parse 6721 ms, sort 0 ms, write 0 ms, index 916 ms: 11 candidates, 91762 repo-hours, 1358 releases; waiting 526 ms; commit 0 ms)
2026-11-08T04:35:32Z [load_day 2024-02-09] 2024-02-09 hour 16: 259666 events in 0 files, snapshot none (task 8945 ms: download 6173 ms overlapping gunzip 1485 ms, parse 6345 ms, sort 0 ms, write 0 ms, index 650 ms: 12 candidates, 88604 repo-hours, 1283 releases; waiting 178 ms; commit 0 ms)
2026-11-08T04:35:32Z [load_day 2024-02-09] 2024-02-09 hour 17: 244065 events in 0 files, snapshot none (task 8537 ms: download 5485 ms overlapping gunzip 1359 ms, parse 5704 ms, sort 0 ms, write 0 ms, index 721 ms: 3 candidates, 81672 repo-hours, 977 releases; waiting 501 ms; commit 0 ms)
2026-11-08T04:35:43Z [load_day 2024-02-09] 2024-02-09 hour 18: 249308 events in 0 files, snapshot none (task 9695 ms: download 6253 ms overlapping gunzip 1437 ms, parse 6605 ms, sort 0 ms, write 0 ms, index 842 ms: 6 candidates, 86583 repo-hours, 1030 releases; waiting 506 ms; commit 0 ms)
2026-11-08T04:35:43Z [load_day 2024-02-09] 2024-02-09 hour 19: 231672 events in 0 files, snapshot none (task 8795 ms: download 5847 ms overlapping gunzip 1390 ms, parse 5787 ms, sort 0 ms, write 0 ms, index 870 ms: 6 candidates, 72711 repo-hours, 1160 releases; waiting 481 ms; commit 0 ms)
2026-11-08T04:35:51Z [load_day 2024-02-09] 2024-02-09 hour 20: 222512 events in 0 files, snapshot none (task 7381 ms: download 4195 ms overlapping gunzip 1064 ms, parse 4804 ms, sort 0 ms, write 0 ms, index 743 ms: 10 candidates, 69823 repo-hours, 877 releases; waiting 522 ms; commit 0 ms)
2026-11-08T04:35:51Z [load_day 2024-02-09] 2024-02-09 hour 21: 213809 events in 0 files, snapshot none (task 7695 ms: download 4410 ms overlapping gunzip 1217 ms, parse 5072 ms, sort 0 ms, write 0 ms, index 444 ms: 6 candidates, 63818 repo-hours, 990 releases; waiting 612 ms; commit 0 ms)
2026-11-08T04:35:58Z [load_day 2024-02-09] 2024-02-09 hour 22: 203592 events in 0 files, snapshot none (task 6857 ms: download 4274 ms overlapping gunzip 1044 ms, parse 4409 ms, sort 0 ms, write 0 ms, index 596 ms: 2 candidates, 58316 repo-hours, 947 releases; waiting 528 ms; commit 0 ms)
2026-11-08T04:35:58Z [load_day 2024-02-09] 2024-02-09 hour 23: 189518 events in 0 files, snapshot none (task 6533 ms: download 3817 ms overlapping gunzip 964 ms, parse 4357 ms, sort 0 ms, write 0 ms, index 457 ms: 6 candidates, 52074 repo-hours, 816 releases; waiting 523 ms; commit 0 ms)
2026-11-08T04:36:06Z [load_day 2024-02-09] 2024-02-09: repo_hour merged from 24 files to 1 (1767961 rows, 7925 ms)
2026-11-08T04:36:08Z [load_day 2024-02-09] 2024-02-09: index committed in 10339 ms (24 + 1 + 24 files)
2026-11-08T04:36:08Z [load_day 2024-02-09] 2024-02-09: 5351481 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:36:08Z [load_day 2024-02-09] attempt 1 succeeded