orcaLog in

Runs · run 4600

load_day 2025-11-10, attempt 1 succeeded

Host
73ccef5e07c2:403273
Started
2026-11-08T14:26:37Z
Ended
2026-11-08T14:27:38Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
684 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
72.6 s, up to 1.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4600/load_day/2025-11-10/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:26:37Z [load_day 2025-11-10] attempt 1 started
2026-11-08T14:26:38Z [load_day 2025-11-10] 2025-11-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:26:41Z [load_day 2025-11-10] 2025-11-10 hour 0: 144842 events in 0 files, snapshot none (task 2861 ms: download 1533 ms overlapping gunzip 422 ms, parse 1386 ms, sort 0 ms, write 0 ms, index 537 ms: 8 candidates, 70405 repo-hours, 775 releases; waiting 206 ms; commit 0 ms)
2026-11-08T14:26:42Z [load_day 2025-11-10] 2025-11-10 hour 1: 151387 events in 0 files, snapshot none (task 3369 ms: download 2121 ms overlapping gunzip 396 ms, parse 1175 ms, sort 0 ms, write 0 ms, index 733 ms: 9 candidates, 88266 repo-hours, 611 releases; waiting 676 ms; commit 0 ms)
2026-11-08T14:26:45Z [load_day 2025-11-10] 2025-11-10 hour 2: 143568 events in 0 files, snapshot none (task 2955 ms: download 1711 ms overlapping gunzip 396 ms, parse 1288 ms, sort 0 ms, write 0 ms, index 605 ms: 7 candidates, 71489 repo-hours, 597 releases; waiting 356 ms; commit 0 ms)
2026-11-08T14:26:46Z [load_day 2025-11-10] 2025-11-10 hour 3: 146138 events in 0 files, snapshot none (task 3860 ms: download 2576 ms overlapping gunzip 385 ms, parse 1179 ms, sort 0 ms, write 0 ms, index 741 ms: 9 candidates, 71573 repo-hours, 1364 releases; waiting 1181 ms; commit 0 ms)
2026-11-08T14:26:48Z [load_day 2025-11-10] 2025-11-10 hour 4: 142634 events in 0 files, snapshot none (task 3161 ms: download 2142 ms overlapping gunzip 366 ms, parse 1184 ms, sort 0 ms, write 0 ms, index 542 ms: 6 candidates, 65933 repo-hours, 615 releases; waiting 762 ms; commit 0 ms)
2026-11-08T14:26:50Z [load_day 2025-11-10] 2025-11-10 hour 5: 147019 events in 0 files, snapshot none (task 3188 ms: download 2173 ms overlapping gunzip 359 ms, parse 1114 ms, sort 0 ms, write 0 ms, index 555 ms: 3 candidates, 67740 repo-hours, 492 releases; waiting 867 ms; commit 0 ms)
2026-11-08T14:26:52Z [load_day 2025-11-10] 2025-11-10 hour 6: 146482 events in 0 files, snapshot none (task 3295 ms: download 2258 ms overlapping gunzip 411 ms, parse 1242 ms, sort 0 ms, write 0 ms, index 540 ms: 4 candidates, 73547 repo-hours, 590 releases; waiting 755 ms; commit 0 ms)
2026-11-08T14:26:54Z [load_day 2025-11-10] 2025-11-10 hour 7: 148384 events in 0 files, snapshot none (task 3959 ms: download 2472 ms overlapping gunzip 402 ms, parse 1195 ms, sort 0 ms, write 0 ms, index 570 ms: 4 candidates, 69891 repo-hours, 510 releases; waiting 995 ms; commit 0 ms)
2026-11-08T14:26:56Z [load_day 2025-11-10] 2025-11-10 hour 8: 145318 events in 0 files, snapshot none (task 3175 ms: download 1985 ms overlapping gunzip 423 ms, parse 1259 ms, sort 0 ms, write 0 ms, index 566 ms: 7 candidates, 74585 repo-hours, 659 releases; waiting 605 ms; commit 0 ms)
2026-11-08T14:26:58Z [load_day 2025-11-10] 2025-11-10 hour 9: 147612 events in 0 files, snapshot none (task 3178 ms: download 2135 ms overlapping gunzip 403 ms, parse 1228 ms, sort 0 ms, write 0 ms, index 593 ms: 6 candidates, 76987 repo-hours, 604 releases; waiting 603 ms; commit 0 ms)
2026-11-08T14:26:59Z [load_day 2025-11-10] 2025-11-10 hour 10: 143508 events in 0 files, snapshot none (task 3198 ms: download 2048 ms overlapping gunzip 425 ms, parse 1266 ms, sort 0 ms, write 0 ms, index 546 ms: 4 candidates, 75977 repo-hours, 543 releases; waiting 640 ms; commit 0 ms)
2026-11-08T14:27:03Z [load_day 2025-11-10] 2025-11-10 hour 11: 149483 events in 0 files, snapshot none (task 3884 ms: download 2643 ms overlapping gunzip 426 ms, parse 1252 ms, sort 0 ms, write 0 ms, index 667 ms: 3 candidates, 73473 repo-hours, 564 releases; waiting 1213 ms; commit 0 ms)
2026-11-08T14:27:05Z [load_day 2025-11-10] 2025-11-10 hour 12: 154371 events in 0 files, snapshot none (task 3828 ms: download 2361 ms overlapping gunzip 455 ms, parse 1375 ms, sort 0 ms, write 0 ms, index 879 ms: 4 candidates, 93631 repo-hours, 362 releases; waiting 774 ms; commit 0 ms)
2026-11-08T14:27:07Z [load_day 2025-11-10] 2025-11-10 hour 13: 156277 events in 0 files, snapshot none (task 3359 ms: download 2097 ms overlapping gunzip 371 ms, parse 1196 ms, sort 0 ms, write 0 ms, index 691 ms: 9 candidates, 92188 repo-hours, 366 releases; waiting 724 ms; commit 0 ms)
2026-11-08T14:27:10Z [load_day 2025-11-10] 2025-11-10 hour 14: 148867 events in 0 files, snapshot none (task 3955 ms: download 2032 ms overlapping gunzip 490 ms, parse 1504 ms, sort 0 ms, write 0 ms, index 1179 ms: 5 candidates, 81015 repo-hours, 490 releases; waiting 572 ms; commit 0 ms)
2026-11-08T14:27:11Z [load_day 2025-11-10] 2025-11-10 hour 15: 151009 events in 0 files, snapshot none (task 3725 ms: download 2074 ms overlapping gunzip 580 ms, parse 1731 ms, sort 0 ms, write 0 ms, index 622 ms: 7 candidates, 81160 repo-hours, 474 releases; waiting 476 ms; commit 0 ms)
2026-11-08T14:27:15Z [load_day 2025-11-10] 2025-11-10 hour 16: 150889 events in 0 files, snapshot none (task 4390 ms: download 2418 ms overlapping gunzip 602 ms, parse 1868 ms, sort 0 ms, write 0 ms, index 889 ms: 5 candidates, 77514 repo-hours, 500 releases; waiting 564 ms; commit 0 ms)
2026-11-08T14:27:15Z [load_day 2025-11-10] 2025-11-10 hour 17: 149462 events in 0 files, snapshot none (task 3536 ms: download 1693 ms overlapping gunzip 602 ms, parse 1792 ms, sort 0 ms, write 0 ms, index 622 ms: 9 candidates, 73729 repo-hours, 349 releases; waiting 175 ms; commit 0 ms)
2026-11-08T14:27:19Z [load_day 2025-11-10] 2025-11-10 hour 18: 158813 events in 0 files, snapshot none (task 3730 ms: download 2182 ms overlapping gunzip 524 ms, parse 1608 ms, sort 0 ms, write 0 ms, index 696 ms: 5 candidates, 79744 repo-hours, 423 releases; waiting 574 ms; commit 0 ms)
2026-11-08T14:27:20Z [load_day 2025-11-10] 2025-11-10 hour 19: 153852 events in 0 files, snapshot none (task 4049 ms: download 2236 ms overlapping gunzip 627 ms, parse 1876 ms, sort 0 ms, write 0 ms, index 719 ms: 3 candidates, 70584 repo-hours, 456 releases; waiting 486 ms; commit 0 ms)
2026-11-08T14:27:23Z [load_day 2025-11-10] 2025-11-10 hour 20: 151201 events in 0 files, snapshot none (task 3262 ms: download 2081 ms overlapping gunzip 524 ms, parse 1481 ms, sort 0 ms, write 0 ms, index 574 ms: 7 candidates, 70317 repo-hours, 531 releases; waiting 406 ms; commit 0 ms)
2026-11-08T14:27:24Z [load_day 2025-11-10] 2025-11-10 hour 21: 151782 events in 0 files, snapshot none (task 3521 ms: download 2419 ms overlapping gunzip 470 ms, parse 1514 ms, sort 0 ms, write 0 ms, index 494 ms: 9 candidates, 67913 repo-hours, 584 releases; waiting 618 ms; commit 0 ms)
2026-11-08T14:27:27Z [load_day 2025-11-10] 2025-11-10 hour 22: 146417 events in 0 files, snapshot none (task 3465 ms: download 2223 ms overlapping gunzip 493 ms, parse 1447 ms, sort 0 ms, write 0 ms, index 547 ms: 4 candidates, 63274 repo-hours, 711 releases; waiting 668 ms; commit 0 ms)
2026-11-08T14:27:27Z [load_day 2025-11-10] 2025-11-10 hour 23: 151382 events in 0 files, snapshot none (task 3251 ms: download 2176 ms overlapping gunzip 472 ms, parse 1447 ms, sort 0 ms, write 0 ms, index 492 ms: 6 candidates, 61242 repo-hours, 603 releases; waiting 550 ms; commit 0 ms)
2026-11-08T14:27:35Z [load_day 2025-11-10] 2025-11-10: repo_hour merged from 24 files to 1 (1792177 rows, 7867 ms)
2026-11-08T14:27:38Z [load_day 2025-11-10] 2025-11-10: index committed in 10561 ms (24 + 1 + 24 files)
2026-11-08T14:27:38Z [load_day 2025-11-10] 2025-11-10: 3580697 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:27:38Z [load_day 2025-11-10] attempt 1 succeeded