orcaLog in

Runs · run 2966

load_day 2024-09-15, attempt 1 succeeded

Host
73ccef5e07c2:178266
Started
2026-11-08T07:56:04Z
Ended
2026-11-08T07:57:18Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
652 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
107.4 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2966/load_day/2024-09-15/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:56:04Z [load_day 2024-09-15] attempt 1 started
2026-11-08T07:56:05Z [load_day 2024-09-15] 2024-09-15: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:56:11Z [load_day 2024-09-15] 2024-09-15 hour 0: 135007 events in 0 files, snapshot none (task 5145 ms: download 2492 ms overlapping gunzip 703 ms, parse 3034 ms, sort 0 ms, write 0 ms, index 581 ms: 11 candidates, 69704 repo-hours, 986 releases; waiting 538 ms; commit 0 ms)
2026-11-08T07:56:11Z [load_day 2024-09-15] 2024-09-15 hour 1: 153683 events in 0 files, snapshot none (task 5151 ms: download 2548 ms overlapping gunzip 626 ms, parse 2906 ms, sort 0 ms, write 0 ms, index 766 ms: 6 candidates, 92193 repo-hours, 794 releases; waiting 541 ms; commit 0 ms)
2026-11-08T07:56:15Z [load_day 2024-09-15] 2024-09-15 hour 2: 118389 events in 0 files, snapshot none (task 3652 ms: download 2550 ms overlapping gunzip 489 ms, parse 2064 ms, sort 0 ms, write 0 ms, index 369 ms: 4 candidates, 55704 repo-hours, 725 releases; waiting 270 ms; commit 0 ms)
2026-11-08T07:56:15Z [load_day 2024-09-15] 2024-09-15 hour 3: 138519 events in 0 files, snapshot none (task 4007 ms: download 2112 ms overlapping gunzip 514 ms, parse 2230 ms, sort 0 ms, write 0 ms, index 445 ms: 4 candidates, 55266 repo-hours, 3840 releases; waiting 531 ms; commit 0 ms)
2026-11-08T07:56:19Z [load_day 2024-09-15] 2024-09-15 hour 4: 120122 events in 0 files, snapshot none (task 3737 ms: download 2670 ms overlapping gunzip 450 ms, parse 1836 ms, sort 0 ms, write 0 ms, index 329 ms: 8 candidates, 45432 repo-hours, 496 releases; waiting 616 ms; commit 0 ms)
2026-11-08T07:56:19Z [load_day 2024-09-15] 2024-09-15 hour 5: 129600 events in 0 files, snapshot none (task 3541 ms: download 2080 ms overlapping gunzip 499 ms, parse 2081 ms, sort 0 ms, write 0 ms, index 390 ms: 4 candidates, 49259 repo-hours, 683 releases; waiting 284 ms; commit 0 ms)
2026-11-08T07:56:24Z [load_day 2024-09-15] 2024-09-15 hour 6: 155347 events in 0 files, snapshot none (task 3974 ms: download 2494 ms overlapping gunzip 477 ms, parse 2153 ms, sort 0 ms, write 0 ms, index 552 ms: 2 candidates, 71990 repo-hours, 738 releases; waiting 494 ms; commit 0 ms)
2026-11-08T07:56:24Z [load_day 2024-09-15] 2024-09-15 hour 7: 146452 events in 0 files, snapshot none (task 3715 ms: download 2134 ms overlapping gunzip 473 ms, parse 2034 ms, sort 0 ms, write 0 ms, index 441 ms: 2 candidates, 53155 repo-hours, 623 releases; waiting 505 ms; commit 0 ms)
2026-11-08T07:56:28Z [load_day 2024-09-15] 2024-09-15 hour 8: 155170 events in 0 files, snapshot none (task 4369 ms: download 2047 ms overlapping gunzip 549 ms, parse 2350 ms, sort 0 ms, write 0 ms, index 691 ms: 12 candidates, 58798 repo-hours, 723 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:56:31Z [load_day 2024-09-15] 2024-09-15 hour 9: 167411 events in 0 files, snapshot none (task 6612 ms: download 4228 ms overlapping gunzip 624 ms, parse 2732 ms, sort 0 ms, write 0 ms, index 983 ms: 8 candidates, 64796 repo-hours, 827 releases; waiting 1242 ms; commit 0 ms)
2026-11-08T07:56:34Z [load_day 2024-09-15] 2024-09-15 hour 10: 153634 events in 0 files, snapshot none (task 4921 ms: download 1987 ms overlapping gunzip 773 ms, parse 3355 ms, sort 0 ms, write 0 ms, index 574 ms: 12 candidates, 60454 repo-hours, 758 releases; waiting 23 ms; commit 0 ms)
2026-11-08T07:56:35Z [load_day 2024-09-15] 2024-09-15 hour 11: 155573 events in 0 files, snapshot none (task 3584 ms: download 1192 ms overlapping gunzip 554 ms, parse 2388 ms, sort 0 ms, write 0 ms, index 424 ms: 3 candidates, 58119 repo-hours, 754 releases; waiting 20 ms; commit 0 ms)
2026-11-08T07:56:41Z [load_day 2024-09-15] 2024-09-15 hour 12: 221263 events in 0 files, snapshot none (task 6630 ms: download 3026 ms overlapping gunzip 871 ms, parse 4106 ms, sort 0 ms, write 0 ms, index 801 ms: 12 candidates, 106665 repo-hours, 928 releases; waiting 524 ms; commit 0 ms)
2026-11-08T07:56:41Z [load_day 2024-09-15] 2024-09-15 hour 13: 192173 events in 0 files, snapshot none (task 6113 ms: download 3040 ms overlapping gunzip 987 ms, parse 4158 ms, sort 0 ms, write 0 ms, index 738 ms: 6 candidates, 87618 repo-hours, 806 releases; waiting 23 ms; commit 0 ms)
2026-11-08T07:56:47Z [load_day 2024-09-15] 2024-09-15 hour 14: 183381 events in 0 files, snapshot none (task 5677 ms: download 2811 ms overlapping gunzip 875 ms, parse 4005 ms, sort 0 ms, write 0 ms, index 597 ms: 10 candidates, 71404 repo-hours, 905 releases; waiting 16 ms; commit 0 ms)
2026-11-08T07:56:47Z [load_day 2024-09-15] 2024-09-15 hour 15: 197331 events in 0 files, snapshot none (task 5382 ms: download 2840 ms overlapping gunzip 857 ms, parse 3650 ms, sort 0 ms, write 0 ms, index 660 ms: 8 candidates, 81191 repo-hours, 1030 releases; waiting 19 ms; commit 0 ms)
2026-11-08T07:56:53Z [load_day 2024-09-15] 2024-09-15 hour 16: 181193 events in 0 files, snapshot none (task 5222 ms: download 2143 ms overlapping gunzip 831 ms, parse 3549 ms, sort 0 ms, write 0 ms, index 627 ms: 10 candidates, 73279 repo-hours, 824 releases; waiting 17 ms; commit 0 ms)
2026-11-08T07:56:53Z [load_day 2024-09-15] 2024-09-15 hour 17: 175113 events in 0 files, snapshot none (task 5391 ms: download 1803 ms overlapping gunzip 839 ms, parse 3623 ms, sort 0 ms, write 0 ms, index 697 ms: 9 candidates, 67673 repo-hours, 854 releases; waiting 16 ms; commit 0 ms)
2026-11-08T07:56:58Z [load_day 2024-09-15] 2024-09-15 hour 18: 187249 events in 0 files, snapshot none (task 5031 ms: download 2453 ms overlapping gunzip 755 ms, parse 3475 ms, sort 0 ms, write 0 ms, index 589 ms: 7 candidates, 84696 repo-hours, 1049 releases; waiting 13 ms; commit 0 ms)
2026-11-08T07:56:58Z [load_day 2024-09-15] 2024-09-15 hour 19: 163843 events in 0 files, snapshot none (task 4634 ms: download 2255 ms overlapping gunzip 781 ms, parse 3119 ms, sort 0 ms, write 0 ms, index 499 ms: 3 candidates, 61325 repo-hours, 957 releases; waiting 15 ms; commit 0 ms)
2026-11-08T07:57:04Z [load_day 2024-09-15] 2024-09-15 hour 20: 157714 events in 0 files, snapshot none (task 5495 ms: download 2606 ms overlapping gunzip 900 ms, parse 3857 ms, sort 0 ms, write 0 ms, index 553 ms: 4 candidates, 60299 repo-hours, 959 releases; waiting 0 ms; commit 0 ms)
2026-11-08T07:57:04Z [load_day 2024-09-15] 2024-09-15 hour 21: 153099 events in 0 files, snapshot none (task 5264 ms: download 2421 ms overlapping gunzip 863 ms, parse 3538 ms, sort 0 ms, write 0 ms, index 625 ms: 5 candidates, 59311 repo-hours, 1040 releases; waiting 24 ms; commit 0 ms)
2026-11-08T07:57:08Z [load_day 2024-09-15] 2024-09-15 hour 22: 134249 events in 0 files, snapshot none (task 3678 ms: download 1380 ms overlapping gunzip 637 ms, parse 2474 ms, sort 0 ms, write 0 ms, index 352 ms: 3 candidates, 48385 repo-hours, 943 releases; waiting 20 ms; commit 0 ms)
2026-11-08T07:57:08Z [load_day 2024-09-15] 2024-09-15 hour 23: 130209 events in 0 files, snapshot none (task 3648 ms: download 1653 ms overlapping gunzip 607 ms, parse 2468 ms, sort 0 ms, write 0 ms, index 368 ms: 3 candidates, 47010 repo-hours, 887 releases; waiting 17 ms; commit 0 ms)
2026-11-08T07:57:16Z [load_day 2024-09-15] 2024-09-15: repo_hour merged from 24 files to 1 (1583726 rows, 7258 ms)
2026-11-08T07:57:18Z [load_day 2024-09-15] 2024-09-15: index committed in 10068 ms (24 + 1 + 24 files)
2026-11-08T07:57:18Z [load_day 2024-09-15] 2024-09-15: 3805724 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:57:18Z [load_day 2024-09-15] attempt 1 succeeded