orcaLog in

Runs · run 2152

load_day 2024-03-02, attempt 1 succeeded

Host
73ccef5e07c2:93792
Started
2026-11-08T04:55:49Z
Ended
2026-11-08T04:57:11Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
611 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
117.5 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2152/load_day/2024-03-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:55:49Z [load_day 2024-03-02] attempt 1 started
2026-11-08T04:55:50Z [load_day 2024-03-02] 2024-03-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:55:57Z [load_day 2024-03-02] 2024-03-02 hour 0: 209390 events in 0 files, snapshot none (task 6129 ms: download 3604 ms overlapping gunzip 916 ms, parse 3910 ms, sort 0 ms, write 0 ms, index 630 ms: 12 candidates, 88935 repo-hours, 1146 releases; waiting 462 ms; commit 0 ms)
2026-11-08T04:55:57Z [load_day 2024-03-02] 2024-03-02 hour 1: 190011 events in 0 files, snapshot none (task 5691 ms: download 3057 ms overlapping gunzip 836 ms, parse 3482 ms, sort 0 ms, write 0 ms, index 585 ms: 9 candidates, 80917 repo-hours, 751 releases; waiting 458 ms; commit 0 ms)
2026-11-08T04:56:03Z [load_day 2024-03-02] 2024-03-02 hour 2: 158471 events in 0 files, snapshot none (task 5955 ms: download 2878 ms overlapping gunzip 916 ms, parse 3852 ms, sort 0 ms, write 0 ms, index 403 ms: 7 candidates, 47933 repo-hours, 555 releases; waiting 512 ms; commit 0 ms)
2026-11-08T04:56:03Z [load_day 2024-03-02] 2024-03-02 hour 3: 163264 events in 0 files, snapshot none (task 5650 ms: download 2848 ms overlapping gunzip 865 ms, parse 3483 ms, sort 0 ms, write 0 ms, index 451 ms: 6 candidates, 48704 repo-hours, 684 releases; waiting 515 ms; commit 0 ms)
2026-11-08T04:56:09Z [load_day 2024-03-02] 2024-03-02 hour 4: 165129 events in 0 files, snapshot none (task 4959 ms: download 1998 ms overlapping gunzip 706 ms, parse 3058 ms, sort 0 ms, write 0 ms, index 468 ms: 12 candidates, 51497 repo-hours, 471 releases; waiting 482 ms; commit 0 ms)
2026-11-08T04:56:10Z [load_day 2024-03-02] 2024-03-02 hour 5: 168206 events in 0 files, snapshot none (task 5617 ms: download 2487 ms overlapping gunzip 868 ms, parse 3487 ms, sort 0 ms, write 0 ms, index 474 ms: 9 candidates, 51237 repo-hours, 560 releases; waiting 505 ms; commit 0 ms)
2026-11-08T04:56:13Z [load_day 2024-03-02] 2024-03-02 hour 6: 184036 events in 0 files, snapshot none (task 4122 ms: download 2252 ms overlapping gunzip 511 ms, parse 2334 ms, sort 0 ms, write 0 ms, index 462 ms: 11 candidates, 62304 repo-hours, 862 releases; waiting 524 ms; commit 0 ms)
2026-11-08T04:56:14Z [load_day 2024-03-02] 2024-03-02 hour 7: 177956 events in 0 files, snapshot none (task 4213 ms: download 2246 ms overlapping gunzip 543 ms, parse 2433 ms, sort 0 ms, write 0 ms, index 372 ms: 9 candidates, 54991 repo-hours, 706 releases; waiting 578 ms; commit 0 ms)
2026-11-08T04:56:18Z [load_day 2024-03-02] 2024-03-02 hour 8: 184891 events in 0 files, snapshot none (task 4381 ms: download 2299 ms overlapping gunzip 626 ms, parse 2594 ms, sort 0 ms, write 0 ms, index 431 ms: 7 candidates, 58167 repo-hours, 743 releases; waiting 510 ms; commit 0 ms)
2026-11-08T04:56:19Z [load_day 2024-03-02] 2024-03-02 hour 9: 195522 events in 0 files, snapshot none (task 4476 ms: download 2274 ms overlapping gunzip 579 ms, parse 2610 ms, sort 0 ms, write 0 ms, index 458 ms: 7 candidates, 61777 repo-hours, 975 releases; waiting 523 ms; commit 0 ms)
2026-11-08T04:56:23Z [load_day 2024-03-02] 2024-03-02 hour 10: 199202 events in 0 files, snapshot none (task 3882 ms: download 2106 ms overlapping gunzip 569 ms, parse 2454 ms, sort 0 ms, write 0 ms, index 501 ms: 16 candidates, 64958 repo-hours, 680 releases; waiting 183 ms; commit 0 ms)
2026-11-08T04:56:24Z [load_day 2024-03-02] 2024-03-02 hour 11: 195702 events in 0 files, snapshot none (task 4412 ms: download 2146 ms overlapping gunzip 602 ms, parse 2605 ms, sort 0 ms, write 0 ms, index 432 ms: 8 candidates, 61980 repo-hours, 734 releases; waiting 505 ms; commit 0 ms)
2026-11-08T04:56:30Z [load_day 2024-03-02] 2024-03-02 hour 12: 268314 events in 0 files, snapshot none (task 6478 ms: download 3186 ms overlapping gunzip 853 ms, parse 4190 ms, sort 0 ms, write 0 ms, index 686 ms: 9 candidates, 96705 repo-hours, 805 releases; waiting 504 ms; commit 0 ms)
2026-11-08T04:56:30Z [load_day 2024-03-02] 2024-03-02 hour 13: 226499 events in 0 files, snapshot none (task 5911 ms: download 3200 ms overlapping gunzip 820 ms, parse 3667 ms, sort 0 ms, write 0 ms, index 611 ms: 4 candidates, 89024 repo-hours, 729 releases; waiting 479 ms; commit 0 ms)
2026-11-08T04:56:36Z [load_day 2024-03-02] 2024-03-02 hour 14: 219014 events in 0 files, snapshot none (task 6051 ms: download 3672 ms overlapping gunzip 904 ms, parse 3801 ms, sort 0 ms, write 0 ms, index 524 ms: 8 candidates, 74561 repo-hours, 772 releases; waiting 541 ms; commit 0 ms)
2026-11-08T04:56:37Z [load_day 2024-03-02] 2024-03-02 hour 15: 218131 events in 0 files, snapshot none (task 5811 ms: download 3185 ms overlapping gunzip 800 ms, parse 3506 ms, sort 0 ms, write 0 ms, index 642 ms: 13 candidates, 73927 repo-hours, 870 releases; waiting 537 ms; commit 0 ms)
2026-11-08T04:56:43Z [load_day 2024-03-02] 2024-03-02 hour 16: 214805 events in 0 files, snapshot none (task 6053 ms: download 3123 ms overlapping gunzip 872 ms, parse 3845 ms, sort 0 ms, write 0 ms, index 578 ms: 5 candidates, 72830 repo-hours, 818 releases; waiting 475 ms; commit 0 ms)
2026-11-08T04:56:43Z [load_day 2024-03-02] 2024-03-02 hour 17: 207957 events in 0 files, snapshot none (task 5418 ms: download 2333 ms overlapping gunzip 814 ms, parse 3474 ms, sort 0 ms, write 0 ms, index 527 ms: 5 candidates, 68443 repo-hours, 720 releases; waiting 182 ms; commit 0 ms)
2026-11-08T04:56:49Z [load_day 2024-03-02] 2024-03-02 hour 18: 193020 events in 0 files, snapshot none (task 5895 ms: download 2410 ms overlapping gunzip 796 ms, parse 3595 ms, sort 0 ms, write 0 ms, index 695 ms: 4 candidates, 74717 repo-hours, 884 releases; waiting 499 ms; commit 0 ms)
2026-11-08T04:56:49Z [load_day 2024-03-02] 2024-03-02 hour 19: 162076 events in 0 files, snapshot none (task 5621 ms: download 3446 ms overlapping gunzip 759 ms, parse 3437 ms, sort 0 ms, write 0 ms, index 531 ms: 4 candidates, 61759 repo-hours, 756 releases; waiting 505 ms; commit 0 ms)
2026-11-08T04:56:55Z [load_day 2024-03-02] 2024-03-02 hour 20: 167960 events in 0 files, snapshot none (task 5550 ms: download 2765 ms overlapping gunzip 762 ms, parse 3464 ms, sort 0 ms, write 0 ms, index 501 ms: 3 candidates, 62291 repo-hours, 769 releases; waiting 524 ms; commit 0 ms)
2026-11-08T04:56:55Z [load_day 2024-03-02] 2024-03-02 hour 21: 183444 events in 0 files, snapshot none (task 5380 ms: download 2498 ms overlapping gunzip 769 ms, parse 3412 ms, sort 0 ms, write 0 ms, index 429 ms: 8 candidates, 56342 repo-hours, 822 releases; waiting 503 ms; commit 0 ms)
2026-11-08T04:57:01Z [load_day 2024-03-02] 2024-03-02 hour 22: 170396 events in 0 files, snapshot none (task 5424 ms: download 2587 ms overlapping gunzip 780 ms, parse 3332 ms, sort 0 ms, write 0 ms, index 489 ms: 4 candidates, 53010 repo-hours, 751 releases; waiting 529 ms; commit 0 ms)
2026-11-08T04:57:01Z [load_day 2024-03-02] 2024-03-02 hour 23: 155176 events in 0 files, snapshot none (task 5449 ms: download 2266 ms overlapping gunzip 719 ms, parse 3438 ms, sort 0 ms, write 0 ms, index 502 ms: 4 candidates, 48625 repo-hours, 543 releases; waiting 506 ms; commit 0 ms)
2026-11-08T04:57:08Z [load_day 2024-03-02] 2024-03-02: repo_hour merged from 24 files to 1 (1565634 rows, 7160 ms)
2026-11-08T04:57:11Z [load_day 2024-03-02] 2024-03-02: index committed in 9929 ms (24 + 1 + 24 files)
2026-11-08T04:57:11Z [load_day 2024-03-02] 2024-03-02: 4578572 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:57:11Z [load_day 2024-03-02] attempt 1 succeeded