orcaLog in

Runs · run 2736

load_day 2024-07-20, attempt 1 succeeded

Host
73ccef5e07c2:151976
Started
2026-11-08T07:04:18Z
Ended
2026-11-08T07:05:36Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
613 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
107.3 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2736/load_day/2024-07-20/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:04:18Z [load_day 2024-07-20] attempt 1 started
2026-11-08T07:04:19Z [load_day 2024-07-20] 2024-07-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:04:26Z [load_day 2024-07-20] 2024-07-20 hour 0: 151739 events in 0 files, snapshot none (task 5905 ms: download 2728 ms overlapping gunzip 759 ms, parse 3335 ms, sort 0 ms, write 0 ms, index 914 ms: 6 candidates, 82916 repo-hours, 1155 releases; waiting 533 ms; commit 0 ms)
2026-11-08T07:04:26Z [load_day 2024-07-20] 2024-07-20 hour 1: 157199 events in 0 files, snapshot none (task 5816 ms: download 2939 ms overlapping gunzip 698 ms, parse 3520 ms, sort 0 ms, write 0 ms, index 870 ms: 14 candidates, 91269 repo-hours, 786 releases; waiting 473 ms; commit 0 ms)
2026-11-08T07:04:32Z [load_day 2024-07-20] 2024-07-20 hour 2: 120446 events in 0 files, snapshot none (task 5492 ms: download 2407 ms overlapping gunzip 812 ms, parse 3454 ms, sort 0 ms, write 0 ms, index 424 ms: 2 candidates, 47501 repo-hours, 684 releases; waiting 490 ms; commit 0 ms)
2026-11-08T07:04:32Z [load_day 2024-07-20] 2024-07-20 hour 3: 144116 events in 0 files, snapshot none (task 5324 ms: download 2156 ms overlapping gunzip 730 ms, parse 3289 ms, sort 0 ms, write 0 ms, index 520 ms: 3 candidates, 58895 repo-hours, 5398 releases; waiting 520 ms; commit 0 ms)
2026-11-08T07:04:38Z [load_day 2024-07-20] 2024-07-20 hour 4: 121525 events in 0 files, snapshot none (task 5731 ms: download 1960 ms overlapping gunzip 847 ms, parse 3464 ms, sort 0 ms, write 0 ms, index 629 ms: 3 candidates, 47598 repo-hours, 517 releases; waiting 506 ms; commit 0 ms)
2026-11-08T07:04:38Z [load_day 2024-07-20] 2024-07-20 hour 5: 135090 events in 0 files, snapshot none (task 5695 ms: download 2488 ms overlapping gunzip 827 ms, parse 3544 ms, sort 0 ms, write 0 ms, index 520 ms: 1 candidates, 53165 repo-hours, 663 releases; waiting 531 ms; commit 0 ms)
2026-11-08T07:04:44Z [load_day 2024-07-20] 2024-07-20 hour 6: 160521 events in 0 files, snapshot none (task 5048 ms: download 2451 ms overlapping gunzip 749 ms, parse 3254 ms, sort 0 ms, write 0 ms, index 551 ms: 3 candidates, 72979 repo-hours, 1007 releases; waiting 277 ms; commit 0 ms)
2026-11-08T07:04:44Z [load_day 2024-07-20] 2024-07-20 hour 7: 146425 events in 0 files, snapshot none (task 4521 ms: download 2570 ms overlapping gunzip 639 ms, parse 2743 ms, sort 0 ms, write 0 ms, index 412 ms: 6 candidates, 58329 repo-hours, 812 releases; waiting 492 ms; commit 0 ms)
2026-11-08T07:04:49Z [load_day 2024-07-20] 2024-07-20 hour 8: 146570 events in 0 files, snapshot none (task 5350 ms: download 2670 ms overlapping gunzip 770 ms, parse 3379 ms, sort 0 ms, write 0 ms, index 481 ms: 7 candidates, 60019 repo-hours, 776 releases; waiting 496 ms; commit 0 ms)
2026-11-08T07:04:50Z [load_day 2024-07-20] 2024-07-20 hour 9: 154661 events in 0 files, snapshot none (task 5691 ms: download 2431 ms overlapping gunzip 823 ms, parse 3565 ms, sort 0 ms, write 0 ms, index 549 ms: 2 candidates, 66550 repo-hours, 891 releases; waiting 507 ms; commit 0 ms)
2026-11-08T07:04:55Z [load_day 2024-07-20] 2024-07-20 hour 10: 146911 events in 0 files, snapshot none (task 5463 ms: download 2085 ms overlapping gunzip 744 ms, parse 3309 ms, sort 0 ms, write 0 ms, index 451 ms: 6 candidates, 60115 repo-hours, 764 releases; waiting 511 ms; commit 0 ms)
2026-11-08T07:04:56Z [load_day 2024-07-20] 2024-07-20 hour 11: 148694 events in 0 files, snapshot none (task 5340 ms: download 2546 ms overlapping gunzip 767 ms, parse 3335 ms, sort 0 ms, write 0 ms, index 439 ms: 3 candidates, 59535 repo-hours, 686 releases; waiting 533 ms; commit 0 ms)
2026-11-08T07:05:02Z [load_day 2024-07-20] 2024-07-20 hour 12: 224570 events in 0 files, snapshot none (task 6429 ms: download 2619 ms overlapping gunzip 705 ms, parse 3351 ms, sort 0 ms, write 0 ms, index 1544 ms: 5 candidates, 107073 repo-hours, 843 releases; waiting 515 ms; commit 0 ms)
2026-11-08T07:05:02Z [load_day 2024-07-20] 2024-07-20 hour 13: 186783 events in 0 files, snapshot none (task 5563 ms: download 2572 ms overlapping gunzip 656 ms, parse 3010 ms, sort 0 ms, write 0 ms, index 1138 ms: 5 candidates, 88511 repo-hours, 783 releases; waiting 511 ms; commit 0 ms)
2026-11-08T07:05:08Z [load_day 2024-07-20] 2024-07-20 hour 14: 165243 events in 0 files, snapshot none (task 4944 ms: download 2620 ms overlapping gunzip 678 ms, parse 2915 ms, sort 0 ms, write 0 ms, index 570 ms: 8 candidates, 69603 repo-hours, 692 releases; waiting 486 ms; commit 0 ms)
2026-11-08T07:05:08Z [load_day 2024-07-20] 2024-07-20 hour 15: 172370 events in 0 files, snapshot none (task 5244 ms: download 2724 ms overlapping gunzip 734 ms, parse 3092 ms, sort 0 ms, write 0 ms, index 663 ms: 12 candidates, 77711 repo-hours, 866 releases; waiting 483 ms; commit 0 ms)
2026-11-08T07:05:13Z [load_day 2024-07-20] 2024-07-20 hour 16: 164054 events in 0 files, snapshot none (task 4808 ms: download 2362 ms overlapping gunzip 637 ms, parse 2781 ms, sort 0 ms, write 0 ms, index 546 ms: 5 candidates, 74291 repo-hours, 752 releases; waiting 571 ms; commit 0 ms)
2026-11-08T07:05:13Z [load_day 2024-07-20] 2024-07-20 hour 17: 154140 events in 0 files, snapshot none (task 4536 ms: download 2271 ms overlapping gunzip 659 ms, parse 2685 ms, sort 0 ms, write 0 ms, index 428 ms: 10 candidates, 64038 repo-hours, 700 releases; waiting 429 ms; commit 0 ms)
2026-11-08T07:05:18Z [load_day 2024-07-20] 2024-07-20 hour 18: 170674 events in 0 files, snapshot none (task 4467 ms: download 2484 ms overlapping gunzip 580 ms, parse 2546 ms, sort 0 ms, write 0 ms, index 567 ms: 2 candidates, 80743 repo-hours, 829 releases; waiting 506 ms; commit 0 ms)
2026-11-08T07:05:18Z [load_day 2024-07-20] 2024-07-20 hour 19: 144561 events in 0 files, snapshot none (task 4396 ms: download 2696 ms overlapping gunzip 572 ms, parse 2441 ms, sort 0 ms, write 0 ms, index 401 ms: 9 candidates, 56687 repo-hours, 745 releases; waiting 489 ms; commit 0 ms)
2026-11-08T07:05:22Z [load_day 2024-07-20] 2024-07-20 hour 20: 137622 events in 0 files, snapshot none (task 3841 ms: download 2015 ms overlapping gunzip 495 ms, parse 2127 ms, sort 0 ms, write 0 ms, index 406 ms: 7 candidates, 53597 repo-hours, 628 releases; waiting 526 ms; commit 0 ms)
2026-11-08T07:05:22Z [load_day 2024-07-20] 2024-07-20 hour 21: 132978 events in 0 files, snapshot none (task 3654 ms: download 1869 ms overlapping gunzip 491 ms, parse 2027 ms, sort 0 ms, write 0 ms, index 364 ms: 2 candidates, 54721 repo-hours, 781 releases; waiting 522 ms; commit 0 ms)
2026-11-08T07:05:26Z [load_day 2024-07-20] 2024-07-20 hour 22: 117342 events in 0 files, snapshot none (task 3317 ms: download 1736 ms overlapping gunzip 429 ms, parse 1830 ms, sort 0 ms, write 0 ms, index 317 ms: 5 candidates, 44136 repo-hours, 828 releases; waiting 519 ms; commit 0 ms)
2026-11-08T07:05:26Z [load_day 2024-07-20] 2024-07-20 hour 23: 111951 events in 0 files, snapshot none (task 3356 ms: download 1695 ms overlapping gunzip 410 ms, parse 1813 ms, sort 0 ms, write 0 ms, index 346 ms: 5 candidates, 42117 repo-hours, 574 releases; waiting 514 ms; commit 0 ms)
2026-11-08T07:05:33Z [load_day 2024-07-20] 2024-07-20: repo_hour merged from 24 files to 1 (1572099 rows, 6984 ms)
2026-11-08T07:05:36Z [load_day 2024-07-20] 2024-07-20: index committed in 9653 ms (24 + 1 + 24 files)
2026-11-08T07:05:36Z [load_day 2024-07-20] 2024-07-20: 3616185 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:05:36Z [load_day 2024-07-20] attempt 1 succeeded