orcaLog in

Runs · run 2234

load_day 2024-03-24, attempt 1 succeeded

Host
73ccef5e07c2:101310
Started
2026-11-08T05:17:22Z
Ended
2026-11-08T05:18:48Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
666 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
109.9 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2234/load_day/2024-03-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:17:22Z [load_day 2024-03-24] attempt 1 started
2026-11-08T05:17:23Z [load_day 2024-03-24] 2024-03-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:17:29Z [load_day 2024-03-24] 2024-03-24 hour 0: 148418 events in 0 files, snapshot none (task 5503 ms: download 2791 ms overlapping gunzip 737 ms, parse 3219 ms, sort 0 ms, write 0 ms, index 771 ms: 4 candidates, 76546 repo-hours, 1064 releases; waiting 490 ms; commit 0 ms)
2026-11-08T05:17:30Z [load_day 2024-03-24] 2024-03-24 hour 1: 155270 events in 0 files, snapshot none (task 6052 ms: download 2591 ms overlapping gunzip 833 ms, parse 3694 ms, sort 0 ms, write 0 ms, index 729 ms: 1 candidates, 85281 repo-hours, 757 releases; waiting 494 ms; commit 0 ms)
2026-11-08T05:17:34Z [load_day 2024-03-24] 2024-03-24 hour 2: 119260 events in 0 files, snapshot none (task 4757 ms: download 3170 ms overlapping gunzip 510 ms, parse 1999 ms, sort 0 ms, write 0 ms, index 834 ms: 3 candidates, 47690 repo-hours, 645 releases; waiting 1006 ms; commit 0 ms)
2026-11-08T05:17:34Z [load_day 2024-03-24] 2024-03-24 hour 3: 119284 events in 0 files, snapshot none (task 4166 ms: download 1870 ms overlapping gunzip 430 ms, parse 1912 ms, sort 0 ms, write 0 ms, index 1040 ms: 2 candidates, 46554 repo-hours, 763 releases; waiting 514 ms; commit 0 ms)
2026-11-08T05:17:42Z [load_day 2024-03-24] 2024-03-24 hour 4: 121337 events in 0 files, snapshot none (task 4660 ms: download 2209 ms overlapping gunzip 634 ms, parse 2832 ms, sort 0 ms, write 0 ms, index 425 ms: 3 candidates, 47542 repo-hours, 555 releases; waiting 516 ms; commit 0 ms)
2026-11-08T05:17:42Z [load_day 2024-03-24] 2024-03-24 hour 5: 123197 events in 0 files, snapshot none (task 4308 ms: download 2020 ms overlapping gunzip 610 ms, parse 2515 ms, sort 0 ms, write 0 ms, index 473 ms: 2 candidates, 49648 repo-hours, 573 releases; waiting 490 ms; commit 0 ms)
2026-11-08T05:17:47Z [load_day 2024-03-24] 2024-03-24 hour 6: 139825 events in 0 files, snapshot none (task 4028 ms: download 1773 ms overlapping gunzip 446 ms, parse 1929 ms, sort 0 ms, write 0 ms, index 854 ms: 1 candidates, 58285 repo-hours, 619 releases; waiting 502 ms; commit 0 ms)
2026-11-08T05:17:47Z [load_day 2024-03-24] 2024-03-24 hour 7: 134495 events in 0 files, snapshot none (task 4269 ms: download 2340 ms overlapping gunzip 547 ms, parse 2266 ms, sort 0 ms, write 0 ms, index 592 ms: 7 candidates, 53588 repo-hours, 531 releases; waiting 511 ms; commit 0 ms)
2026-11-08T05:17:52Z [load_day 2024-03-24] 2024-03-24 hour 8: 143070 events in 0 files, snapshot none (task 4502 ms: download 2550 ms overlapping gunzip 596 ms, parse 2580 ms, sort 0 ms, write 0 ms, index 487 ms: 3 candidates, 58418 repo-hours, 632 releases; waiting 445 ms; commit 0 ms)
2026-11-08T05:17:52Z [load_day 2024-03-24] 2024-03-24 hour 9: 149528 events in 0 files, snapshot none (task 4755 ms: download 2682 ms overlapping gunzip 705 ms, parse 2834 ms, sort 0 ms, write 0 ms, index 427 ms: 5 candidates, 59397 repo-hours, 795 releases; waiting 523 ms; commit 0 ms)
2026-11-08T05:17:58Z [load_day 2024-03-24] 2024-03-24 hour 10: 157542 events in 0 files, snapshot none (task 6097 ms: download 2864 ms overlapping gunzip 902 ms, parse 3819 ms, sort 0 ms, write 0 ms, index 609 ms: 7 candidates, 63401 repo-hours, 674 releases; waiting 548 ms; commit 0 ms)
2026-11-08T05:17:59Z [load_day 2024-03-24] 2024-03-24 hour 11: 155939 events in 0 files, snapshot none (task 6023 ms: download 3066 ms overlapping gunzip 921 ms, parse 3739 ms, sort 0 ms, write 0 ms, index 551 ms: 1 candidates, 61448 repo-hours, 735 releases; waiting 514 ms; commit 0 ms)
2026-11-08T05:18:06Z [load_day 2024-03-24] 2024-03-24 hour 12: 230872 events in 0 files, snapshot none (task 7472 ms: download 3602 ms overlapping gunzip 871 ms, parse 4107 ms, sort 0 ms, write 0 ms, index 1377 ms: 4 candidates, 98267 repo-hours, 861 releases; waiting 767 ms; commit 0 ms)
2026-11-08T05:18:07Z [load_day 2024-03-24] 2024-03-24 hour 13: 198380 events in 0 files, snapshot none (task 7461 ms: download 3574 ms overlapping gunzip 986 ms, parse 4464 ms, sort 0 ms, write 0 ms, index 1155 ms: 5 candidates, 98447 repo-hours, 881 releases; waiting 515 ms; commit 0 ms)
2026-11-08T05:18:13Z [load_day 2024-03-24] 2024-03-24 hour 14: 194486 events in 0 files, snapshot none (task 6637 ms: download 3939 ms overlapping gunzip 987 ms, parse 4113 ms, sort 0 ms, write 0 ms, index 698 ms: 3 candidates, 82189 repo-hours, 841 releases; waiting 521 ms; commit 0 ms)
2026-11-08T05:18:14Z [load_day 2024-03-24] 2024-03-24 hour 15: 192671 events in 0 files, snapshot none (task 6491 ms: download 3533 ms overlapping gunzip 884 ms, parse 3746 ms, sort 0 ms, write 0 ms, index 796 ms: 5 candidates, 77816 repo-hours, 980 releases; waiting 512 ms; commit 0 ms)
2026-11-08T05:18:21Z [load_day 2024-03-24] 2024-03-24 hour 16: 185803 events in 0 files, snapshot none (task 6927 ms: download 3945 ms overlapping gunzip 1000 ms, parse 4312 ms, sort 0 ms, write 0 ms, index 749 ms: 9 candidates, 74455 repo-hours, 911 releases; waiting 517 ms; commit 0 ms)
2026-11-08T05:18:21Z [load_day 2024-03-24] 2024-03-24 hour 17: 180926 events in 0 files, snapshot none (task 6505 ms: download 3652 ms overlapping gunzip 942 ms, parse 4003 ms, sort 0 ms, write 0 ms, index 734 ms: 2 candidates, 70338 repo-hours, 816 releases; waiting 526 ms; commit 0 ms)
2026-11-08T05:18:26Z [load_day 2024-03-24] 2024-03-24 hour 18: 184294 events in 0 files, snapshot none (task 5170 ms: download 2943 ms overlapping gunzip 698 ms, parse 3066 ms, sort 0 ms, write 0 ms, index 538 ms: 4 candidates, 76959 repo-hours, 928 releases; waiting 535 ms; commit 0 ms)
2026-11-08T05:18:26Z [load_day 2024-03-24] 2024-03-24 hour 19: 164972 events in 0 files, snapshot none (task 5101 ms: download 2702 ms overlapping gunzip 770 ms, parse 3199 ms, sort 0 ms, write 0 ms, index 439 ms: 2 candidates, 64096 repo-hours, 785 releases; waiting 383 ms; commit 0 ms)
2026-11-08T05:18:33Z [load_day 2024-03-24] 2024-03-24 hour 20: 169012 events in 0 files, snapshot none (task 6280 ms: download 3741 ms overlapping gunzip 869 ms, parse 3822 ms, sort 0 ms, write 0 ms, index 456 ms: 5 candidates, 64613 repo-hours, 742 releases; waiting 828 ms; commit 0 ms)
2026-11-08T05:18:33Z [load_day 2024-03-24] 2024-03-24 hour 21: 160148 events in 0 files, snapshot none (task 5727 ms: download 3708 ms overlapping gunzip 772 ms, parse 3443 ms, sort 0 ms, write 0 ms, index 500 ms: 1 candidates, 58141 repo-hours, 846 releases; waiting 655 ms; commit 0 ms)
2026-11-08T05:18:38Z [load_day 2024-03-24] 2024-03-24 hour 22: 146999 events in 0 files, snapshot none (task 4194 ms: download 2052 ms overlapping gunzip 549 ms, parse 2361 ms, sort 0 ms, write 0 ms, index 482 ms: 4 candidates, 53204 repo-hours, 768 releases; waiting 531 ms; commit 0 ms)
2026-11-08T05:18:38Z [load_day 2024-03-24] 2024-03-24 hour 23: 142653 events in 0 files, snapshot none (task 4613 ms: download 2249 ms overlapping gunzip 593 ms, parse 2620 ms, sort 0 ms, write 0 ms, index 565 ms: 4 candidates, 52451 repo-hours, 773 releases; waiting 504 ms; commit 0 ms)
2026-11-08T05:18:45Z [load_day 2024-03-24] 2024-03-24: repo_hour merged from 24 files to 1 (1578774 rows, 7089 ms)
2026-11-08T05:18:48Z [load_day 2024-03-24] 2024-03-24: index committed in 9662 ms (24 + 1 + 24 files)
2026-11-08T05:18:48Z [load_day 2024-03-24] 2024-03-24: 3818381 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:18:48Z [load_day 2024-03-24] attempt 1 succeeded