orcaLog in

Runs · run 2253

load_day 2024-03-29, attempt 1 succeeded

Host
73ccef5e07c2:103026
Started
2026-11-08T05:21:30Z
Ended
2026-11-08T05:23:12Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
741 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
156.4 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2253/load_day/2024-03-29/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:21:30Z [load_day 2024-03-29] attempt 1 started
2026-11-08T05:21:31Z [load_day 2024-03-29] 2024-03-29: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:21:40Z [load_day 2024-03-29] 2024-03-29 hour 0: 213144 events in 0 files, snapshot none (task 8773 ms: download 5893 ms overlapping gunzip 1411 ms, parse 5798 ms, sort 0 ms, write 0 ms, index 723 ms: 13 candidates, 96675 repo-hours, 1120 releases; waiting 546 ms; commit 0 ms)
2026-11-08T05:21:40Z [load_day 2024-03-29] 2024-03-29 hour 1: 208567 events in 0 files, snapshot none (task 8212 ms: download 5051 ms overlapping gunzip 1242 ms, parse 5319 ms, sort 0 ms, write 0 ms, index 837 ms: 10 candidates, 97789 repo-hours, 824 releases; waiting 500 ms; commit 0 ms)
2026-11-08T05:21:48Z [load_day 2024-03-29] 2024-03-29 hour 2: 180989 events in 0 files, snapshot none (task 6809 ms: download 3694 ms overlapping gunzip 1084 ms, parse 4556 ms, sort 0 ms, write 0 ms, index 669 ms: 10 candidates, 63875 repo-hours, 842 releases; waiting 185 ms; commit 0 ms)
2026-11-08T05:21:48Z [load_day 2024-03-29] 2024-03-29 hour 3: 183788 events in 0 files, snapshot none (task 7043 ms: download 4152 ms overlapping gunzip 1135 ms, parse 4631 ms, sort 0 ms, write 0 ms, index 480 ms: 7 candidates, 61071 repo-hours, 916 releases; waiting 498 ms; commit 0 ms)
2026-11-08T05:21:53Z [load_day 2024-03-29] 2024-03-29 hour 4: 168536 events in 0 files, snapshot none (task 5036 ms: download 2683 ms overlapping gunzip 736 ms, parse 3063 ms, sort 0 ms, write 0 ms, index 465 ms: 5 candidates, 55958 repo-hours, 587 releases; waiting 501 ms; commit 0 ms)
2026-11-08T05:21:54Z [load_day 2024-03-29] 2024-03-29 hour 5: 177607 events in 0 files, snapshot none (task 6035 ms: download 3325 ms overlapping gunzip 897 ms, parse 3683 ms, sort 0 ms, write 0 ms, index 610 ms: 5 candidates, 60210 repo-hours, 710 releases; waiting 518 ms; commit 0 ms)
2026-11-08T05:22:01Z [load_day 2024-03-29] 2024-03-29 hour 6: 201993 events in 0 files, snapshot none (task 7220 ms: download 4600 ms overlapping gunzip 1031 ms, parse 4436 ms, sort 0 ms, write 0 ms, index 779 ms: 15 candidates, 75207 repo-hours, 1131 releases; waiting 496 ms; commit 0 ms)
2026-11-08T05:22:02Z [load_day 2024-03-29] 2024-03-29 hour 7: 201633 events in 0 files, snapshot none (task 7166 ms: download 4627 ms overlapping gunzip 1108 ms, parse 4683 ms, sort 0 ms, write 0 ms, index 578 ms: 12 candidates, 71033 repo-hours, 742 releases; waiting 489 ms; commit 0 ms)
2026-11-08T05:22:09Z [load_day 2024-03-29] 2024-03-29 hour 8: 212413 events in 0 files, snapshot none (task 7744 ms: download 4556 ms overlapping gunzip 1135 ms, parse 4915 ms, sort 0 ms, write 0 ms, index 862 ms: 11 candidates, 79058 repo-hours, 897 releases; waiting 515 ms; commit 0 ms)
2026-11-08T05:22:10Z [load_day 2024-03-29] 2024-03-29 hour 9: 217863 events in 0 files, snapshot none (task 7947 ms: download 4898 ms overlapping gunzip 1252 ms, parse 5149 ms, sort 0 ms, write 0 ms, index 570 ms: 10 candidates, 81559 repo-hours, 1125 releases; waiting 521 ms; commit 0 ms)
2026-11-08T05:22:16Z [load_day 2024-03-29] 2024-03-29 hour 10: 210141 events in 0 files, snapshot none (task 6685 ms: download 3613 ms overlapping gunzip 961 ms, parse 4065 ms, sort 0 ms, write 0 ms, index 815 ms: 9 candidates, 77949 repo-hours, 895 releases; waiting 532 ms; commit 0 ms)
2026-11-08T05:22:18Z [load_day 2024-03-29] 2024-03-29 hour 11: 207607 events in 0 files, snapshot none (task 7038 ms: download 3820 ms overlapping gunzip 1072 ms, parse 4359 ms, sort 0 ms, write 0 ms, index 825 ms: 8 candidates, 72047 repo-hours, 934 releases; waiting 524 ms; commit 0 ms)
2026-11-08T05:22:24Z [load_day 2024-03-29] 2024-03-29 hour 12: 268497 events in 0 files, snapshot none (task 7686 ms: download 4724 ms overlapping gunzip 1108 ms, parse 4985 ms, sort 0 ms, write 0 ms, index 871 ms: 16 candidates, 110020 repo-hours, 1075 releases; waiting 468 ms; commit 0 ms)
2026-11-08T05:22:26Z [load_day 2024-03-29] 2024-03-29 hour 13: 237993 events in 0 files, snapshot none (task 7971 ms: download 4797 ms overlapping gunzip 1182 ms, parse 4824 ms, sort 0 ms, write 0 ms, index 1202 ms: 17 candidates, 98823 repo-hours, 1040 releases; waiting 473 ms; commit 0 ms)
2026-11-08T05:22:30Z [load_day 2024-03-29] 2024-03-29 hour 14: 166458 events in 0 files, snapshot none (task 5310 ms: download 2759 ms overlapping gunzip 840 ms, parse 3385 ms, sort 0 ms, write 0 ms, index 598 ms: 8 candidates, 69540 repo-hours, 734 releases; waiting 203 ms; commit 0 ms)
2026-11-08T05:22:35Z [load_day 2024-03-29] 2024-03-29 hour 15: 212546 events in 0 files, snapshot none (task 7979 ms: download 4298 ms overlapping gunzip 1212 ms, parse 5041 ms, sort 0 ms, write 0 ms, index 1009 ms: 12 candidates, 83721 repo-hours, 1110 releases; waiting 461 ms; commit 0 ms)
2026-11-08T05:22:38Z [load_day 2024-03-29] 2024-03-29 hour 16: 226698 events in 0 files, snapshot none (task 7729 ms: download 5070 ms overlapping gunzip 1250 ms, parse 4982 ms, sort 0 ms, write 0 ms, index 738 ms: 13 candidates, 86850 repo-hours, 1019 releases; waiting 504 ms; commit 0 ms)
2026-11-08T05:22:42Z [load_day 2024-03-29] 2024-03-29 hour 17: 215162 events in 0 files, snapshot none (task 6384 ms: download 3864 ms overlapping gunzip 980 ms, parse 3900 ms, sort 0 ms, write 0 ms, index 753 ms: 8 candidates, 79967 repo-hours, 1008 releases; waiting 495 ms; commit 0 ms)
2026-11-08T05:22:45Z [load_day 2024-03-29] 2024-03-29 hour 18: 221925 events in 0 files, snapshot none (task 5961 ms: download 3456 ms overlapping gunzip 935 ms, parse 3805 ms, sort 0 ms, write 0 ms, index 674 ms: 7 candidates, 85063 repo-hours, 1030 releases; waiting 223 ms; commit 0 ms)
2026-11-08T05:22:49Z [load_day 2024-03-29] 2024-03-29 hour 19: 208046 events in 0 files, snapshot none (task 6129 ms: download 3915 ms overlapping gunzip 990 ms, parse 3860 ms, sort 0 ms, write 0 ms, index 546 ms: 9 candidates, 70979 repo-hours, 968 releases; waiting 524 ms; commit 0 ms)
2026-11-08T05:22:51Z [load_day 2024-03-29] 2024-03-29 hour 20: 203393 events in 0 files, snapshot none (task 6073 ms: download 3961 ms overlapping gunzip 878 ms, parse 3458 ms, sort 0 ms, write 0 ms, index 598 ms: 10 candidates, 70403 repo-hours, 813 releases; waiting 794 ms; commit 0 ms)
2026-11-08T05:22:55Z [load_day 2024-03-29] 2024-03-29 hour 21: 189246 events in 0 files, snapshot none (task 6424 ms: download 3655 ms overlapping gunzip 921 ms, parse 3796 ms, sort 0 ms, write 0 ms, index 937 ms: 8 candidates, 61878 repo-hours, 951 releases; waiting 462 ms; commit 0 ms)
2026-11-08T05:22:58Z [load_day 2024-03-29] 2024-03-29 hour 22: 178051 events in 0 files, snapshot none (task 6144 ms: download 3392 ms overlapping gunzip 903 ms, parse 3705 ms, sort 0 ms, write 0 ms, index 706 ms: 10 candidates, 57608 repo-hours, 926 releases; waiting 552 ms; commit 0 ms)
2026-11-08T05:23:01Z [load_day 2024-03-29] 2024-03-29 hour 23: 186706 events in 0 files, snapshot none (task 5236 ms: download 2472 ms overlapping gunzip 666 ms, parse 2960 ms, sort 0 ms, write 0 ms, index 843 ms: 12 candidates, 76737 repo-hours, 772 releases; waiting 518 ms; commit 0 ms)
2026-11-08T05:23:09Z [load_day 2024-03-29] 2024-03-29: repo_hour merged from 24 files to 1 (1844020 rows, 8332 ms)
2026-11-08T05:23:12Z [load_day 2024-03-29] 2024-03-29: index committed in 10614 ms (24 + 1 + 24 files)
2026-11-08T05:23:12Z [load_day 2024-03-29] 2024-03-29: 4899002 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:23:12Z [load_day 2024-03-29] attempt 1 succeeded