orcaLog in

Runs · run 2590

load_day 2024-06-14, attempt 1 succeeded

Host
73ccef5e07c2:136230
Started
2026-11-08T06:32:14Z
Ended
2026-11-08T06:33:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
696 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
167.8 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2590/load_day/2024-06-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:32:14Z [load_day 2024-06-14] attempt 1 started
2026-11-08T06:32:15Z [load_day 2024-06-14] 2024-06-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:32:22Z [load_day 2024-06-14] 2024-06-14 hour 0: 181372 events in 0 files, snapshot none (task 6558 ms: download 3384 ms overlapping gunzip 1022 ms, parse 4387 ms, sort 0 ms, write 0 ms, index 939 ms: 17 candidates, 91853 repo-hours, 1061 releases; waiting 13 ms; commit 0 ms)
2026-11-08T06:32:22Z [load_day 2024-06-14] 2024-06-14 hour 1: 191361 events in 0 files, snapshot none (task 6399 ms: download 3214 ms overlapping gunzip 908 ms, parse 3991 ms, sort 0 ms, write 0 ms, index 1293 ms: 3 candidates, 104941 repo-hours, 884 releases; waiting 0 ms; commit 0 ms)
2026-11-08T06:32:28Z [load_day 2024-06-14] 2024-06-14 hour 2: 159814 events in 0 files, snapshot none (task 5323 ms: download 2670 ms overlapping gunzip 862 ms, parse 3666 ms, sort 0 ms, write 0 ms, index 573 ms: 13 candidates, 67010 repo-hours, 845 releases; waiting 13 ms; commit 0 ms)
2026-11-08T06:32:29Z [load_day 2024-06-14] 2024-06-14 hour 3: 190390 events in 0 files, snapshot none (task 5978 ms: download 3460 ms overlapping gunzip 973 ms, parse 4214 ms, sort 0 ms, write 0 ms, index 569 ms: 3 candidates, 84469 repo-hours, 5459 releases; waiting 26 ms; commit 0 ms)
2026-11-08T06:32:34Z [load_day 2024-06-14] 2024-06-14 hour 4: 158402 events in 0 files, snapshot none (task 5782 ms: download 3069 ms overlapping gunzip 954 ms, parse 4103 ms, sort 0 ms, write 0 ms, index 524 ms: 6 candidates, 65805 repo-hours, 771 releases; waiting 12 ms; commit 0 ms)
2026-11-08T06:32:35Z [load_day 2024-06-14] 2024-06-14 hour 5: 166986 events in 0 files, snapshot none (task 5785 ms: download 3267 ms overlapping gunzip 982 ms, parse 4054 ms, sort 0 ms, write 0 ms, index 530 ms: 4 candidates, 66704 repo-hours, 936 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:32:40Z [load_day 2024-06-14] 2024-06-14 hour 6: 204028 events in 0 files, snapshot none (task 5386 ms: download 2955 ms overlapping gunzip 883 ms, parse 3626 ms, sort 0 ms, write 0 ms, index 679 ms: 11 candidates, 93958 repo-hours, 949 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:32:42Z [load_day 2024-06-14] 2024-06-14 hour 7: 205067 events in 0 files, snapshot none (task 6009 ms: download 3598 ms overlapping gunzip 1000 ms, parse 4141 ms, sort 0 ms, write 0 ms, index 647 ms: 4 candidates, 83814 repo-hours, 1007 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:32:48Z [load_day 2024-06-14] 2024-06-14 hour 8: 220043 events in 0 files, snapshot none (task 6683 ms: download 3952 ms overlapping gunzip 1051 ms, parse 4464 ms, sort 0 ms, write 0 ms, index 643 ms: 9 candidates, 92448 repo-hours, 1229 releases; waiting 17 ms; commit 0 ms)
2026-11-08T06:32:49Z [load_day 2024-06-14] 2024-06-14 hour 9: 230142 events in 0 files, snapshot none (task 6602 ms: download 4094 ms overlapping gunzip 1083 ms, parse 4565 ms, sort 0 ms, write 0 ms, index 740 ms: 10 candidates, 100990 repo-hours, 1373 releases; waiting 12 ms; commit 0 ms)
2026-11-08T06:32:56Z [load_day 2024-06-14] 2024-06-14 hour 10: 217273 events in 0 files, snapshot none (task 7624 ms: download 5067 ms overlapping gunzip 1287 ms, parse 5484 ms, sort 0 ms, write 0 ms, index 647 ms: 7 candidates, 93846 repo-hours, 1148 releases; waiting 19 ms; commit 0 ms)
2026-11-08T06:32:57Z [load_day 2024-06-14] 2024-06-14 hour 11: 204091 events in 0 files, snapshot none (task 7505 ms: download 4848 ms overlapping gunzip 1210 ms, parse 5377 ms, sort 0 ms, write 0 ms, index 708 ms: 9 candidates, 82257 repo-hours, 1070 releases; waiting 21 ms; commit 0 ms)
2026-11-08T06:33:07Z [load_day 2024-06-14] 2024-06-14 hour 12: 264901 events in 0 files, snapshot none (task 10388 ms: download 6369 ms overlapping gunzip 1570 ms, parse 7130 ms, sort 0 ms, write 0 ms, index 1221 ms: 14 candidates, 126992 repo-hours, 1220 releases; waiting 3 ms; commit 0 ms)
2026-11-08T06:33:08Z [load_day 2024-06-14] 2024-06-14 hour 13: 238126 events in 0 files, snapshot none (task 10428 ms: download 6885 ms overlapping gunzip 1646 ms, parse 7327 ms, sort 0 ms, write 0 ms, index 1221 ms: 14 candidates, 111855 repo-hours, 1280 releases; waiting 14 ms; commit 0 ms)
2026-11-08T06:33:16Z [load_day 2024-06-14] 2024-06-14 hour 14: 225931 events in 0 files, snapshot none (task 9013 ms: download 6220 ms overlapping gunzip 1568 ms, parse 6443 ms, sort 0 ms, write 0 ms, index 761 ms: 3 candidates, 95818 repo-hours, 1278 releases; waiting 31 ms; commit 0 ms)
2026-11-08T06:33:18Z [load_day 2024-06-14] 2024-06-14 hour 15: 227259 events in 0 files, snapshot none (task 9371 ms: download 6164 ms overlapping gunzip 1378 ms, parse 5826 ms, sort 0 ms, write 0 ms, index 1398 ms: 11 candidates, 100377 repo-hours, 1337 releases; waiting 536 ms; commit 0 ms)
2026-11-08T06:33:24Z [load_day 2024-06-14] 2024-06-14 hour 16: 212375 events in 0 files, snapshot none (task 7657 ms: download 4427 ms overlapping gunzip 1216 ms, parse 5229 ms, sort 0 ms, write 0 ms, index 1004 ms: 23 candidates, 87293 repo-hours, 1065 releases; waiting 3 ms; commit 0 ms)
2026-11-08T06:33:26Z [load_day 2024-06-14] 2024-06-14 hour 17: 200894 events in 0 files, snapshot none (task 7728 ms: download 4654 ms overlapping gunzip 1162 ms, parse 4826 ms, sort 0 ms, write 0 ms, index 889 ms: 13 candidates, 80035 repo-hours, 1180 releases; waiting 533 ms; commit 0 ms)
2026-11-08T06:33:32Z [load_day 2024-06-14] 2024-06-14 hour 18: 208225 events in 0 files, snapshot none (task 7019 ms: download 3919 ms overlapping gunzip 1175 ms, parse 4934 ms, sort 0 ms, write 0 ms, index 676 ms: 15 candidates, 92069 repo-hours, 1351 releases; waiting 23 ms; commit 0 ms)
2026-11-08T06:33:33Z [load_day 2024-06-14] 2024-06-14 hour 19: 182327 events in 0 files, snapshot none (task 6515 ms: download 4177 ms overlapping gunzip 1015 ms, parse 4707 ms, sort 0 ms, write 0 ms, index 564 ms: 6 candidates, 69928 repo-hours, 1104 releases; waiting 8 ms; commit 0 ms)
2026-11-08T06:33:38Z [load_day 2024-06-14] 2024-06-14 hour 20: 177603 events in 0 files, snapshot none (task 6017 ms: download 3430 ms overlapping gunzip 985 ms, parse 4294 ms, sort 0 ms, write 0 ms, index 535 ms: 5 candidates, 72131 repo-hours, 1019 releases; waiting 11 ms; commit 0 ms)
2026-11-08T06:33:42Z [load_day 2024-06-14] 2024-06-14 hour 21: 172572 events in 0 files, snapshot none (task 7600 ms: download 4427 ms overlapping gunzip 1219 ms, parse 4907 ms, sort 0 ms, write 0 ms, index 716 ms: 11 candidates, 70446 repo-hours, 1148 releases; waiting 459 ms; commit 0 ms)
2026-11-08T06:33:44Z [load_day 2024-06-14] 2024-06-14 hour 22: 155913 events in 0 files, snapshot none (task 5470 ms: download 2710 ms overlapping gunzip 936 ms, parse 3798 ms, sort 0 ms, write 0 ms, index 543 ms: 6 candidates, 65004 repo-hours, 935 releases; waiting 10 ms; commit 0 ms)
2026-11-08T06:33:47Z [load_day 2024-06-14] 2024-06-14 hour 23: 141430 events in 0 files, snapshot none (task 4631 ms: download 1971 ms overlapping gunzip 784 ms, parse 3144 ms, sort 0 ms, write 0 ms, index 465 ms: 4 candidates, 58709 repo-hours, 686 releases; waiting 12 ms; commit 0 ms)
2026-11-08T06:33:55Z [load_day 2024-06-14] 2024-06-14: repo_hour merged from 24 files to 1 (2058752 rows, 8862 ms)
2026-11-08T06:33:58Z [load_day 2024-06-14] 2024-06-14: index committed in 11059 ms (24 + 1 + 24 files)
2026-11-08T06:33:58Z [load_day 2024-06-14] 2024-06-14: 4736525 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:33:58Z [load_day 2024-06-14] attempt 1 succeeded