orcaLog in

Runs · run 2427

load_day 2024-05-08, attempt 1 succeeded

Host
73ccef5e07c2:119660
Started
2026-11-08T05:59:43Z
Ended
2026-11-08T06:01:36Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
744 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
180.9 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2427/load_day/2024-05-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:59:43Z [load_day 2024-05-08] attempt 1 started
2026-11-08T05:59:44Z [load_day 2024-05-08] 2024-05-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:59:51Z [load_day 2024-05-08] 2024-05-08 hour 0: 211653 events in 0 files, snapshot none (task 6662 ms: download 3611 ms overlapping gunzip 919 ms, parse 4120 ms, sort 0 ms, write 0 ms, index 797 ms: 9 candidates, 114164 repo-hours, 1132 releases; waiting 502 ms; commit 0 ms)
2026-11-08T05:59:51Z [load_day 2024-05-08] 2024-05-08 hour 1: 188173 events in 0 files, snapshot none (task 6287 ms: download 4029 ms overlapping gunzip 842 ms, parse 3603 ms, sort 0 ms, write 0 ms, index 1006 ms: 9 candidates, 95969 repo-hours, 863 releases; waiting 477 ms; commit 0 ms)
2026-11-08T05:59:58Z [load_day 2024-05-08] 2024-05-08 hour 2: 179715 events in 0 files, snapshot none (task 6554 ms: download 3955 ms overlapping gunzip 974 ms, parse 4280 ms, sort 0 ms, write 0 ms, index 513 ms: 7 candidates, 67099 repo-hours, 744 releases; waiting 504 ms; commit 0 ms)
2026-11-08T05:59:58Z [load_day 2024-05-08] 2024-05-08 hour 3: 168596 events in 0 files, snapshot none (task 6636 ms: download 3758 ms overlapping gunzip 1007 ms, parse 4440 ms, sort 0 ms, write 0 ms, index 670 ms: 7 candidates, 71750 repo-hours, 2777 releases; waiting 209 ms; commit 0 ms)
2026-11-08T06:00:05Z [load_day 2024-05-08] 2024-05-08 hour 4: 157956 events in 0 files, snapshot none (task 6815 ms: download 3629 ms overlapping gunzip 1077 ms, parse 4390 ms, sort 0 ms, write 0 ms, index 543 ms: 6 candidates, 62741 repo-hours, 759 releases; waiting 532 ms; commit 0 ms)
2026-11-08T06:00:07Z [load_day 2024-05-08] 2024-05-08 hour 5: 177463 events in 0 files, snapshot none (task 7697 ms: download 4267 ms overlapping gunzip 1283 ms, parse 4957 ms, sort 0 ms, write 0 ms, index 709 ms: 16 candidates, 69446 repo-hours, 907 releases; waiting 514 ms; commit 0 ms)
2026-11-08T06:00:13Z [load_day 2024-05-08] 2024-05-08 hour 6: 209199 events in 0 files, snapshot none (task 6647 ms: download 3440 ms overlapping gunzip 927 ms, parse 3837 ms, sort 0 ms, write 0 ms, index 1048 ms: 11 candidates, 88258 repo-hours, 957 releases; waiting 548 ms; commit 0 ms)
2026-11-08T06:00:15Z [load_day 2024-05-08] 2024-05-08 hour 7: 209057 events in 0 files, snapshot none (task 7939 ms: download 4731 ms overlapping gunzip 1164 ms, parse 4916 ms, sort 0 ms, write 0 ms, index 1067 ms: 7 candidates, 86308 repo-hours, 1060 releases; waiting 485 ms; commit 0 ms)
2026-11-08T06:00:22Z [load_day 2024-05-08] 2024-05-08 hour 8: 225224 events in 0 files, snapshot none (task 8409 ms: download 5212 ms overlapping gunzip 1241 ms, parse 5171 ms, sort 0 ms, write 0 ms, index 1170 ms: 14 candidates, 95078 repo-hours, 1241 releases; waiting 488 ms; commit 0 ms)
2026-11-08T06:00:24Z [load_day 2024-05-08] 2024-05-08 hour 9: 228224 events in 0 files, snapshot none (task 8462 ms: download 5241 ms overlapping gunzip 1293 ms, parse 5464 ms, sort 0 ms, write 0 ms, index 949 ms: 15 candidates, 98046 repo-hours, 1348 releases; waiting 494 ms; commit 0 ms)
2026-11-08T06:00:31Z [load_day 2024-05-08] 2024-05-08 hour 10: 239287 events in 0 files, snapshot none (task 8208 ms: download 5174 ms overlapping gunzip 1246 ms, parse 5437 ms, sort 0 ms, write 0 ms, index 785 ms: 12 candidates, 87737 repo-hours, 1094 releases; waiting 488 ms; commit 0 ms)
2026-11-08T06:00:33Z [load_day 2024-05-08] 2024-05-08 hour 11: 235919 events in 0 files, snapshot none (task 8536 ms: download 5376 ms overlapping gunzip 1344 ms, parse 5562 ms, sort 0 ms, write 0 ms, index 875 ms: 9 candidates, 85072 repo-hours, 1077 releases; waiting 485 ms; commit 0 ms)
2026-11-08T06:00:39Z [load_day 2024-05-08] 2024-05-08 hour 12: 265117 events in 0 files, snapshot none (task 7694 ms: download 4823 ms overlapping gunzip 1072 ms, parse 4573 ms, sort 0 ms, write 0 ms, index 932 ms: 15 candidates, 121164 repo-hours, 1195 releases; waiting 800 ms; commit 0 ms)
2026-11-08T06:00:42Z [load_day 2024-05-08] 2024-05-08 hour 13: 261528 events in 0 files, snapshot none (task 8491 ms: download 5286 ms overlapping gunzip 1266 ms, parse 5392 ms, sort 0 ms, write 0 ms, index 1019 ms: 8 candidates, 117320 repo-hours, 1256 releases; waiting 537 ms; commit 0 ms)
2026-11-08T06:00:47Z [load_day 2024-05-08] 2024-05-08 hour 14: 260909 events in 0 files, snapshot none (task 7767 ms: download 5247 ms overlapping gunzip 1201 ms, parse 5042 ms, sort 0 ms, write 0 ms, index 742 ms: 16 candidates, 103789 repo-hours, 1291 releases; waiting 522 ms; commit 0 ms)
2026-11-08T06:00:50Z [load_day 2024-05-08] 2024-05-08 hour 15: 252897 events in 0 files, snapshot none (task 7333 ms: download 4710 ms overlapping gunzip 1119 ms, parse 4688 ms, sort 0 ms, write 0 ms, index 745 ms: 12 candidates, 105560 repo-hours, 1241 releases; waiting 514 ms; commit 0 ms)
2026-11-08T06:00:57Z [load_day 2024-05-08] 2024-05-08 hour 16: 234696 events in 0 files, snapshot none (task 9539 ms: download 6342 ms overlapping gunzip 1462 ms, parse 6508 ms, sort 0 ms, write 0 ms, index 797 ms: 12 candidates, 103639 repo-hours, 1156 releases; waiting 522 ms; commit 0 ms)
2026-11-08T06:01:01Z [load_day 2024-05-08] 2024-05-08 hour 17: 228205 events in 0 files, snapshot none (task 10423 ms: download 7158 ms overlapping gunzip 1763 ms, parse 7014 ms, sort 0 ms, write 0 ms, index 834 ms: 12 candidates, 88919 repo-hours, 1101 releases; waiting 455 ms; commit 0 ms)
2026-11-08T06:01:06Z [load_day 2024-05-08] 2024-05-08 hour 18: 237848 events in 0 files, snapshot none (task 8520 ms: download 6082 ms overlapping gunzip 1343 ms, parse 5739 ms, sort 0 ms, write 0 ms, index 728 ms: 17 candidates, 97426 repo-hours, 1176 releases; waiting 503 ms; commit 0 ms)
2026-11-08T06:01:09Z [load_day 2024-05-08] 2024-05-08 hour 19: 204027 events in 0 files, snapshot none (task 7970 ms: download 4433 ms overlapping gunzip 1129 ms, parse 4652 ms, sort 0 ms, write 0 ms, index 1411 ms: 12 candidates, 80029 repo-hours, 1015 releases; waiting 471 ms; commit 0 ms)
2026-11-08T06:01:15Z [load_day 2024-05-08] 2024-05-08 hour 20: 214658 events in 0 files, snapshot none (task 7974 ms: download 4861 ms overlapping gunzip 1170 ms, parse 5088 ms, sort 0 ms, write 0 ms, index 961 ms: 12 candidates, 77028 repo-hours, 1127 releases; waiting 540 ms; commit 0 ms)
2026-11-08T06:01:17Z [load_day 2024-05-08] 2024-05-08 hour 21: 209518 events in 0 files, snapshot none (task 6869 ms: download 3922 ms overlapping gunzip 1045 ms, parse 4171 ms, sort 0 ms, write 0 ms, index 852 ms: 7 candidates, 74271 repo-hours, 1081 releases; waiting 509 ms; commit 0 ms)
2026-11-08T06:01:21Z [load_day 2024-05-08] 2024-05-08 hour 22: 181789 events in 0 files, snapshot none (task 6393 ms: download 3537 ms overlapping gunzip 1045 ms, parse 4087 ms, sort 0 ms, write 0 ms, index 491 ms: 6 candidates, 64702 repo-hours, 981 releases; waiting 414 ms; commit 0 ms)
2026-11-08T06:01:23Z [load_day 2024-05-08] 2024-05-08 hour 23: 172270 events in 0 files, snapshot none (task 5886 ms: download 3360 ms overlapping gunzip 854 ms, parse 3620 ms, sort 0 ms, write 0 ms, index 628 ms: 19 candidates, 59042 repo-hours, 694 releases; waiting 490 ms; commit 0 ms)
2026-11-08T06:01:33Z [load_day 2024-05-08] 2024-05-08: repo_hour merged from 24 files to 1 (2114557 rows, 9531 ms)
2026-11-08T06:01:36Z [load_day 2024-05-08] 2024-05-08: index committed in 12854 ms (24 + 1 + 24 files)
2026-11-08T06:01:36Z [load_day 2024-05-08] 2024-05-08: 5153928 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:01:36Z [load_day 2024-05-08] attempt 1 succeeded