orcaLog in

Runs · run 3152

load_day 2024-11-01, attempt 1 succeeded

Host
73ccef5e07c2:200930
Started
2026-11-08T08:36:13Z
Ended
2026-11-08T08:37:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
716 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
158.5 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3152/load_day/2024-11-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:36:13Z [load_day 2024-11-01] attempt 1 started
2026-11-08T08:36:13Z [load_day 2024-11-01] 2024-11-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:36:21Z [load_day 2024-11-01] 2024-11-01 hour 0: 197569 events in 0 files, snapshot none (task 7375 ms: download 4238 ms overlapping gunzip 1249 ms, parse 4438 ms, sort 0 ms, write 0 ms, index 791 ms: 8 candidates, 88410 repo-hours, 1381 releases; waiting 528 ms; commit 0 ms)
2026-11-08T08:36:22Z [load_day 2024-11-01] 2024-11-01 hour 1: 224064 events in 0 files, snapshot none (task 7681 ms: download 4468 ms overlapping gunzip 1193 ms, parse 4686 ms, sort 0 ms, write 0 ms, index 1043 ms: 7 candidates, 116834 repo-hours, 1082 releases; waiting 537 ms; commit 0 ms)
2026-11-08T08:36:28Z [load_day 2024-11-01] 2024-11-01 hour 2: 185247 events in 0 files, snapshot none (task 5969 ms: download 3033 ms overlapping gunzip 954 ms, parse 3394 ms, sort 0 ms, write 0 ms, index 731 ms: 15 candidates, 78529 repo-hours, 1204 releases; waiting 545 ms; commit 0 ms)
2026-11-08T08:36:28Z [load_day 2024-11-01] 2024-11-01 hour 3: 206219 events in 0 files, snapshot none (task 6139 ms: download 3548 ms overlapping gunzip 956 ms, parse 3575 ms, sort 0 ms, write 0 ms, index 747 ms: 6 candidates, 78395 repo-hours, 4110 releases; waiting 563 ms; commit 0 ms)
2026-11-08T08:36:34Z [load_day 2024-11-01] 2024-11-01 hour 4: 182841 events in 0 files, snapshot none (task 6033 ms: download 3803 ms overlapping gunzip 998 ms, parse 3715 ms, sort 0 ms, write 0 ms, index 472 ms: 4 candidates, 63240 repo-hours, 751 releases; waiting 534 ms; commit 0 ms)
2026-11-08T08:36:34Z [load_day 2024-11-01] 2024-11-01 hour 5: 189413 events in 0 files, snapshot none (task 5729 ms: download 3578 ms overlapping gunzip 941 ms, parse 3456 ms, sort 0 ms, write 0 ms, index 507 ms: 2 candidates, 66261 repo-hours, 909 releases; waiting 533 ms; commit 0 ms)
2026-11-08T08:36:42Z [load_day 2024-11-01] 2024-11-01 hour 6: 205463 events in 0 files, snapshot none (task 6988 ms: download 4413 ms overlapping gunzip 1169 ms, parse 4385 ms, sort 0 ms, write 0 ms, index 606 ms: 5 candidates, 85606 repo-hours, 1007 releases; waiting 504 ms; commit 0 ms)
2026-11-08T08:36:42Z [load_day 2024-11-01] 2024-11-01 hour 7: 198165 events in 0 files, snapshot none (task 7163 ms: download 4905 ms overlapping gunzip 1290 ms, parse 4536 ms, sort 0 ms, write 0 ms, index 523 ms: 6 candidates, 71661 repo-hours, 910 releases; waiting 524 ms; commit 0 ms)
2026-11-08T08:36:50Z [load_day 2024-11-01] 2024-11-01 hour 8: 208070 events in 0 files, snapshot none (task 7410 ms: download 4955 ms overlapping gunzip 1282 ms, parse 4621 ms, sort 0 ms, write 0 ms, index 688 ms: 9 candidates, 81119 repo-hours, 1093 releases; waiting 485 ms; commit 0 ms)
2026-11-08T08:36:50Z [load_day 2024-11-01] 2024-11-01 hour 9: 218585 events in 0 files, snapshot none (task 7769 ms: download 5533 ms overlapping gunzip 1307 ms, parse 5098 ms, sort 0 ms, write 0 ms, index 620 ms: 19 candidates, 86157 repo-hours, 1271 releases; waiting 501 ms; commit 0 ms)
2026-11-08T08:36:56Z [load_day 2024-11-01] 2024-11-01 hour 10: 210730 events in 0 files, snapshot none (task 6270 ms: download 3514 ms overlapping gunzip 1094 ms, parse 3782 ms, sort 0 ms, write 0 ms, index 773 ms: 10 candidates, 81122 repo-hours, 1144 releases; waiting 320 ms; commit 0 ms)
2026-11-08T08:36:58Z [load_day 2024-11-01] 2024-11-01 hour 11: 214306 events in 0 files, snapshot none (task 7372 ms: download 4600 ms overlapping gunzip 1165 ms, parse 4161 ms, sort 0 ms, write 0 ms, index 566 ms: 16 candidates, 75966 repo-hours, 1007 releases; waiting 566 ms; commit 0 ms)
2026-11-08T08:37:03Z [load_day 2024-11-01] 2024-11-01 hour 12: 258618 events in 0 files, snapshot none (task 5921 ms: download 3191 ms overlapping gunzip 898 ms, parse 3661 ms, sort 0 ms, write 0 ms, index 860 ms: 12 candidates, 124821 repo-hours, 1268 releases; waiting 217 ms; commit 0 ms)
2026-11-08T08:37:06Z [load_day 2024-11-01] 2024-11-01 hour 13: 249381 events in 0 files, snapshot none (task 7425 ms: download 5706 ms overlapping gunzip 1148 ms, parse 4001 ms, sort 0 ms, write 0 ms, index 811 ms: 11 candidates, 106868 repo-hours, 1318 releases; waiting 1193 ms; commit 0 ms)
2026-11-08T08:37:10Z [load_day 2024-11-01] 2024-11-01 hour 14: 244054 events in 0 files, snapshot none (task 6845 ms: download 4457 ms overlapping gunzip 1180 ms, parse 4133 ms, sort 0 ms, write 0 ms, index 786 ms: 10 candidates, 92818 repo-hours, 1332 releases; waiting 472 ms; commit 0 ms)
2026-11-08T08:37:13Z [load_day 2024-11-01] 2024-11-01 hour 15: 266931 events in 0 files, snapshot none (task 6786 ms: download 4050 ms overlapping gunzip 1043 ms, parse 3647 ms, sort 0 ms, write 0 ms, index 1165 ms: 13 candidates, 129177 repo-hours, 1349 releases; waiting 625 ms; commit 0 ms)
2026-11-08T08:37:18Z [load_day 2024-11-01] 2024-11-01 hour 16: 237172 events in 0 files, snapshot none (task 7720 ms: download 5003 ms overlapping gunzip 1296 ms, parse 4828 ms, sort 0 ms, write 0 ms, index 769 ms: 14 candidates, 91028 repo-hours, 1358 releases; waiting 558 ms; commit 0 ms)
2026-11-08T08:37:23Z [load_day 2024-11-01] 2024-11-01 hour 17: 231929 events in 0 files, snapshot none (task 8612 ms: download 4651 ms overlapping gunzip 1249 ms, parse 4731 ms, sort 0 ms, write 0 ms, index 2097 ms: 7 candidates, 83720 repo-hours, 1128 releases; waiting 310 ms; commit 0 ms)
2026-11-08T08:37:26Z [load_day 2024-11-01] 2024-11-01 hour 18: 235977 events in 0 files, snapshot none (task 7099 ms: download 4686 ms overlapping gunzip 1182 ms, parse 4334 ms, sort 0 ms, write 0 ms, index 823 ms: 13 candidates, 95665 repo-hours, 1197 releases; waiting 504 ms; commit 0 ms)
2026-11-08T08:37:33Z [load_day 2024-11-01] 2024-11-01 hour 19: 218023 events in 0 files, snapshot none (task 8868 ms: download 6117 ms overlapping gunzip 1583 ms, parse 5683 ms, sort 0 ms, write 0 ms, index 644 ms: 7 candidates, 77472 repo-hours, 1087 releases; waiting 616 ms; commit 0 ms)
2026-11-08T08:37:34Z [load_day 2024-11-01] 2024-11-01 hour 20: 206360 events in 0 files, snapshot none (task 7624 ms: download 5069 ms overlapping gunzip 1292 ms, parse 4927 ms, sort 0 ms, write 0 ms, index 626 ms: 7 candidates, 73529 repo-hours, 1017 releases; waiting 440 ms; commit 0 ms)
2026-11-08T08:37:41Z [load_day 2024-11-01] 2024-11-01 hour 21: 203964 events in 0 files, snapshot none (task 7337 ms: download 5023 ms overlapping gunzip 1184 ms, parse 4551 ms, sort 0 ms, write 0 ms, index 796 ms: 23 candidates, 72664 repo-hours, 1369 releases; waiting 506 ms; commit 0 ms)
2026-11-08T08:37:41Z [load_day 2024-11-01] 2024-11-01 hour 22: 184745 events in 0 files, snapshot none (task 6066 ms: download 3679 ms overlapping gunzip 1018 ms, parse 3501 ms, sort 0 ms, write 0 ms, index 746 ms: 22 candidates, 62065 repo-hours, 1254 releases; waiting 479 ms; commit 0 ms)
2026-11-08T08:37:46Z [load_day 2024-11-01] 2024-11-01 hour 23: 175925 events in 0 files, snapshot none (task 4692 ms: download 2706 ms overlapping gunzip 755 ms, parse 2775 ms, sort 0 ms, write 0 ms, index 452 ms: 5 candidates, 62523 repo-hours, 880 releases; waiting 498 ms; commit 0 ms)
2026-11-08T08:37:56Z [load_day 2024-11-01] 2024-11-01: repo_hour merged from 24 files to 1 (2045650 rows, 9592 ms)
2026-11-08T08:37:58Z [load_day 2024-11-01] 2024-11-01: index committed in 11705 ms (24 + 1 + 24 files)
2026-11-08T08:37:58Z [load_day 2024-11-01] 2024-11-01: 5153751 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:37:58Z [load_day 2024-11-01] attempt 1 succeeded