orcaLog in

Runs · run 3939

load_day 2025-05-23, attempt 1 succeeded

Host
73ccef5e07c2:310804
Started
2026-11-08T12:06:29Z
Ended
2026-11-08T12:08:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
779 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
188.6 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3939/load_day/2025-05-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:06:29Z [load_day 2025-05-23] attempt 1 started
2026-11-08T12:06:30Z [load_day 2025-05-23] 2025-05-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:06:39Z [load_day 2025-05-23] 2025-05-23 hour 0: 200297 events in 0 files, snapshot none (task 8426 ms: download 5552 ms overlapping gunzip 1272 ms, parse 5491 ms, sort 0 ms, write 0 ms, index 898 ms: 13 candidates, 93436 repo-hours, 1363 releases; waiting 441 ms; commit 0 ms)
2026-11-08T12:06:39Z [load_day 2025-05-23] 2025-05-23 hour 1: 231712 events in 0 files, snapshot none (task 8702 ms: download 5550 ms overlapping gunzip 1335 ms, parse 5544 ms, sort 0 ms, write 0 ms, index 980 ms: 13 candidates, 126469 repo-hours, 1070 releases; waiting 465 ms; commit 0 ms)
2026-11-08T12:06:47Z [load_day 2025-05-23] 2025-05-23 hour 2: 206116 events in 0 files, snapshot none (task 8040 ms: download 5325 ms overlapping gunzip 1222 ms, parse 5437 ms, sort 0 ms, write 0 ms, index 681 ms: 4 candidates, 92655 repo-hours, 1056 releases; waiting 375 ms; commit 0 ms)
2026-11-08T12:06:48Z [load_day 2025-05-23] 2025-05-23 hour 3: 211641 events in 0 files, snapshot none (task 8166 ms: download 5529 ms overlapping gunzip 1201 ms, parse 5452 ms, sort 0 ms, write 0 ms, index 653 ms: 3 candidates, 89764 repo-hours, 3009 releases; waiting 511 ms; commit 0 ms)
2026-11-08T12:06:56Z [load_day 2025-05-23] 2025-05-23 hour 4: 193066 events in 0 files, snapshot none (task 8078 ms: download 5364 ms overlapping gunzip 1291 ms, parse 5499 ms, sort 0 ms, write 0 ms, index 591 ms: 14 candidates, 78504 repo-hours, 949 releases; waiting 395 ms; commit 0 ms)
2026-11-08T12:06:57Z [load_day 2025-05-23] 2025-05-23 hour 5: 196895 events in 0 files, snapshot none (task 8232 ms: download 5645 ms overlapping gunzip 1332 ms, parse 5514 ms, sort 0 ms, write 0 ms, index 563 ms: 4 candidates, 80368 repo-hours, 1026 releases; waiting 484 ms; commit 0 ms)
2026-11-08T12:07:04Z [load_day 2025-05-23] 2025-05-23 hour 6: 224827 events in 0 files, snapshot none (task 7747 ms: download 5497 ms overlapping gunzip 1183 ms, parse 4832 ms, sort 0 ms, write 0 ms, index 764 ms: 9 candidates, 102625 repo-hours, 1187 releases; waiting 640 ms; commit 0 ms)
2026-11-08T12:07:05Z [load_day 2025-05-23] 2025-05-23 hour 7: 229136 events in 0 files, snapshot none (task 8192 ms: download 5425 ms overlapping gunzip 1297 ms, parse 5256 ms, sort 0 ms, write 0 ms, index 670 ms: 5 candidates, 96552 repo-hours, 1275 releases; waiting 511 ms; commit 0 ms)
2026-11-08T12:07:14Z [load_day 2025-05-23] 2025-05-23 hour 8: 245433 events in 0 files, snapshot none (task 8959 ms: download 5924 ms overlapping gunzip 1343 ms, parse 5816 ms, sort 0 ms, write 0 ms, index 861 ms: 5 candidates, 107720 repo-hours, 1388 releases; waiting 631 ms; commit 0 ms)
2026-11-08T12:07:15Z [load_day 2025-05-23] 2025-05-23 hour 9: 255519 events in 0 files, snapshot none (task 8662 ms: download 5605 ms overlapping gunzip 1346 ms, parse 5560 ms, sort 0 ms, write 0 ms, index 1223 ms: 4 candidates, 110628 repo-hours, 1704 releases; waiting 239 ms; commit 0 ms)
2026-11-08T12:07:25Z [load_day 2025-05-23] 2025-05-23 hour 10: 243845 events in 0 files, snapshot none (task 10361 ms: download 6747 ms overlapping gunzip 1585 ms, parse 6692 ms, sort 0 ms, write 0 ms, index 1049 ms: 9 candidates, 103451 repo-hours, 1298 releases; waiting 709 ms; commit 0 ms)
2026-11-08T12:07:25Z [load_day 2025-05-23] 2025-05-23 hour 11: 244740 events in 0 files, snapshot none (task 10216 ms: download 7375 ms overlapping gunzip 1642 ms, parse 7085 ms, sort 0 ms, write 0 ms, index 725 ms: 16 candidates, 99231 repo-hours, 1414 releases; waiting 477 ms; commit 0 ms)
2026-11-08T12:07:38Z [load_day 2025-05-23] 2025-05-23 hour 12: 279642 events in 0 files, snapshot none (task 12438 ms: download 9338 ms overlapping gunzip 1718 ms, parse 7539 ms, sort 0 ms, write 0 ms, index 1027 ms: 9 candidates, 142882 repo-hours, 1466 releases; waiting 1853 ms; commit 0 ms)
2026-11-08T12:07:38Z [load_day 2025-05-23] 2025-05-23 hour 13: 273006 events in 0 files, snapshot none (task 10883 ms: download 7905 ms overlapping gunzip 1682 ms, parse 7607 ms, sort 0 ms, write 0 ms, index 888 ms: 17 candidates, 130314 repo-hours, 1434 releases; waiting 448 ms; commit 0 ms)
2026-11-08T12:07:49Z [load_day 2025-05-23] 2025-05-23 hour 14: 264147 events in 0 files, snapshot none (task 10393 ms: download 7541 ms overlapping gunzip 1729 ms, parse 7083 ms, sort 0 ms, write 0 ms, index 827 ms: 14 candidates, 112694 repo-hours, 1504 releases; waiting 460 ms; commit 0 ms)
2026-11-08T12:07:49Z [load_day 2025-05-23] 2025-05-23 hour 15: 262958 events in 0 files, snapshot none (task 10324 ms: download 7269 ms overlapping gunzip 1622 ms, parse 7204 ms, sort 0 ms, write 0 ms, index 958 ms: 15 candidates, 115660 repo-hours, 1553 releases; waiting 295 ms; commit 0 ms)
2026-11-08T12:07:58Z [load_day 2025-05-23] 2025-05-23 hour 16: 213245 events in 0 files, snapshot none (task 8779 ms: download 6112 ms overlapping gunzip 1358 ms, parse 5865 ms, sort 0 ms, write 0 ms, index 741 ms: 14 candidates, 95311 repo-hours, 1088 releases; waiting 510 ms; commit 0 ms)
2026-11-08T12:07:58Z [load_day 2025-05-23] 2025-05-23 hour 17: 155678 events in 0 files, snapshot none (task 7027 ms: download 4357 ms overlapping gunzip 1095 ms, parse 4537 ms, sort 0 ms, write 0 ms, index 599 ms: 15 candidates, 74012 repo-hours, 799 releases; waiting 488 ms; commit 0 ms)
2026-11-08T12:08:04Z [load_day 2025-05-23] 2025-05-23 hour 18: 170048 events in 0 files, snapshot none (task 5922 ms: download 3218 ms overlapping gunzip 849 ms, parse 3529 ms, sort 0 ms, write 0 ms, index 674 ms: 6 candidates, 74938 repo-hours, 624 releases; waiting 549 ms; commit 0 ms)
2026-11-08T12:08:05Z [load_day 2025-05-23] 2025-05-23 hour 19: 151290 events in 0 files, snapshot none (task 6389 ms: download 3799 ms overlapping gunzip 968 ms, parse 3944 ms, sort 0 ms, write 0 ms, index 662 ms: 10 candidates, 69489 repo-hours, 807 releases; waiting 515 ms; commit 0 ms)
2026-11-08T12:08:11Z [load_day 2025-05-23] 2025-05-23 hour 20: 149990 events in 0 files, snapshot none (task 6366 ms: download 3600 ms overlapping gunzip 941 ms, parse 3901 ms, sort 0 ms, write 0 ms, index 580 ms: 4 candidates, 68018 repo-hours, 791 releases; waiting 572 ms; commit 0 ms)
2026-11-08T12:08:12Z [load_day 2025-05-23] 2025-05-23 hour 21: 145424 events in 0 files, snapshot none (task 6338 ms: download 3564 ms overlapping gunzip 930 ms, parse 4023 ms, sort 0 ms, write 0 ms, index 485 ms: 4 candidates, 63239 repo-hours, 877 releases; waiting 537 ms; commit 0 ms)
2026-11-08T12:08:18Z [load_day 2025-05-23] 2025-05-23 hour 22: 141480 events in 0 files, snapshot none (task 6312 ms: download 3779 ms overlapping gunzip 862 ms, parse 3559 ms, sort 0 ms, write 0 ms, index 477 ms: 7 candidates, 59872 repo-hours, 948 releases; waiting 1029 ms; commit 0 ms)
2026-11-08T12:08:18Z [load_day 2025-05-23] 2025-05-23 hour 23: 134794 events in 0 files, snapshot none (task 5905 ms: download 3269 ms overlapping gunzip 879 ms, parse 3722 ms, sort 0 ms, write 0 ms, index 481 ms: 8 candidates, 55414 repo-hours, 955 releases; waiting 505 ms; commit 0 ms)
2026-11-08T12:08:28Z [load_day 2025-05-23] 2025-05-23: repo_hour merged from 24 files to 1 (2243246 rows, 9525 ms)
2026-11-08T12:08:30Z [load_day 2025-05-23] 2025-05-23: index committed in 12140 ms (24 + 1 + 24 files)
2026-11-08T12:08:30Z [load_day 2025-05-23] 2025-05-23: 5024929 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:08:30Z [load_day 2025-05-23] attempt 1 succeeded