orcaLog in

Runs · run 2805

load_day 2024-08-05, attempt 1 succeeded

Host
73ccef5e07c2:159461
Started
2026-11-08T07:18:12Z
Ended
2026-11-08T07:20:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
717 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
192.7 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2805/load_day/2024-08-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:18:12Z [load_day 2024-08-05] attempt 1 started
2026-11-08T07:18:13Z [load_day 2024-08-05] 2024-08-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:18:20Z [load_day 2024-08-05] 2024-08-05 hour 0: 165289 events in 0 files, snapshot none (task 6838 ms: download 4182 ms overlapping gunzip 1021 ms, parse 4306 ms, sort 0 ms, write 0 ms, index 698 ms: 8 candidates, 83311 repo-hours, 1043 releases; waiting 515 ms; commit 0 ms)
2026-11-08T07:18:20Z [load_day 2024-08-05] 2024-08-05 hour 1: 188446 events in 0 files, snapshot none (task 7310 ms: download 4779 ms overlapping gunzip 1111 ms, parse 4701 ms, sort 0 ms, write 0 ms, index 748 ms: 6 candidates, 104133 repo-hours, 873 releases; waiting 479 ms; commit 0 ms)
2026-11-08T07:18:26Z [load_day 2024-08-05] 2024-08-05 hour 2: 171027 events in 0 files, snapshot none (task 5915 ms: download 3603 ms overlapping gunzip 939 ms, parse 3708 ms, sort 0 ms, write 0 ms, index 539 ms: 1 candidates, 78666 repo-hours, 1004 releases; waiting 475 ms; commit 0 ms)
2026-11-08T07:18:28Z [load_day 2024-08-05] 2024-08-05 hour 3: 184911 events in 0 files, snapshot none (task 6940 ms: download 4186 ms overlapping gunzip 1149 ms, parse 4509 ms, sort 0 ms, write 0 ms, index 629 ms: 2 candidates, 75225 repo-hours, 5353 releases; waiting 187 ms; commit 0 ms)
2026-11-08T07:18:33Z [load_day 2024-08-05] 2024-08-05 hour 4: 154806 events in 0 files, snapshot none (task 6744 ms: download 5089 ms overlapping gunzip 957 ms, parse 3714 ms, sort 0 ms, write 0 ms, index 463 ms: 8 candidates, 58872 repo-hours, 775 releases; waiting 1130 ms; commit 0 ms)
2026-11-08T07:18:33Z [load_day 2024-08-05] 2024-08-05 hour 5: 100514 events in 0 files, snapshot none (task 4584 ms: download 2466 ms overlapping gunzip 712 ms, parse 2696 ms, sort 0 ms, write 0 ms, index 426 ms: 6 candidates, 46855 repo-hours, 522 releases; waiting 491 ms; commit 0 ms)
2026-11-08T07:18:40Z [load_day 2024-08-05] 2024-08-05 hour 6: 141859 events in 0 files, snapshot none (task 6584 ms: download 3378 ms overlapping gunzip 1054 ms, parse 4176 ms, sort 0 ms, write 0 ms, index 580 ms: 2 candidates, 65162 repo-hours, 746 releases; waiting 509 ms; commit 0 ms)
2026-11-08T07:18:43Z [load_day 2024-08-05] 2024-08-05 hour 7: 207089 events in 0 files, snapshot none (task 8935 ms: download 6116 ms overlapping gunzip 1491 ms, parse 5751 ms, sort 0 ms, write 0 ms, index 969 ms: 9 candidates, 81288 repo-hours, 935 releases; waiting 367 ms; commit 0 ms)
2026-11-08T07:18:51Z [load_day 2024-08-05] 2024-08-05 hour 8: 219238 events in 0 files, snapshot none (task 10317 ms: download 6572 ms overlapping gunzip 1551 ms, parse 6537 ms, sort 0 ms, write 0 ms, index 1392 ms: 16 candidates, 89977 repo-hours, 1148 releases; waiting 527 ms; commit 0 ms)
2026-11-08T07:18:55Z [load_day 2024-08-05] 2024-08-05 hour 9: 227859 events in 0 files, snapshot none (task 11773 ms: download 8315 ms overlapping gunzip 1907 ms, parse 8374 ms, sort 0 ms, write 0 ms, index 689 ms: 5 candidates, 95546 repo-hours, 1262 releases; waiting 511 ms; commit 0 ms)
2026-11-08T07:19:00Z [load_day 2024-08-05] 2024-08-05 hour 10: 215539 events in 0 files, snapshot none (task 8736 ms: download 6068 ms overlapping gunzip 1488 ms, parse 5711 ms, sort 0 ms, write 0 ms, index 687 ms: 2 candidates, 85605 repo-hours, 1059 releases; waiting 572 ms; commit 0 ms)
2026-11-08T07:19:06Z [load_day 2024-08-05] 2024-08-05 hour 11: 218191 events in 0 files, snapshot none (task 10506 ms: download 7588 ms overlapping gunzip 1613 ms, parse 6671 ms, sort 0 ms, write 0 ms, index 624 ms: 7 candidates, 83084 repo-hours, 1133 releases; waiting 1296 ms; commit 0 ms)
2026-11-08T07:19:10Z [load_day 2024-08-05] 2024-08-05 hour 12: 267597 events in 0 files, snapshot none (task 9289 ms: download 6281 ms overlapping gunzip 1450 ms, parse 6105 ms, sort 0 ms, write 0 ms, index 913 ms: 6 candidates, 128981 repo-hours, 1402 releases; waiting 526 ms; commit 0 ms)
2026-11-08T07:19:15Z [load_day 2024-08-05] 2024-08-05 hour 13: 249463 events in 0 files, snapshot none (task 8259 ms: download 5717 ms overlapping gunzip 1342 ms, parse 5419 ms, sort 0 ms, write 0 ms, index 770 ms: 6 candidates, 112859 repo-hours, 1390 releases; waiting 501 ms; commit 0 ms)
2026-11-08T07:19:20Z [load_day 2024-08-05] 2024-08-05 hour 14: 238916 events in 0 files, snapshot none (task 9272 ms: download 5994 ms overlapping gunzip 1432 ms, parse 5565 ms, sort 0 ms, write 0 ms, index 1405 ms: 6 candidates, 97546 repo-hours, 1274 releases; waiting 543 ms; commit 0 ms)
2026-11-08T07:19:25Z [load_day 2024-08-05] 2024-08-05 hour 15: 244449 events in 0 files, snapshot none (task 9610 ms: download 6469 ms overlapping gunzip 1592 ms, parse 6412 ms, sort 0 ms, write 0 ms, index 862 ms: 4 candidates, 104836 repo-hours, 1487 releases; waiting 433 ms; commit 0 ms)
2026-11-08T07:19:31Z [load_day 2024-08-05] 2024-08-05 hour 16: 223050 events in 0 files, snapshot none (task 10443 ms: download 6018 ms overlapping gunzip 1775 ms, parse 7262 ms, sort 0 ms, write 0 ms, index 855 ms: 5 candidates, 91686 repo-hours, 1165 releases; waiting 304 ms; commit 0 ms)
2026-11-08T07:19:34Z [load_day 2024-08-05] 2024-08-05 hour 17: 214348 events in 0 files, snapshot none (task 7962 ms: download 5413 ms overlapping gunzip 1333 ms, parse 5351 ms, sort 0 ms, write 0 ms, index 656 ms: 2 candidates, 85235 repo-hours, 1045 releases; waiting 403 ms; commit 0 ms)
2026-11-08T07:19:42Z [load_day 2024-08-05] 2024-08-05 hour 18: 232815 events in 0 files, snapshot none (task 10837 ms: download 7775 ms overlapping gunzip 1850 ms, parse 7437 ms, sort 0 ms, write 0 ms, index 744 ms: 7 candidates, 101076 repo-hours, 1198 releases; waiting 508 ms; commit 0 ms)
2026-11-08T07:19:44Z [load_day 2024-08-05] 2024-08-05 hour 19: 209536 events in 0 files, snapshot none (task 10011 ms: download 7619 ms overlapping gunzip 1694 ms, parse 6858 ms, sort 0 ms, write 0 ms, index 636 ms: 8 candidates, 80491 repo-hours, 1038 releases; waiting 518 ms; commit 0 ms)
2026-11-08T07:19:52Z [load_day 2024-08-05] 2024-08-05 hour 20: 204129 events in 0 files, snapshot none (task 8963 ms: download 6013 ms overlapping gunzip 1455 ms, parse 6264 ms, sort 0 ms, write 0 ms, index 622 ms: 6 candidates, 78743 repo-hours, 1062 releases; waiting 288 ms; commit 0 ms)
2026-11-08T07:19:53Z [load_day 2024-08-05] 2024-08-05 hour 21: 197621 events in 0 files, snapshot none (task 8918 ms: download 6388 ms overlapping gunzip 1416 ms, parse 5914 ms, sort 0 ms, write 0 ms, index 783 ms: 5 candidates, 75644 repo-hours, 1111 releases; waiting 530 ms; commit 0 ms)
2026-11-08T07:20:01Z [load_day 2024-08-05] 2024-08-05 hour 22: 177080 events in 0 files, snapshot none (task 8878 ms: download 5965 ms overlapping gunzip 1476 ms, parse 5930 ms, sort 0 ms, write 0 ms, index 529 ms: 7 candidates, 63341 repo-hours, 1108 releases; waiting 527 ms; commit 0 ms)
2026-11-08T07:20:02Z [load_day 2024-08-05] 2024-08-05 hour 23: 164691 events in 0 files, snapshot none (task 7885 ms: download 5375 ms overlapping gunzip 1318 ms, parse 5355 ms, sort 0 ms, write 0 ms, index 443 ms: 6 candidates, 59935 repo-hours, 856 releases; waiting 479 ms; commit 0 ms)
2026-11-08T07:20:11Z [load_day 2024-08-05] 2024-08-05: repo_hour merged from 24 files to 1 (2028097 rows, 8948 ms)
2026-11-08T07:20:13Z [load_day 2024-08-05] 2024-08-05: index committed in 11417 ms (24 + 1 + 24 files)
2026-11-08T07:20:13Z [load_day 2024-08-05] 2024-08-05: 4818463 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:20:13Z [load_day 2024-08-05] attempt 1 succeeded