orcaLog in

Runs · run 2511

load_day 2024-05-28, attempt 1 succeeded

Host
73ccef5e07c2:128056
Started
2026-11-08T06:17:06Z
Ended
2026-11-08T06:18:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
722 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
175.3 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2511/load_day/2024-05-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:17:06Z [load_day 2024-05-28] attempt 1 started
2026-11-08T06:17:07Z [load_day 2024-05-28] 2024-05-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:17:14Z [load_day 2024-05-28] 2024-05-28 hour 0: 191284 events in 0 files, snapshot none (task 6170 ms: download 3296 ms overlapping gunzip 957 ms, parse 4062 ms, sort 0 ms, write 0 ms, index 759 ms: 14 candidates, 99313 repo-hours, 1095 releases; waiting 182 ms; commit 0 ms)
2026-11-08T06:17:14Z [load_day 2024-05-28] 2024-05-28 hour 1: 200649 events in 0 files, snapshot none (task 6341 ms: download 3717 ms overlapping gunzip 943 ms, parse 3963 ms, sort 0 ms, write 0 ms, index 736 ms: 13 candidates, 109315 repo-hours, 828 releases; waiting 489 ms; commit 0 ms)
2026-11-08T06:17:21Z [load_day 2024-05-28] 2024-05-28 hour 2: 169808 events in 0 files, snapshot none (task 6733 ms: download 3867 ms overlapping gunzip 897 ms, parse 3634 ms, sort 0 ms, write 0 ms, index 670 ms: 12 candidates, 69049 repo-hours, 738 releases; waiting 1288 ms; commit 0 ms)
2026-11-08T06:17:21Z [load_day 2024-05-28] 2024-05-28 hour 3: 192724 events in 0 files, snapshot none (task 6892 ms: download 3433 ms overlapping gunzip 952 ms, parse 4482 ms, sort 0 ms, write 0 ms, index 645 ms: 8 candidates, 75303 repo-hours, 4089 releases; waiting 506 ms; commit 0 ms)
2026-11-08T06:17:28Z [load_day 2024-05-28] 2024-05-28 hour 4: 162026 events in 0 files, snapshot none (task 6439 ms: download 3422 ms overlapping gunzip 993 ms, parse 4180 ms, sort 0 ms, write 0 ms, index 717 ms: 12 candidates, 63456 repo-hours, 667 releases; waiting 214 ms; commit 0 ms)
2026-11-08T06:17:30Z [load_day 2024-05-28] 2024-05-28 hour 5: 180542 events in 0 files, snapshot none (task 7797 ms: download 4706 ms overlapping gunzip 1337 ms, parse 5115 ms, sort 0 ms, write 0 ms, index 581 ms: 19 candidates, 72450 repo-hours, 845 releases; waiting 488 ms; commit 0 ms)
2026-11-08T06:17:38Z [load_day 2024-05-28] 2024-05-28 hour 6: 222529 events in 0 files, snapshot none (task 9073 ms: download 5892 ms overlapping gunzip 1373 ms, parse 5859 ms, sort 0 ms, write 0 ms, index 1119 ms: 14 candidates, 97484 repo-hours, 1031 releases; waiting 522 ms; commit 0 ms)
2026-11-08T06:17:40Z [load_day 2024-05-28] 2024-05-28 hour 7: 221822 events in 0 files, snapshot none (task 9277 ms: download 6118 ms overlapping gunzip 1474 ms, parse 6173 ms, sort 0 ms, write 0 ms, index 821 ms: 20 candidates, 92563 repo-hours, 1077 releases; waiting 505 ms; commit 0 ms)
2026-11-08T06:17:48Z [load_day 2024-05-28] 2024-05-28 hour 8: 237848 events in 0 files, snapshot none (task 9457 ms: download 6012 ms overlapping gunzip 1396 ms, parse 5932 ms, sort 0 ms, write 0 ms, index 1335 ms: 15 candidates, 101065 repo-hours, 1229 releases; waiting 540 ms; commit 0 ms)
2026-11-08T06:17:50Z [load_day 2024-05-28] 2024-05-28 hour 9: 242065 events in 0 files, snapshot none (task 9205 ms: download 6567 ms overlapping gunzip 1521 ms, parse 6166 ms, sort 0 ms, write 0 ms, index 788 ms: 19 candidates, 104431 repo-hours, 1313 releases; waiting 452 ms; commit 0 ms)
2026-11-08T06:17:57Z [load_day 2024-05-28] 2024-05-28 hour 10: 226175 events in 0 files, snapshot none (task 8147 ms: download 4897 ms overlapping gunzip 1302 ms, parse 5711 ms, sort 0 ms, write 0 ms, index 695 ms: 10 candidates, 95334 repo-hours, 1236 releases; waiting 182 ms; commit 0 ms)
2026-11-08T06:17:58Z [load_day 2024-05-28] 2024-05-28 hour 11: 235627 events in 0 files, snapshot none (task 7582 ms: download 5049 ms overlapping gunzip 1207 ms, parse 4928 ms, sort 0 ms, write 0 ms, index 648 ms: 26 candidates, 92921 repo-hours, 1117 releases; waiting 531 ms; commit 0 ms)
2026-11-08T06:18:08Z [load_day 2024-05-28] 2024-05-28 hour 12: 288591 events in 0 files, snapshot none (task 11031 ms: download 6434 ms overlapping gunzip 1478 ms, parse 6672 ms, sort 0 ms, write 0 ms, index 1626 ms: 13 candidates, 135719 repo-hours, 1391 releases; waiting 515 ms; commit 0 ms)
2026-11-08T06:18:08Z [load_day 2024-05-28] 2024-05-28 hour 13: 257090 events in 0 files, snapshot none (task 9696 ms: download 6460 ms overlapping gunzip 1396 ms, parse 6328 ms, sort 0 ms, write 0 ms, index 1235 ms: 9 candidates, 114729 repo-hours, 1121 releases; waiting 489 ms; commit 0 ms)
2026-11-08T06:18:11Z [load_day 2024-05-28] 2024-05-28 hour 14: 122453 events in 0 files, snapshot none (task 2307 ms: download 1052 ms overlapping gunzip 202 ms, parse 1277 ms, sort 0 ms, write 0 ms, index 154 ms: 1 candidates, 12607 repo-hours, 40 releases; waiting 458 ms; commit 0 ms)
2026-11-08T06:18:15Z [load_day 2024-05-28] 2024-05-28 hour 15: 218746 events in 0 files, snapshot none (task 6768 ms: download 3835 ms overlapping gunzip 995 ms, parse 4132 ms, sort 0 ms, write 0 ms, index 896 ms: 18 candidates, 104900 repo-hours, 878 releases; waiting 471 ms; commit 0 ms)
2026-11-08T06:18:20Z [load_day 2024-05-28] 2024-05-28 hour 16: 247188 events in 0 files, snapshot none (task 8547 ms: download 5885 ms overlapping gunzip 1363 ms, parse 5651 ms, sort 0 ms, write 0 ms, index 754 ms: 24 candidates, 106634 repo-hours, 1235 releases; waiting 512 ms; commit 0 ms)
2026-11-08T06:18:23Z [load_day 2024-05-28] 2024-05-28 hour 17: 233913 events in 0 files, snapshot none (task 7033 ms: download 4466 ms overlapping gunzip 1110 ms, parse 4615 ms, sort 0 ms, write 0 ms, index 755 ms: 21 candidates, 95363 repo-hours, 1136 releases; waiting 294 ms; commit 0 ms)
2026-11-08T06:18:28Z [load_day 2024-05-28] 2024-05-28 hour 18: 237233 events in 0 files, snapshot none (task 8148 ms: download 4424 ms overlapping gunzip 1203 ms, parse 4932 ms, sort 0 ms, write 0 ms, index 1273 ms: 13 candidates, 104415 repo-hours, 1286 releases; waiting 509 ms; commit 0 ms)
2026-11-08T06:18:32Z [load_day 2024-05-28] 2024-05-28 hour 19: 215417 events in 0 files, snapshot none (task 8744 ms: download 5631 ms overlapping gunzip 1342 ms, parse 5622 ms, sort 0 ms, write 0 ms, index 928 ms: 21 candidates, 84128 repo-hours, 1210 releases; waiting 536 ms; commit 0 ms)
2026-11-08T06:18:37Z [load_day 2024-05-28] 2024-05-28 hour 20: 213656 events in 0 files, snapshot none (task 8658 ms: download 4718 ms overlapping gunzip 1332 ms, parse 5507 ms, sort 0 ms, write 0 ms, index 1040 ms: 20 candidates, 83183 repo-hours, 1306 releases; waiting 521 ms; commit 0 ms)
2026-11-08T06:18:41Z [load_day 2024-05-28] 2024-05-28 hour 21: 205985 events in 0 files, snapshot none (task 7981 ms: download 5239 ms overlapping gunzip 1282 ms, parse 5304 ms, sort 0 ms, write 0 ms, index 598 ms: 9 candidates, 78081 repo-hours, 1203 releases; waiting 502 ms; commit 0 ms)
2026-11-08T06:18:45Z [load_day 2024-05-28] 2024-05-28 hour 22: 179794 events in 0 files, snapshot none (task 6783 ms: download 3262 ms overlapping gunzip 1014 ms, parse 4204 ms, sort 0 ms, write 0 ms, index 808 ms: 12 candidates, 63761 repo-hours, 1755 releases; waiting 527 ms; commit 0 ms)
2026-11-08T06:18:47Z [load_day 2024-05-28] 2024-05-28 hour 23: 186066 events in 0 files, snapshot none (task 5819 ms: download 3440 ms overlapping gunzip 842 ms, parse 3701 ms, sort 0 ms, write 0 ms, index 525 ms: 8 candidates, 65882 repo-hours, 730 releases; waiting 483 ms; commit 0 ms)
2026-11-08T06:18:56Z [load_day 2024-05-28] 2024-05-28: repo_hour merged from 24 files to 1 (2122086 rows, 8925 ms)
2026-11-08T06:18:58Z [load_day 2024-05-28] 2024-05-28: index committed in 11022 ms (24 + 1 + 24 files)
2026-11-08T06:18:58Z [load_day 2024-05-28] 2024-05-28: 5089231 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:18:58Z [load_day 2024-05-28] attempt 1 succeeded