orcaLog in

Runs · run 5037

load_day 2026-03-15, attempt 1 succeeded

Host
73ccef5e07c2:455533
Started
2026-11-08T15:35:07Z
Ended
2026-11-08T15:36:06Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
774 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
71.5 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/5037/load_day/2026-03-15/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:35:07Z [load_day 2026-03-15] attempt 1 started
2026-11-08T15:35:08Z [load_day 2026-03-15] 2026-03-15: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:35:13Z [load_day 2026-03-15] 2026-03-15 hour 0: 150403 events in 0 files, snapshot none (task 4313 ms: download 2482 ms overlapping gunzip 711 ms, parse 2120 ms, sort 0 ms, write 0 ms, index 674 ms: 8 candidates, 67667 repo-hours, 1030 releases; waiting 360 ms; commit 0 ms)
2026-11-08T15:35:13Z [load_day 2026-03-15] 2026-03-15 hour 1: 149200 events in 0 files, snapshot none (task 4230 ms: download 2274 ms overlapping gunzip 732 ms, parse 2228 ms, sort 0 ms, write 0 ms, index 695 ms: 9 candidates, 79290 repo-hours, 763 releases; waiting 278 ms; commit 0 ms)
2026-11-08T15:35:18Z [load_day 2026-03-15] 2026-03-15 hour 2: 154595 events in 0 files, snapshot none (task 4596 ms: download 2664 ms overlapping gunzip 657 ms, parse 2045 ms, sort 0 ms, write 0 ms, index 1013 ms: 10 candidates, 83745 repo-hours, 754 releases; waiting 560 ms; commit 0 ms)
2026-11-08T15:35:18Z [load_day 2026-03-15] 2026-03-15 hour 3: 149509 events in 0 files, snapshot none (task 4624 ms: download 2712 ms overlapping gunzip 734 ms, parse 2315 ms, sort 0 ms, write 0 ms, index 671 ms: 8 candidates, 68847 repo-hours, 965 releases; waiting 607 ms; commit 0 ms)
2026-11-08T15:35:23Z [load_day 2026-03-15] 2026-03-15 hour 4: 148558 events in 0 files, snapshot none (task 4330 ms: download 2844 ms overlapping gunzip 538 ms, parse 1578 ms, sort 0 ms, write 0 ms, index 594 ms: 8 candidates, 68114 repo-hours, 1032 releases; waiting 1345 ms; commit 0 ms)
2026-11-08T15:35:23Z [load_day 2026-03-15] 2026-03-15 hour 5: 146614 events in 0 files, snapshot none (task 4186 ms: download 3109 ms overlapping gunzip 565 ms, parse 1512 ms, sort 0 ms, write 0 ms, index 594 ms: 7 candidates, 70831 repo-hours, 1007 releases; waiting 1195 ms; commit 0 ms)
2026-11-08T15:35:27Z [load_day 2026-03-15] 2026-03-15 hour 6: 148386 events in 0 files, snapshot none (task 3955 ms: download 2908 ms overlapping gunzip 485 ms, parse 1455 ms, sort 0 ms, write 0 ms, index 586 ms: 7 candidates, 70481 repo-hours, 989 releases; waiting 1106 ms; commit 0 ms)
2026-11-08T15:35:27Z [load_day 2026-03-15] 2026-03-15 hour 7: 147620 events in 0 files, snapshot none (task 3450 ms: download 2155 ms overlapping gunzip 420 ms, parse 1243 ms, sort 0 ms, write 0 ms, index 643 ms: 7 candidates, 73862 repo-hours, 958 releases; waiting 841 ms; commit 0 ms)
2026-11-08T15:35:31Z [load_day 2026-03-15] 2026-03-15 hour 8: 151315 events in 0 files, snapshot none (task 3219 ms: download 1955 ms overlapping gunzip 425 ms, parse 1244 ms, sort 0 ms, write 0 ms, index 652 ms: 3 candidates, 75358 repo-hours, 988 releases; waiting 529 ms; commit 0 ms)
2026-11-08T15:35:31Z [load_day 2026-03-15] 2026-03-15 hour 9: 154392 events in 0 files, snapshot none (task 3052 ms: download 1928 ms overlapping gunzip 386 ms, parse 1146 ms, sort 0 ms, write 0 ms, index 572 ms: 5 candidates, 77961 repo-hours, 935 releases; waiting 633 ms; commit 0 ms)
2026-11-08T15:35:34Z [load_day 2026-03-15] 2026-03-15 hour 10: 153797 events in 0 files, snapshot none (task 2468 ms: download 899 ms overlapping gunzip 407 ms, parse 1208 ms, sort 0 ms, write 0 ms, index 626 ms: 7 candidates, 78003 repo-hours, 850 releases; waiting 17 ms; commit 0 ms)
2026-11-08T15:35:34Z [load_day 2026-03-15] 2026-03-15 hour 11: 152119 events in 0 files, snapshot none (task 2331 ms: download 652 ms overlapping gunzip 369 ms, parse 1124 ms, sort 0 ms, write 0 ms, index 589 ms: 4 candidates, 75356 repo-hours, 835 releases; waiting 40 ms; commit 0 ms)
2026-11-08T15:35:37Z [load_day 2026-03-15] 2026-03-15 hour 12: 164927 events in 0 files, snapshot none (task 2700 ms: download 553 ms overlapping gunzip 371 ms, parse 1191 ms, sort 0 ms, write 0 ms, index 923 ms: 8 candidates, 96140 repo-hours, 536 releases; waiting 16 ms; commit 0 ms)
2026-11-08T15:35:37Z [load_day 2026-03-15] 2026-03-15 hour 13: 163707 events in 0 files, snapshot none (task 2716 ms: download 652 ms overlapping gunzip 312 ms, parse 1009 ms, sort 0 ms, write 0 ms, index 1164 ms: 6 candidates, 94689 repo-hours, 333 releases; waiting 17 ms; commit 0 ms)
2026-11-08T15:35:41Z [load_day 2026-03-15] 2026-03-15 hour 14: 164840 events in 0 files, snapshot none (task 3265 ms: download 1755 ms overlapping gunzip 342 ms, parse 1102 ms, sort 0 ms, write 0 ms, index 687 ms: 8 candidates, 85604 repo-hours, 408 releases; waiting 675 ms; commit 0 ms)
2026-11-08T15:35:41Z [load_day 2026-03-15] 2026-03-15 hour 15: 157814 events in 0 files, snapshot none (task 2090 ms: download 518 ms overlapping gunzip 264 ms, parse 810 ms, sort 0 ms, write 0 ms, index 792 ms: 12 candidates, 83414 repo-hours, 451 releases; waiting 14 ms; commit 0 ms)
2026-11-08T15:35:44Z [load_day 2026-03-15] 2026-03-15 hour 16: 160659 events in 0 files, snapshot none (task 2281 ms: download 679 ms overlapping gunzip 354 ms, parse 1070 ms, sort 0 ms, write 0 ms, index 628 ms: 6 candidates, 82129 repo-hours, 533 releases; waiting 22 ms; commit 0 ms)
2026-11-08T15:35:44Z [load_day 2026-03-15] 2026-03-15 hour 17: 160344 events in 0 files, snapshot none (task 2286 ms: download 666 ms overlapping gunzip 306 ms, parse 973 ms, sort 0 ms, write 0 ms, index 782 ms: 11 candidates, 83881 repo-hours, 469 releases; waiting 17 ms; commit 0 ms)
2026-11-08T15:35:47Z [load_day 2026-03-15] 2026-03-15 hour 18: 158574 events in 0 files, snapshot none (task 2807 ms: download 1118 ms overlapping gunzip 433 ms, parse 1413 ms, sort 0 ms, write 0 ms, index 727 ms: 8 candidates, 84645 repo-hours, 549 releases; waiting 16 ms; commit 0 ms)
2026-11-08T15:35:47Z [load_day 2026-03-15] 2026-03-15 hour 19: 158886 events in 0 files, snapshot none (task 2664 ms: download 967 ms overlapping gunzip 421 ms, parse 1409 ms, sort 0 ms, write 0 ms, index 597 ms: 8 candidates, 81260 repo-hours, 712 releases; waiting 19 ms; commit 0 ms)
2026-11-08T15:35:51Z [load_day 2026-03-15] 2026-03-15 hour 20: 156148 events in 0 files, snapshot none (task 2952 ms: download 1054 ms overlapping gunzip 521 ms, parse 1307 ms, sort 0 ms, write 0 ms, index 883 ms: 3 candidates, 78333 repo-hours, 717 releases; waiting 11 ms; commit 0 ms)
2026-11-08T15:35:51Z [load_day 2026-03-15] 2026-03-15 hour 21: 154633 events in 0 files, snapshot none (task 3206 ms: download 1138 ms overlapping gunzip 584 ms, parse 1754 ms, sort 0 ms, write 0 ms, index 611 ms: 5 candidates, 73540 repo-hours, 916 releases; waiting 27 ms; commit 0 ms)
2026-11-08T15:35:54Z [load_day 2026-03-15] 2026-03-15 hour 22: 152917 events in 0 files, snapshot none (task 2855 ms: download 910 ms overlapping gunzip 462 ms, parse 1496 ms, sort 0 ms, write 0 ms, index 649 ms: 5 candidates, 74846 repo-hours, 1026 releases; waiting 24 ms; commit 0 ms)
2026-11-08T15:35:55Z [load_day 2026-03-15] 2026-03-15 hour 23: 152544 events in 0 files, snapshot none (task 2857 ms: download 1262 ms overlapping gunzip 537 ms, parse 1510 ms, sort 0 ms, write 0 ms, index 572 ms: 8 candidates, 71629 repo-hours, 1073 releases; waiting 20 ms; commit 0 ms)
2026-11-08T15:36:03Z [load_day 2026-03-15] 2026-03-15: repo_hour merged from 24 files to 1 (1879625 rows, 8225 ms)
2026-11-08T15:36:06Z [load_day 2026-03-15] 2026-03-15: index committed in 11174 ms (24 + 1 + 24 files)
2026-11-08T15:36:06Z [load_day 2026-03-15] 2026-03-15: 3712501 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:36:06Z [load_day 2026-03-15] attempt 1 succeeded