orcaLog in

Runs · run 2956

load_day 2024-09-13, attempt 1 succeeded

Host
73ccef5e07c2:177059
Started
2026-11-08T07:54:09Z
Ended
2026-11-08T07:56:03Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
712 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
173.5 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2956/load_day/2024-09-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:54:09Z [load_day 2024-09-13] attempt 1 started
2026-11-08T07:54:10Z [load_day 2024-09-13] 2024-09-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:54:18Z [load_day 2024-09-13] 2024-09-13 hour 0: 190040 events in 0 files, snapshot none (task 7057 ms: download 4326 ms overlapping gunzip 1047 ms, parse 4469 ms, sort 0 ms, write 0 ms, index 679 ms: 7 candidates, 93140 repo-hours, 1197 releases; waiting 515 ms; commit 0 ms)
2026-11-08T07:54:19Z [load_day 2024-09-13] 2024-09-13 hour 1: 198172 events in 0 files, snapshot none (task 7396 ms: download 5497 ms overlapping gunzip 1078 ms, parse 4827 ms, sort 0 ms, write 0 ms, index 757 ms: 3 candidates, 107636 repo-hours, 928 releases; waiting 457 ms; commit 0 ms)
2026-11-08T07:54:26Z [load_day 2024-09-13] 2024-09-13 hour 2: 168801 events in 0 files, snapshot none (task 7224 ms: download 4258 ms overlapping gunzip 1148 ms, parse 4695 ms, sort 0 ms, write 0 ms, index 642 ms: 7 candidates, 77128 repo-hours, 905 releases; waiting 452 ms; commit 0 ms)
2026-11-08T07:54:26Z [load_day 2024-09-13] 2024-09-13 hour 3: 184276 events in 0 files, snapshot none (task 6737 ms: download 3848 ms overlapping gunzip 1039 ms, parse 4312 ms, sort 0 ms, write 0 ms, index 600 ms: 3 candidates, 74352 repo-hours, 3963 releases; waiting 438 ms; commit 0 ms)
2026-11-08T07:54:32Z [load_day 2024-09-13] 2024-09-13 hour 4: 119739 events in 0 files, snapshot none (task 5598 ms: download 2899 ms overlapping gunzip 788 ms, parse 3424 ms, sort 0 ms, write 0 ms, index 565 ms: 0 candidates, 50312 repo-hours, 527 releases; waiting 475 ms; commit 0 ms)
2026-11-08T07:54:34Z [load_day 2024-09-13] 2024-09-13 hour 5: 170382 events in 0 files, snapshot none (task 7121 ms: download 4078 ms overlapping gunzip 1049 ms, parse 4649 ms, sort 0 ms, write 0 ms, index 639 ms: 6 candidates, 67885 repo-hours, 941 releases; waiting 525 ms; commit 0 ms)
2026-11-08T07:54:40Z [load_day 2024-09-13] 2024-09-13 hour 6: 208832 events in 0 files, snapshot none (task 7560 ms: download 4307 ms overlapping gunzip 1091 ms, parse 4617 ms, sort 0 ms, write 0 ms, index 966 ms: 9 candidates, 94970 repo-hours, 1037 releases; waiting 495 ms; commit 0 ms)
2026-11-08T07:54:42Z [load_day 2024-09-13] 2024-09-13 hour 7: 212969 events in 0 files, snapshot none (task 7804 ms: download 4717 ms overlapping gunzip 1183 ms, parse 4932 ms, sort 0 ms, write 0 ms, index 810 ms: 11 candidates, 86285 repo-hours, 1004 releases; waiting 588 ms; commit 0 ms)
2026-11-08T07:54:52Z [load_day 2024-09-13] 2024-09-13 hour 8: 224729 events in 0 files, snapshot none (task 10794 ms: download 7996 ms overlapping gunzip 1324 ms, parse 5457 ms, sort 0 ms, write 0 ms, index 773 ms: 7 candidates, 90890 repo-hours, 1207 releases; waiting 2771 ms; commit 0 ms)
2026-11-08T07:54:52Z [load_day 2024-09-13] 2024-09-13 hour 9: 229236 events in 0 files, snapshot none (task 8689 ms: download 5177 ms overlapping gunzip 1387 ms, parse 5700 ms, sort 0 ms, write 0 ms, index 803 ms: 7 candidates, 95972 repo-hours, 1414 releases; waiting 523 ms; commit 0 ms)
2026-11-08T07:55:01Z [load_day 2024-09-13] 2024-09-13 hour 10: 215870 events in 0 files, snapshot none (task 8738 ms: download 6213 ms overlapping gunzip 1179 ms, parse 4889 ms, sort 0 ms, write 0 ms, index 723 ms: 8 candidates, 87172 repo-hours, 1136 releases; waiting 1728 ms; commit 0 ms)
2026-11-08T07:55:01Z [load_day 2024-09-13] 2024-09-13 hour 11: 212737 events in 0 files, snapshot none (task 7403 ms: download 4564 ms overlapping gunzip 1110 ms, parse 4768 ms, sort 0 ms, write 0 ms, index 661 ms: 6 candidates, 82746 repo-hours, 1232 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:55:09Z [load_day 2024-09-13] 2024-09-13 hour 12: 266654 events in 0 files, snapshot none (task 7751 ms: download 4965 ms overlapping gunzip 1131 ms, parse 4910 ms, sort 0 ms, write 0 ms, index 934 ms: 8 candidates, 130431 repo-hours, 1345 releases; waiting 498 ms; commit 0 ms)
2026-11-08T07:55:09Z [load_day 2024-09-13] 2024-09-13 hour 13: 247687 events in 0 files, snapshot none (task 7578 ms: download 4858 ms overlapping gunzip 1131 ms, parse 4737 ms, sort 0 ms, write 0 ms, index 911 ms: 9 candidates, 113257 repo-hours, 1353 releases; waiting 506 ms; commit 0 ms)
2026-11-08T07:55:19Z [load_day 2024-09-13] 2024-09-13 hour 14: 240594 events in 0 files, snapshot none (task 9680 ms: download 6578 ms overlapping gunzip 1620 ms, parse 6521 ms, sort 0 ms, write 0 ms, index 795 ms: 14 candidates, 98442 repo-hours, 1250 releases; waiting 402 ms; commit 0 ms)
2026-11-08T07:55:19Z [load_day 2024-09-13] 2024-09-13 hour 15: 244025 events in 0 files, snapshot none (task 9642 ms: download 6693 ms overlapping gunzip 1513 ms, parse 6640 ms, sort 0 ms, write 0 ms, index 763 ms: 25 candidates, 102798 repo-hours, 1976 releases; waiting 451 ms; commit 0 ms)
2026-11-08T07:55:28Z [load_day 2024-09-13] 2024-09-13 hour 16: 229145 events in 0 files, snapshot none (task 8797 ms: download 5821 ms overlapping gunzip 1362 ms, parse 5720 ms, sort 0 ms, write 0 ms, index 840 ms: 17 candidates, 93587 repo-hours, 1159 releases; waiting 518 ms; commit 0 ms)
2026-11-08T07:55:28Z [load_day 2024-09-13] 2024-09-13 hour 17: 212609 events in 0 files, snapshot none (task 8204 ms: download 5592 ms overlapping gunzip 1237 ms, parse 5402 ms, sort 0 ms, write 0 ms, index 649 ms: 14 candidates, 83215 repo-hours, 1092 releases; waiting 594 ms; commit 0 ms)
2026-11-08T07:55:37Z [load_day 2024-09-13] 2024-09-13 hour 18: 214662 events in 0 files, snapshot none (task 8478 ms: download 5588 ms overlapping gunzip 1249 ms, parse 5520 ms, sort 0 ms, write 0 ms, index 762 ms: 12 candidates, 94694 repo-hours, 1159 releases; waiting 540 ms; commit 0 ms)
2026-11-08T07:55:37Z [load_day 2024-09-13] 2024-09-13 hour 19: 191745 events in 0 files, snapshot none (task 7557 ms: download 5051 ms overlapping gunzip 1257 ms, parse 4776 ms, sort 0 ms, write 0 ms, index 595 ms: 21 candidates, 72856 repo-hours, 988 releases; waiting 587 ms; commit 0 ms)
2026-11-08T07:55:45Z [load_day 2024-09-13] 2024-09-13 hour 20: 183714 events in 0 files, snapshot none (task 7027 ms: download 3866 ms overlapping gunzip 1099 ms, parse 4519 ms, sort 0 ms, write 0 ms, index 549 ms: 14 candidates, 70297 repo-hours, 965 releases; waiting 545 ms; commit 0 ms)
2026-11-08T07:55:45Z [load_day 2024-09-13] 2024-09-13 hour 21: 173271 events in 0 files, snapshot none (task 6375 ms: download 3654 ms overlapping gunzip 909 ms, parse 3761 ms, sort 0 ms, write 0 ms, index 794 ms: 17 candidates, 68496 repo-hours, 1070 releases; waiting 571 ms; commit 0 ms)
2026-11-08T07:55:51Z [load_day 2024-09-13] 2024-09-13 hour 22: 152764 events in 0 files, snapshot none (task 5768 ms: download 3241 ms overlapping gunzip 926 ms, parse 3651 ms, sort 0 ms, write 0 ms, index 403 ms: 14 candidates, 57384 repo-hours, 978 releases; waiting 492 ms; commit 0 ms)
2026-11-08T07:55:51Z [load_day 2024-09-13] 2024-09-13 hour 23: 138558 events in 0 files, snapshot none (task 5631 ms: download 2688 ms overlapping gunzip 873 ms, parse 3509 ms, sort 0 ms, write 0 ms, index 479 ms: 13 candidates, 51794 repo-hours, 845 releases; waiting 486 ms; commit 0 ms)
2026-11-08T07:56:00Z [load_day 2024-09-13] 2024-09-13: repo_hour merged from 24 files to 1 (2045739 rows, 8849 ms)
2026-11-08T07:56:03Z [load_day 2024-09-13] 2024-09-13: index committed in 11674 ms (23 + 1 + 24 files)
2026-11-08T07:56:03Z [load_day 2024-09-13] 2024-09-13: 4831211 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:56:03Z [load_day 2024-09-13] attempt 1 succeeded