orcaLog in

Runs · run 2415

load_day 2024-05-06, attempt 1 succeeded

Host
73ccef5e07c2:118388
Started
2026-11-08T05:57:26Z
Ended
2026-11-08T05:59:42Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
776 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
225.5 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2415/load_day/2024-05-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:57:26Z [load_day 2024-05-06] attempt 1 started
2026-11-08T05:57:27Z [load_day 2024-05-06] 2024-05-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:57:34Z [load_day 2024-05-06] 2024-05-06 hour 0: 188510 events in 0 files, snapshot none (task 7105 ms: download 4121 ms overlapping gunzip 1070 ms, parse 4587 ms, sort 0 ms, write 0 ms, index 745 ms: 17 candidates, 86458 repo-hours, 1036 releases; waiting 464 ms; commit 0 ms)
2026-11-08T05:57:36Z [load_day 2024-05-06] 2024-05-06 hour 1: 208097 events in 0 files, snapshot none (task 8736 ms: download 5758 ms overlapping gunzip 1447 ms, parse 5753 ms, sort 0 ms, write 0 ms, index 870 ms: 19 candidates, 99592 repo-hours, 827 releases; waiting 453 ms; commit 0 ms)
2026-11-08T05:57:42Z [load_day 2024-05-06] 2024-05-06 hour 2: 175754 events in 0 files, snapshot none (task 6958 ms: download 4543 ms overlapping gunzip 1106 ms, parse 4439 ms, sort 0 ms, write 0 ms, index 570 ms: 13 candidates, 65008 repo-hours, 798 releases; waiting 542 ms; commit 0 ms)
2026-11-08T05:57:43Z [load_day 2024-05-06] 2024-05-06 hour 3: 199627 events in 0 files, snapshot none (task 7037 ms: download 4382 ms overlapping gunzip 1071 ms, parse 4421 ms, sort 0 ms, write 0 ms, index 594 ms: 8 candidates, 69432 repo-hours, 2638 releases; waiting 569 ms; commit 0 ms)
2026-11-08T05:57:50Z [load_day 2024-05-06] 2024-05-06 hour 4: 191709 events in 0 files, snapshot none (task 7659 ms: download 4490 ms overlapping gunzip 1200 ms, parse 4855 ms, sort 0 ms, write 0 ms, index 546 ms: 9 candidates, 59930 repo-hours, 657 releases; waiting 699 ms; commit 0 ms)
2026-11-08T05:57:51Z [load_day 2024-05-06] 2024-05-06 hour 5: 195442 events in 0 files, snapshot none (task 7180 ms: download 4752 ms overlapping gunzip 1200 ms, parse 4725 ms, sort 0 ms, write 0 ms, index 443 ms: 11 candidates, 65307 repo-hours, 855 releases; waiting 537 ms; commit 0 ms)
2026-11-08T05:57:59Z [load_day 2024-05-06] 2024-05-06 hour 6: 237160 events in 0 files, snapshot none (task 8753 ms: download 6159 ms overlapping gunzip 1463 ms, parse 5830 ms, sort 0 ms, write 0 ms, index 689 ms: 16 candidates, 89329 repo-hours, 985 releases; waiting 492 ms; commit 0 ms)
2026-11-08T05:58:02Z [load_day 2024-05-06] 2024-05-06 hour 7: 234770 events in 0 files, snapshot none (task 9991 ms: download 6943 ms overlapping gunzip 1600 ms, parse 6489 ms, sort 0 ms, write 0 ms, index 1099 ms: 13 candidates, 81847 repo-hours, 1042 releases; waiting 481 ms; commit 0 ms)
2026-11-08T05:58:12Z [load_day 2024-05-06] 2024-05-06 hour 8: 248385 events in 0 files, snapshot none (task 11784 ms: download 7792 ms overlapping gunzip 1849 ms, parse 8101 ms, sort 0 ms, write 0 ms, index 1026 ms: 12 candidates, 89472 repo-hours, 1110 releases; waiting 510 ms; commit 0 ms)
2026-11-08T05:58:14Z [load_day 2024-05-06] 2024-05-06 hour 9: 248768 events in 0 files, snapshot none (task 11453 ms: download 8389 ms overlapping gunzip 1861 ms, parse 8068 ms, sort 0 ms, write 0 ms, index 799 ms: 12 candidates, 95086 repo-hours, 1405 releases; waiting 442 ms; commit 0 ms)
2026-11-08T05:58:24Z [load_day 2024-05-06] 2024-05-06 hour 10: 235457 events in 0 files, snapshot none (task 11577 ms: download 8607 ms overlapping gunzip 1894 ms, parse 8046 ms, sort 0 ms, write 0 ms, index 690 ms: 8 candidates, 88229 repo-hours, 1161 releases; waiting 601 ms; commit 0 ms)
2026-11-08T05:58:25Z [load_day 2024-05-06] 2024-05-06 hour 11: 236363 events in 0 files, snapshot none (task 10491 ms: download 7828 ms overlapping gunzip 1653 ms, parse 7183 ms, sort 0 ms, write 0 ms, index 827 ms: 9 candidates, 85752 repo-hours, 1034 releases; waiting 495 ms; commit 0 ms)
2026-11-08T05:58:34Z [load_day 2024-05-06] 2024-05-06 hour 12: 291862 events in 0 files, snapshot none (task 10116 ms: download 7199 ms overlapping gunzip 1565 ms, parse 6810 ms, sort 0 ms, write 0 ms, index 928 ms: 17 candidates, 126668 repo-hours, 1294 releases; waiting 536 ms; commit 0 ms)
2026-11-08T05:58:35Z [load_day 2024-05-06] 2024-05-06 hour 13: 277427 events in 0 files, snapshot none (task 10139 ms: download 7502 ms overlapping gunzip 1749 ms, parse 7110 ms, sort 0 ms, write 0 ms, index 848 ms: 18 candidates, 115274 repo-hours, 1202 releases; waiting 199 ms; commit 0 ms)
2026-11-08T05:58:45Z [load_day 2024-05-06] 2024-05-06 hour 14: 278053 events in 0 files, snapshot none (task 10205 ms: download 7514 ms overlapping gunzip 1653 ms, parse 6874 ms, sort 0 ms, write 0 ms, index 842 ms: 29 candidates, 104802 repo-hours, 1355 releases; waiting 501 ms; commit 0 ms)
2026-11-08T05:58:46Z [load_day 2024-05-06] 2024-05-06 hour 15: 276403 events in 0 files, snapshot none (task 10476 ms: download 7725 ms overlapping gunzip 1704 ms, parse 7087 ms, sort 0 ms, write 0 ms, index 893 ms: 17 candidates, 106369 repo-hours, 1283 releases; waiting 505 ms; commit 0 ms)
2026-11-08T05:58:59Z [load_day 2024-05-06] 2024-05-06 hour 16: 267371 events in 0 files, snapshot none (task 13562 ms: download 10178 ms overlapping gunzip 2259 ms, parse 9255 ms, sort 0 ms, write 0 ms, index 1213 ms: 13 candidates, 98306 repo-hours, 1097 releases; waiting 529 ms; commit 0 ms)
2026-11-08T05:58:59Z [load_day 2024-05-06] 2024-05-06 hour 17: 253765 events in 0 files, snapshot none (task 12382 ms: download 9066 ms overlapping gunzip 1960 ms, parse 8728 ms, sort 0 ms, write 0 ms, index 810 ms: 18 candidates, 91709 repo-hours, 1030 releases; waiting 453 ms; commit 0 ms)
2026-11-08T05:59:11Z [load_day 2024-05-06] 2024-05-06 hour 18: 260918 events in 0 files, snapshot none (task 11433 ms: download 8845 ms overlapping gunzip 1820 ms, parse 8056 ms, sort 0 ms, write 0 ms, index 738 ms: 6 candidates, 101686 repo-hours, 1179 releases; waiting 536 ms; commit 0 ms)
2026-11-08T05:59:11Z [load_day 2024-05-06] 2024-05-06 hour 19: 228236 events in 0 files, snapshot none (task 10483 ms: download 7828 ms overlapping gunzip 1846 ms, parse 7092 ms, sort 0 ms, write 0 ms, index 679 ms: 7 candidates, 88356 repo-hours, 1080 releases; waiting 560 ms; commit 0 ms)
2026-11-08T05:59:21Z [load_day 2024-05-06] 2024-05-06 hour 20: 223026 events in 0 files, snapshot none (task 10001 ms: download 7520 ms overlapping gunzip 1805 ms, parse 6789 ms, sort 0 ms, write 0 ms, index 670 ms: 12 candidates, 87262 repo-hours, 1038 releases; waiting 472 ms; commit 0 ms)
2026-11-08T05:59:21Z [load_day 2024-05-06] 2024-05-06 hour 21: 215466 events in 0 files, snapshot none (task 9454 ms: download 6975 ms overlapping gunzip 1667 ms, parse 6387 ms, sort 0 ms, write 0 ms, index 704 ms: 3 candidates, 80107 repo-hours, 1081 releases; waiting 492 ms; commit 0 ms)
2026-11-08T05:59:30Z [load_day 2024-05-06] 2024-05-06 hour 22: 184995 events in 0 files, snapshot none (task 8467 ms: download 5825 ms overlapping gunzip 1483 ms, parse 5600 ms, sort 0 ms, write 0 ms, index 527 ms: 14 candidates, 67154 repo-hours, 1002 releases; waiting 489 ms; commit 0 ms)
2026-11-08T05:59:30Z [load_day 2024-05-06] 2024-05-06 hour 23: 163097 events in 0 files, snapshot none (task 7680 ms: download 5019 ms overlapping gunzip 1245 ms, parse 5064 ms, sort 0 ms, write 0 ms, index 580 ms: 8 candidates, 61576 repo-hours, 770 releases; waiting 499 ms; commit 0 ms)
2026-11-08T05:59:40Z [load_day 2024-05-06] 2024-05-06: repo_hour merged from 24 files to 1 (2104711 rows, 9727 ms)
2026-11-08T05:59:42Z [load_day 2024-05-06] 2024-05-06: index committed in 12296 ms (24 + 1 + 24 files)
2026-11-08T05:59:42Z [load_day 2024-05-06] 2024-05-06: 5520661 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:59:42Z [load_day 2024-05-06] attempt 1 succeeded