orcaLog in

Runs · run 2539

load_day 2024-06-03, attempt 1 succeeded

Host
73ccef5e07c2:130721
Started
2026-11-08T06:22:07Z
Ended
2026-11-08T06:24:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
729 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
201.1 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2539/load_day/2024-06-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:22:07Z [load_day 2024-06-03] attempt 1 started
2026-11-08T06:22:08Z [load_day 2024-06-03] 2024-06-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:22:16Z [load_day 2024-06-03] 2024-06-03 hour 0: 180763 events in 0 files, snapshot none (task 6981 ms: download 4121 ms overlapping gunzip 1148 ms, parse 4629 ms, sort 0 ms, write 0 ms, index 974 ms: 9 candidates, 89372 repo-hours, 1081 releases; waiting 25 ms; commit 0 ms)
2026-11-08T06:22:17Z [load_day 2024-06-03] 2024-06-03 hour 1: 194119 events in 0 files, snapshot none (task 7708 ms: download 4510 ms overlapping gunzip 1329 ms, parse 5234 ms, sort 0 ms, write 0 ms, index 957 ms: 11 candidates, 103858 repo-hours, 951 releases; waiting 7 ms; commit 0 ms)
2026-11-08T06:22:22Z [load_day 2024-06-03] 2024-06-03 hour 2: 174830 events in 0 files, snapshot none (task 5984 ms: download 3265 ms overlapping gunzip 1045 ms, parse 4148 ms, sort 0 ms, write 0 ms, index 582 ms: 7 candidates, 66512 repo-hours, 815 releases; waiting 19 ms; commit 0 ms)
2026-11-08T06:22:25Z [load_day 2024-06-03] 2024-06-03 hour 3: 192777 events in 0 files, snapshot none (task 7948 ms: download 4832 ms overlapping gunzip 1305 ms, parse 5470 ms, sort 0 ms, write 0 ms, index 981 ms: 3 candidates, 74541 repo-hours, 4254 releases; waiting 0 ms; commit 0 ms)
2026-11-08T06:22:29Z [load_day 2024-06-03] 2024-06-03 hour 4: 168069 events in 0 files, snapshot none (task 6741 ms: download 4193 ms overlapping gunzip 1184 ms, parse 4696 ms, sort 0 ms, write 0 ms, index 562 ms: 12 candidates, 61923 repo-hours, 725 releases; waiting 17 ms; commit 0 ms)
2026-11-08T06:22:32Z [load_day 2024-06-03] 2024-06-03 hour 5: 178034 events in 0 files, snapshot none (task 6506 ms: download 3877 ms overlapping gunzip 1085 ms, parse 4539 ms, sort 0 ms, write 0 ms, index 642 ms: 12 candidates, 69504 repo-hours, 850 releases; waiting 20 ms; commit 0 ms)
2026-11-08T06:22:38Z [load_day 2024-06-03] 2024-06-03 hour 6: 211745 events in 0 files, snapshot none (task 8088 ms: download 4891 ms overlapping gunzip 1250 ms, parse 5528 ms, sort 0 ms, write 0 ms, index 1081 ms: 10 candidates, 93338 repo-hours, 1055 releases; waiting 15 ms; commit 0 ms)
2026-11-08T06:22:42Z [load_day 2024-06-03] 2024-06-03 hour 7: 218688 events in 0 files, snapshot none (task 9205 ms: download 5878 ms overlapping gunzip 1589 ms, parse 6509 ms, sort 0 ms, write 0 ms, index 885 ms: 5 candidates, 87842 repo-hours, 1083 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:22:49Z [load_day 2024-06-03] 2024-06-03 hour 8: 235273 events in 0 files, snapshot none (task 10543 ms: download 7120 ms overlapping gunzip 1834 ms, parse 7221 ms, sort 0 ms, write 0 ms, index 1266 ms: 13 candidates, 96576 repo-hours, 1250 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:22:52Z [load_day 2024-06-03] 2024-06-03 hour 9: 240001 events in 0 files, snapshot none (task 10188 ms: download 6422 ms overlapping gunzip 1789 ms, parse 6989 ms, sort 0 ms, write 0 ms, index 1189 ms: 16 candidates, 100931 repo-hours, 1418 releases; waiting 26 ms; commit 0 ms)
2026-11-08T06:22:59Z [load_day 2024-06-03] 2024-06-03 hour 10: 226360 events in 0 files, snapshot none (task 9853 ms: download 6888 ms overlapping gunzip 1798 ms, parse 7064 ms, sort 0 ms, write 0 ms, index 778 ms: 7 candidates, 91631 repo-hours, 1286 releases; waiting 0 ms; commit 0 ms)
2026-11-08T06:23:03Z [load_day 2024-06-03] 2024-06-03 hour 11: 238765 events in 0 files, snapshot none (task 9783 ms: download 6404 ms overlapping gunzip 1729 ms, parse 6941 ms, sort 0 ms, write 0 ms, index 896 ms: 15 candidates, 86725 repo-hours, 1028 releases; waiting 3 ms; commit 0 ms)
2026-11-08T06:23:10Z [load_day 2024-06-03] 2024-06-03 hour 12: 273532 events in 0 files, snapshot none (task 10682 ms: download 7051 ms overlapping gunzip 1788 ms, parse 7474 ms, sort 0 ms, write 0 ms, index 1143 ms: 19 candidates, 127778 repo-hours, 1277 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:23:12Z [load_day 2024-06-03] 2024-06-03 hour 13: 265803 events in 0 files, snapshot none (task 8931 ms: download 6393 ms overlapping gunzip 1566 ms, parse 6287 ms, sort 0 ms, write 0 ms, index 866 ms: 20 candidates, 119496 repo-hours, 1270 releases; waiting 8 ms; commit 0 ms)
2026-11-08T06:23:19Z [load_day 2024-06-03] 2024-06-03 hour 14: 251366 events in 0 files, snapshot none (task 7959 ms: download 5561 ms overlapping gunzip 1381 ms, parse 5661 ms, sort 0 ms, write 0 ms, index 738 ms: 20 candidates, 105413 repo-hours, 1345 releases; waiting 10 ms; commit 0 ms)
2026-11-08T06:23:21Z [load_day 2024-06-03] 2024-06-03 hour 15: 256682 events in 0 files, snapshot none (task 8252 ms: download 5733 ms overlapping gunzip 1416 ms, parse 5807 ms, sort 0 ms, write 0 ms, index 815 ms: 19 candidates, 109290 repo-hours, 1418 releases; waiting 14 ms; commit 0 ms)
2026-11-08T06:23:28Z [load_day 2024-06-03] 2024-06-03 hour 16: 248654 events in 0 files, snapshot none (task 8742 ms: download 5318 ms overlapping gunzip 1496 ms, parse 6074 ms, sort 0 ms, write 0 ms, index 971 ms: 15 candidates, 97866 repo-hours, 1348 releases; waiting 8 ms; commit 0 ms)
2026-11-08T06:23:30Z [load_day 2024-06-03] 2024-06-03 hour 17: 228026 events in 0 files, snapshot none (task 8541 ms: download 5918 ms overlapping gunzip 1478 ms, parse 6031 ms, sort 0 ms, write 0 ms, index 819 ms: 5 candidates, 90572 repo-hours, 1133 releases; waiting 22 ms; commit 0 ms)
2026-11-08T06:23:38Z [load_day 2024-06-03] 2024-06-03 hour 18: 245513 events in 0 files, snapshot none (task 9437 ms: download 6661 ms overlapping gunzip 1635 ms, parse 6693 ms, sort 0 ms, write 0 ms, index 869 ms: 13 candidates, 104417 repo-hours, 1298 releases; waiting 24 ms; commit 0 ms)
2026-11-08T06:23:40Z [load_day 2024-06-03] 2024-06-03 hour 19: 222834 events in 0 files, snapshot none (task 10000 ms: download 6672 ms overlapping gunzip 1620 ms, parse 6597 ms, sort 0 ms, write 0 ms, index 1557 ms: 16 candidates, 84408 repo-hours, 1274 releases; waiting 17 ms; commit 0 ms)
2026-11-08T06:23:48Z [load_day 2024-06-03] 2024-06-03 hour 20: 216162 events in 0 files, snapshot none (task 9859 ms: download 6879 ms overlapping gunzip 1713 ms, parse 6978 ms, sort 0 ms, write 0 ms, index 981 ms: 10 candidates, 82368 repo-hours, 1069 releases; waiting 0 ms; commit 0 ms)
2026-11-08T06:23:49Z [load_day 2024-06-03] 2024-06-03 hour 21: 206911 events in 0 files, snapshot none (task 8246 ms: download 5340 ms overlapping gunzip 1484 ms, parse 5875 ms, sort 0 ms, write 0 ms, index 621 ms: 14 candidates, 78470 repo-hours, 1113 releases; waiting 21 ms; commit 0 ms)
2026-11-08T06:23:55Z [load_day 2024-06-03] 2024-06-03 hour 22: 184031 events in 0 files, snapshot none (task 6446 ms: download 4017 ms overlapping gunzip 1168 ms, parse 4529 ms, sort 0 ms, write 0 ms, index 523 ms: 10 candidates, 65956 repo-hours, 1167 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:23:56Z [load_day 2024-06-03] 2024-06-03 hour 23: 174516 events in 0 files, snapshot none (task 6588 ms: download 3961 ms overlapping gunzip 1182 ms, parse 4729 ms, sort 0 ms, write 0 ms, index 482 ms: 6 candidates, 62897 repo-hours, 891 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:24:06Z [load_day 2024-06-03] 2024-06-03: repo_hour merged from 24 files to 1 (2151684 rows, 9697 ms)
2026-11-08T06:24:08Z [load_day 2024-06-03] 2024-06-03: index committed in 11809 ms (24 + 1 + 24 files)
2026-11-08T06:24:08Z [load_day 2024-06-03] 2024-06-03: 5233454 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:24:08Z [load_day 2024-06-03] attempt 1 succeeded