orcaLog in

Runs · run 2930

load_day 2024-09-06, attempt 1 succeeded

Host
73ccef5e07c2:174126
Started
2026-11-08T07:47:56Z
Ended
2026-11-08T07:49:48Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
706 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
179.5 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2930/load_day/2024-09-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:47:56Z [load_day 2024-09-06] attempt 1 started
2026-11-08T07:47:57Z [load_day 2024-09-06] 2024-09-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:48:04Z [load_day 2024-09-06] 2024-09-06 hour 0: 180447 events in 0 files, snapshot none (task 6877 ms: download 4837 ms overlapping gunzip 839 ms, parse 3508 ms, sort 0 ms, write 0 ms, index 890 ms: 12 candidates, 88905 repo-hours, 1137 releases; waiting 1157 ms; commit 0 ms)
2026-11-08T07:48:04Z [load_day 2024-09-06] 2024-09-06 hour 1: 191142 events in 0 files, snapshot none (task 6923 ms: download 3494 ms overlapping gunzip 865 ms, parse 3698 ms, sort 0 ms, write 0 ms, index 1572 ms: 6 candidates, 104060 repo-hours, 996 releases; waiting 522 ms; commit 0 ms)
2026-11-08T07:48:10Z [load_day 2024-09-06] 2024-09-06 hour 2: 168232 events in 0 files, snapshot none (task 5527 ms: download 3043 ms overlapping gunzip 795 ms, parse 3344 ms, sort 0 ms, write 0 ms, index 565 ms: 4 candidates, 75015 repo-hours, 933 releases; waiting 525 ms; commit 0 ms)
2026-11-08T07:48:11Z [load_day 2024-09-06] 2024-09-06 hour 3: 183882 events in 0 files, snapshot none (task 6191 ms: download 4418 ms overlapping gunzip 833 ms, parse 3539 ms, sort 0 ms, write 0 ms, index 571 ms: 8 candidates, 76254 repo-hours, 4127 releases; waiting 807 ms; commit 0 ms)
2026-11-08T07:48:17Z [load_day 2024-09-06] 2024-09-06 hour 4: 166760 events in 0 files, snapshot none (task 6567 ms: download 4039 ms overlapping gunzip 1139 ms, parse 4374 ms, sort 0 ms, write 0 ms, index 449 ms: 8 candidates, 64180 repo-hours, 675 releases; waiting 218 ms; commit 0 ms)
2026-11-08T07:48:18Z [load_day 2024-09-06] 2024-09-06 hour 5: 175952 events in 0 files, snapshot none (task 6867 ms: download 4412 ms overlapping gunzip 1063 ms, parse 4482 ms, sort 0 ms, write 0 ms, index 502 ms: 6 candidates, 69137 repo-hours, 862 releases; waiting 479 ms; commit 0 ms)
2026-11-08T07:48:27Z [load_day 2024-09-06] 2024-09-06 hour 6: 209892 events in 0 files, snapshot none (task 8857 ms: download 5545 ms overlapping gunzip 1437 ms, parse 5763 ms, sort 0 ms, write 0 ms, index 777 ms: 20 candidates, 93978 repo-hours, 999 releases; waiting 574 ms; commit 0 ms)
2026-11-08T07:48:27Z [load_day 2024-09-06] 2024-09-06 hour 7: 213904 events in 0 files, snapshot none (task 8762 ms: download 5914 ms overlapping gunzip 1444 ms, parse 5930 ms, sort 0 ms, write 0 ms, index 632 ms: 10 candidates, 85251 repo-hours, 1076 releases; waiting 480 ms; commit 0 ms)
2026-11-08T07:48:37Z [load_day 2024-09-06] 2024-09-06 hour 8: 227085 events in 0 files, snapshot none (task 9781 ms: download 6968 ms overlapping gunzip 1524 ms, parse 6759 ms, sort 0 ms, write 0 ms, index 660 ms: 10 candidates, 92223 repo-hours, 1238 releases; waiting 516 ms; commit 0 ms)
2026-11-08T07:48:38Z [load_day 2024-09-06] 2024-09-06 hour 9: 227791 events in 0 files, snapshot none (task 9816 ms: download 6717 ms overlapping gunzip 1488 ms, parse 6727 ms, sort 0 ms, write 0 ms, index 822 ms: 8 candidates, 96205 repo-hours, 1343 releases; waiting 501 ms; commit 0 ms)
2026-11-08T07:48:47Z [load_day 2024-09-06] 2024-09-06 hour 10: 221000 events in 0 files, snapshot none (task 9593 ms: download 6604 ms overlapping gunzip 1512 ms, parse 6415 ms, sort 0 ms, write 0 ms, index 684 ms: 7 candidates, 88837 repo-hours, 1137 releases; waiting 508 ms; commit 0 ms)
2026-11-08T07:48:47Z [load_day 2024-09-06] 2024-09-06 hour 11: 208014 events in 0 files, snapshot none (task 7947 ms: download 5200 ms overlapping gunzip 1228 ms, parse 5208 ms, sort 0 ms, write 0 ms, index 697 ms: 10 candidates, 81286 repo-hours, 1287 releases; waiting 526 ms; commit 0 ms)
2026-11-08T07:48:57Z [load_day 2024-09-06] 2024-09-06 hour 12: 266502 events in 0 files, snapshot none (task 9541 ms: download 6184 ms overlapping gunzip 1491 ms, parse 6321 ms, sort 0 ms, write 0 ms, index 881 ms: 18 candidates, 130339 repo-hours, 1399 releases; waiting 519 ms; commit 0 ms)
2026-11-08T07:48:57Z [load_day 2024-09-06] 2024-09-06 hour 13: 237728 events in 0 files, snapshot none (task 9134 ms: download 6113 ms overlapping gunzip 1343 ms, parse 6116 ms, sort 0 ms, write 0 ms, index 834 ms: 9 candidates, 110446 repo-hours, 1437 releases; waiting 506 ms; commit 0 ms)
2026-11-08T07:49:07Z [load_day 2024-09-06] 2024-09-06 hour 14: 230781 events in 0 files, snapshot none (task 9338 ms: download 6369 ms overlapping gunzip 1563 ms, parse 6497 ms, sort 0 ms, write 0 ms, index 812 ms: 25 candidates, 95665 repo-hours, 1424 releases; waiting 183 ms; commit 0 ms)
2026-11-08T07:49:07Z [load_day 2024-09-06] 2024-09-06 hour 15: 231542 events in 0 files, snapshot none (task 9102 ms: download 6137 ms overlapping gunzip 1436 ms, parse 5887 ms, sort 0 ms, write 0 ms, index 922 ms: 15 candidates, 99733 repo-hours, 1389 releases; waiting 492 ms; commit 0 ms)
2026-11-08T07:49:16Z [load_day 2024-09-06] 2024-09-06 hour 16: 212204 events in 0 files, snapshot none (task 8182 ms: download 5682 ms overlapping gunzip 1257 ms, parse 5497 ms, sort 0 ms, write 0 ms, index 631 ms: 7 candidates, 88201 repo-hours, 1104 releases; waiting 504 ms; commit 0 ms)
2026-11-08T07:49:16Z [load_day 2024-09-06] 2024-09-06 hour 17: 211246 events in 0 files, snapshot none (task 7563 ms: download 5000 ms overlapping gunzip 1166 ms, parse 4940 ms, sort 0 ms, write 0 ms, index 557 ms: 10 candidates, 80243 repo-hours, 965 releases; waiting 578 ms; commit 0 ms)
2026-11-08T07:49:24Z [load_day 2024-09-06] 2024-09-06 hour 18: 221996 events in 0 files, snapshot none (task 7286 ms: download 4715 ms overlapping gunzip 1092 ms, parse 4573 ms, sort 0 ms, write 0 ms, index 679 ms: 5 candidates, 95200 repo-hours, 1134 releases; waiting 574 ms; commit 0 ms)
2026-11-08T07:49:24Z [load_day 2024-09-06] 2024-09-06 hour 19: 194264 events in 0 files, snapshot none (task 6096 ms: download 3614 ms overlapping gunzip 962 ms, parse 3907 ms, sort 0 ms, write 0 ms, index 610 ms: 11 candidates, 72926 repo-hours, 1131 releases; waiting 283 ms; commit 0 ms)
2026-11-08T07:49:30Z [load_day 2024-09-06] 2024-09-06 hour 20: 188484 events in 0 files, snapshot none (task 5700 ms: download 3285 ms overlapping gunzip 852 ms, parse 3536 ms, sort 0 ms, write 0 ms, index 519 ms: 8 candidates, 72356 repo-hours, 964 releases; waiting 521 ms; commit 0 ms)
2026-11-08T07:49:30Z [load_day 2024-09-06] 2024-09-06 hour 21: 180435 events in 0 files, snapshot none (task 6019 ms: download 3737 ms overlapping gunzip 897 ms, parse 3734 ms, sort 0 ms, write 0 ms, index 519 ms: 12 candidates, 71052 repo-hours, 1179 releases; waiting 541 ms; commit 0 ms)
2026-11-08T07:49:37Z [load_day 2024-09-06] 2024-09-06 hour 22: 157270 events in 0 files, snapshot none (task 6365 ms: download 4004 ms overlapping gunzip 998 ms, parse 4155 ms, sort 0 ms, write 0 ms, index 396 ms: 10 candidates, 57987 repo-hours, 1075 releases; waiting 519 ms; commit 0 ms)
2026-11-08T07:49:37Z [load_day 2024-09-06] 2024-09-06 hour 23: 140783 events in 0 files, snapshot none (task 6058 ms: download 3449 ms overlapping gunzip 909 ms, parse 3917 ms, sort 0 ms, write 0 ms, index 367 ms: 3 candidates, 51590 repo-hours, 856 releases; waiting 506 ms; commit 0 ms)
2026-11-08T07:49:45Z [load_day 2024-09-06] 2024-09-06: repo_hour merged from 24 files to 1 (2041069 rows, 8510 ms)
2026-11-08T07:49:48Z [load_day 2024-09-06] 2024-09-06: index committed in 10906 ms (24 + 1 + 24 files)
2026-11-08T07:49:48Z [load_day 2024-09-06] 2024-09-06: 4847336 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:49:48Z [load_day 2024-09-06] attempt 1 succeeded