orcaLog in

Runs · run 3618

load_day 2025-03-01, attempt 1 succeeded

Host
73ccef5e07c2:263214
Started
2026-11-08T10:36:11Z
Ended
2026-11-08T10:38:01Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
701 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
159.7 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3618/load_day/2025-03-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:36:11Z [load_day 2025-03-01] attempt 1 started
2026-11-08T10:36:12Z [load_day 2025-03-01] 2025-03-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:36:21Z [load_day 2025-03-01] 2025-03-01 hour 0: 197139 events in 0 files, snapshot none (task 9311 ms: download 5913 ms overlapping gunzip 1457 ms, parse 6383 ms, sort 0 ms, write 0 ms, index 764 ms: 9 candidates, 89129 repo-hours, 1402 releases; waiting 472 ms; commit 0 ms)
2026-11-08T10:36:22Z [load_day 2025-03-01] 2025-03-01 hour 1: 224686 events in 0 files, snapshot none (task 9663 ms: download 6300 ms overlapping gunzip 1536 ms, parse 6392 ms, sort 0 ms, write 0 ms, index 940 ms: 13 candidates, 116902 repo-hours, 1283 releases; waiting 506 ms; commit 0 ms)
2026-11-08T10:36:29Z [load_day 2025-03-01] 2025-03-01 hour 2: 183763 events in 0 files, snapshot none (task 6725 ms: download 3388 ms overlapping gunzip 973 ms, parse 3790 ms, sort 0 ms, write 0 ms, index 1078 ms: 10 candidates, 72845 repo-hours, 1078 releases; waiting 532 ms; commit 0 ms)
2026-11-08T10:36:33Z [load_day 2025-03-01] 2025-03-01 hour 3: 201165 events in 0 files, snapshot none (task 10411 ms: download 7030 ms overlapping gunzip 1243 ms, parse 4951 ms, sort 0 ms, write 0 ms, index 855 ms: 3 candidates, 73995 repo-hours, 3939 releases; waiting 2950 ms; commit 0 ms)
2026-11-08T10:36:35Z [load_day 2025-03-01] 2025-03-01 hour 4: 185674 events in 0 files, snapshot none (task 5824 ms: download 3515 ms overlapping gunzip 913 ms, parse 3589 ms, sort 0 ms, write 0 ms, index 563 ms: 12 candidates, 63964 repo-hours, 709 releases; waiting 519 ms; commit 0 ms)
2026-11-08T10:36:40Z [load_day 2025-03-01] 2025-03-01 hour 5: 192094 events in 0 files, snapshot none (task 7252 ms: download 3801 ms overlapping gunzip 1104 ms, parse 4410 ms, sort 0 ms, write 0 ms, index 943 ms: 3 candidates, 68353 repo-hours, 804 releases; waiting 503 ms; commit 0 ms)
2026-11-08T10:36:43Z [load_day 2025-03-01] 2025-03-01 hour 6: 206320 events in 0 files, snapshot none (task 7083 ms: download 3988 ms overlapping gunzip 1034 ms, parse 4398 ms, sort 0 ms, write 0 ms, index 863 ms: 6 candidates, 83918 repo-hours, 1116 releases; waiting 475 ms; commit 0 ms)
2026-11-08T10:36:48Z [load_day 2025-03-01] 2025-03-01 hour 7: 194516 events in 0 files, snapshot none (task 7236 ms: download 3347 ms overlapping gunzip 1083 ms, parse 4568 ms, sort 0 ms, write 0 ms, index 784 ms: 6 candidates, 67862 repo-hours, 947 releases; waiting 496 ms; commit 0 ms)
2026-11-08T10:36:52Z [load_day 2025-03-01] 2025-03-01 hour 8: 197249 events in 0 files, snapshot none (task 8608 ms: download 4541 ms overlapping gunzip 1263 ms, parse 5377 ms, sort 0 ms, write 0 ms, index 1186 ms: 8 candidates, 73860 repo-hours, 947 releases; waiting 433 ms; commit 0 ms)
2026-11-08T10:36:57Z [load_day 2025-03-01] 2025-03-01 hour 9: 217928 events in 0 files, snapshot none (task 7971 ms: download 4982 ms overlapping gunzip 1161 ms, parse 4920 ms, sort 0 ms, write 0 ms, index 1099 ms: 4 candidates, 83002 repo-hours, 1950 releases; waiting 489 ms; commit 0 ms)
2026-11-08T10:37:00Z [load_day 2025-03-01] 2025-03-01 hour 10: 210442 events in 0 files, snapshot none (task 7497 ms: download 4125 ms overlapping gunzip 1161 ms, parse 4465 ms, sort 0 ms, write 0 ms, index 952 ms: 6 candidates, 79422 repo-hours, 901 releases; waiting 596 ms; commit 0 ms)
2026-11-08T10:37:04Z [load_day 2025-03-01] 2025-03-01 hour 11: 201403 events in 0 files, snapshot none (task 6956 ms: download 4338 ms overlapping gunzip 1141 ms, parse 4432 ms, sort 0 ms, write 0 ms, index 564 ms: 7 candidates, 71597 repo-hours, 828 releases; waiting 474 ms; commit 0 ms)
2026-11-08T10:37:08Z [load_day 2025-03-01] 2025-03-01 hour 12: 255914 events in 0 files, snapshot none (task 6949 ms: download 3447 ms overlapping gunzip 933 ms, parse 3949 ms, sort 0 ms, write 0 ms, index 1155 ms: 8 candidates, 122999 repo-hours, 1228 releases; waiting 530 ms; commit 0 ms)
2026-11-08T10:37:11Z [load_day 2025-03-01] 2025-03-01 hour 13: 230097 events in 0 files, snapshot none (task 6634 ms: download 3765 ms overlapping gunzip 963 ms, parse 3995 ms, sort 0 ms, write 0 ms, index 783 ms: 9 candidates, 99689 repo-hours, 910 releases; waiting 582 ms; commit 0 ms)
2026-11-08T10:37:15Z [load_day 2025-03-01] 2025-03-01 hour 14: 218956 events in 0 files, snapshot none (task 6402 ms: download 3616 ms overlapping gunzip 984 ms, parse 3768 ms, sort 0 ms, write 0 ms, index 661 ms: 6 candidates, 82852 repo-hours, 950 releases; waiting 504 ms; commit 0 ms)
2026-11-08T10:37:18Z [load_day 2025-03-01] 2025-03-01 hour 15: 230695 events in 0 files, snapshot none (task 6265 ms: download 3762 ms overlapping gunzip 939 ms, parse 3818 ms, sort 0 ms, write 0 ms, index 716 ms: 7 candidates, 91972 repo-hours, 1104 releases; waiting 525 ms; commit 0 ms)
2026-11-08T10:37:23Z [load_day 2025-03-01] 2025-03-01 hour 16: 229534 events in 0 files, snapshot none (task 8031 ms: download 3773 ms overlapping gunzip 1142 ms, parse 4876 ms, sort 0 ms, write 0 ms, index 989 ms: 11 candidates, 85328 repo-hours, 1041 releases; waiting 752 ms; commit 0 ms)
2026-11-08T10:37:26Z [load_day 2025-03-01] 2025-03-01 hour 17: 239340 events in 0 files, snapshot none (task 7481 ms: download 4771 ms overlapping gunzip 1139 ms, parse 4870 ms, sort 0 ms, write 0 ms, index 625 ms: 11 candidates, 80084 repo-hours, 1022 releases; waiting 514 ms; commit 0 ms)
2026-11-08T10:37:32Z [load_day 2025-03-01] 2025-03-01 hour 18: 258054 events in 0 files, snapshot none (task 8269 ms: download 5020 ms overlapping gunzip 1204 ms, parse 5092 ms, sort 0 ms, write 0 ms, index 882 ms: 9 candidates, 94741 repo-hours, 1214 releases; waiting 855 ms; commit 0 ms)
2026-11-08T10:37:35Z [load_day 2025-03-01] 2025-03-01 hour 19: 207889 events in 0 files, snapshot none (task 8298 ms: download 5274 ms overlapping gunzip 1256 ms, parse 5165 ms, sort 0 ms, write 0 ms, index 1134 ms: 8 candidates, 72422 repo-hours, 1051 releases; waiting 486 ms; commit 0 ms)
2026-11-08T10:37:40Z [load_day 2025-03-01] 2025-03-01 hour 20: 200033 events in 0 files, snapshot none (task 6723 ms: download 3983 ms overlapping gunzip 1124 ms, parse 4558 ms, sort 0 ms, write 0 ms, index 607 ms: 8 candidates, 72655 repo-hours, 912 releases; waiting 218 ms; commit 0 ms)
2026-11-08T10:37:42Z [load_day 2025-03-01] 2025-03-01 hour 21: 199599 events in 0 files, snapshot none (task 6561 ms: download 3718 ms overlapping gunzip 942 ms, parse 3928 ms, sort 0 ms, write 0 ms, index 959 ms: 4 candidates, 73096 repo-hours, 1043 releases; waiting 495 ms; commit 0 ms)
2026-11-08T10:37:47Z [load_day 2025-03-01] 2025-03-01 hour 22: 181472 events in 0 files, snapshot none (task 6623 ms: download 3393 ms overlapping gunzip 988 ms, parse 4260 ms, sort 0 ms, write 0 ms, index 549 ms: 9 candidates, 64893 repo-hours, 1111 releases; waiting 507 ms; commit 0 ms)
2026-11-08T10:37:49Z [load_day 2025-03-01] 2025-03-01 hour 23: 170379 events in 0 files, snapshot none (task 6094 ms: download 3340 ms overlapping gunzip 887 ms, parse 3675 ms, sort 0 ms, write 0 ms, index 712 ms: 11 candidates, 60099 repo-hours, 906 releases; waiting 525 ms; commit 0 ms)
2026-11-08T10:37:58Z [load_day 2025-03-01] 2025-03-01: repo_hour merged from 24 files to 1 (1945679 rows, 9409 ms)
2026-11-08T10:38:01Z [load_day 2025-03-01] 2025-03-01: index committed in 12012 ms (24 + 1 + 24 files)
2026-11-08T10:38:01Z [load_day 2025-03-01] 2025-03-01: 5034341 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:38:01Z [load_day 2025-03-01] attempt 1 succeeded