orcaLog in

Runs · run 2161

load_day 2024-03-05, attempt 1 succeeded

Host
73ccef5e07c2:94539
Started
2026-11-08T04:57:43Z
Ended
2026-11-08T04:59:43Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
949 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
188.3 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2161/load_day/2024-03-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:57:43Z [load_day 2024-03-05] attempt 1 started
2026-11-08T04:57:44Z [load_day 2024-03-05] 2024-03-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:57:52Z [load_day 2024-03-05] 2024-03-05 hour 0: 238198 events in 0 files, snapshot none (task 7754 ms: download 4878 ms overlapping gunzip 1217 ms, parse 4944 ms, sort 0 ms, write 0 ms, index 863 ms: 7 candidates, 101952 repo-hours, 1131 releases; waiting 470 ms; commit 0 ms)
2026-11-08T04:57:53Z [load_day 2024-03-05] 2024-03-05 hour 1: 234635 events in 0 files, snapshot none (task 8032 ms: download 5202 ms overlapping gunzip 1164 ms, parse 5293 ms, sort 0 ms, write 0 ms, index 809 ms: 13 candidates, 102420 repo-hours, 961 releases; waiting 470 ms; commit 0 ms)
2026-11-08T04:58:00Z [load_day 2024-03-05] 2024-03-05 hour 2: 199583 events in 0 files, snapshot none (task 6922 ms: download 4172 ms overlapping gunzip 1053 ms, parse 4573 ms, sort 0 ms, write 0 ms, index 543 ms: 12 candidates, 68558 repo-hours, 764 releases; waiting 536 ms; commit 0 ms)
2026-11-08T04:58:00Z [load_day 2024-03-05] 2024-03-05 hour 3: 203151 events in 0 files, snapshot none (task 7044 ms: download 4427 ms overlapping gunzip 1135 ms, parse 4537 ms, sort 0 ms, write 0 ms, index 518 ms: 8 candidates, 67999 repo-hours, 818 releases; waiting 566 ms; commit 0 ms)
2026-11-08T04:58:07Z [load_day 2024-03-05] 2024-03-05 hour 4: 192579 events in 0 files, snapshot none (task 7027 ms: download 3927 ms overlapping gunzip 1086 ms, parse 4533 ms, sort 0 ms, write 0 ms, index 616 ms: 9 candidates, 63328 repo-hours, 647 releases; waiting 564 ms; commit 0 ms)
2026-11-08T04:58:07Z [load_day 2024-03-05] 2024-03-05 hour 5: 175683 events in 0 files, snapshot none (task 6442 ms: download 3354 ms overlapping gunzip 1015 ms, parse 4021 ms, sort 0 ms, write 0 ms, index 725 ms: 10 candidates, 69704 repo-hours, 767 releases; waiting 394 ms; commit 0 ms)
2026-11-08T04:58:16Z [load_day 2024-03-05] 2024-03-05 hour 6: 230665 events in 0 files, snapshot none (task 8106 ms: download 4835 ms overlapping gunzip 1226 ms, parse 5156 ms, sort 0 ms, write 0 ms, index 991 ms: 11 candidates, 82369 repo-hours, 900 releases; waiting 481 ms; commit 0 ms)
2026-11-08T04:58:17Z [load_day 2024-03-05] 2024-03-05 hour 7: 232249 events in 0 files, snapshot none (task 9176 ms: download 5458 ms overlapping gunzip 1429 ms, parse 5989 ms, sort 0 ms, write 0 ms, index 892 ms: 10 candidates, 82312 repo-hours, 803 releases; waiting 636 ms; commit 0 ms)
2026-11-08T04:58:26Z [load_day 2024-03-05] 2024-03-05 hour 8: 231768 events in 0 files, snapshot none (task 9259 ms: download 6082 ms overlapping gunzip 1404 ms, parse 6034 ms, sort 0 ms, write 0 ms, index 1066 ms: 18 candidates, 86829 repo-hours, 964 releases; waiting 478 ms; commit 0 ms)
2026-11-08T04:58:27Z [load_day 2024-03-05] 2024-03-05 hour 9: 265488 events in 0 files, snapshot none (task 9387 ms: download 6520 ms overlapping gunzip 1603 ms, parse 6815 ms, sort 0 ms, write 0 ms, index 752 ms: 11 candidates, 95986 repo-hours, 1193 releases; waiting 2 ms; commit 0 ms)
2026-11-08T04:58:35Z [load_day 2024-03-05] 2024-03-05 hour 10: 257691 events in 0 files, snapshot none (task 9067 ms: download 6467 ms overlapping gunzip 1570 ms, parse 6620 ms, sort 0 ms, write 0 ms, index 678 ms: 13 candidates, 94197 repo-hours, 1100 releases; waiting 15 ms; commit 0 ms)
2026-11-08T04:58:36Z [load_day 2024-03-05] 2024-03-05 hour 11: 252033 events in 0 files, snapshot none (task 8655 ms: download 6014 ms overlapping gunzip 1506 ms, parse 6227 ms, sort 0 ms, write 0 ms, index 708 ms: 10 candidates, 88927 repo-hours, 965 releases; waiting 17 ms; commit 0 ms)
2026-11-08T04:58:45Z [load_day 2024-03-05] 2024-03-05 hour 12: 298239 events in 0 files, snapshot none (task 9451 ms: download 6249 ms overlapping gunzip 1484 ms, parse 6750 ms, sort 0 ms, write 0 ms, index 987 ms: 12 candidates, 119669 repo-hours, 1284 releases; waiting 20 ms; commit 0 ms)
2026-11-08T04:58:46Z [load_day 2024-03-05] 2024-03-05 hour 13: 282919 events in 0 files, snapshot none (task 9344 ms: download 6289 ms overlapping gunzip 1461 ms, parse 6887 ms, sort 0 ms, write 0 ms, index 769 ms: 9 candidates, 113503 repo-hours, 1238 releases; waiting 8 ms; commit 0 ms)
2026-11-08T04:58:56Z [load_day 2024-03-05] 2024-03-05 hour 14: 273453 events in 0 files, snapshot none (task 10395 ms: download 7790 ms overlapping gunzip 1628 ms, parse 7282 ms, sort 0 ms, write 0 ms, index 719 ms: 7 candidates, 104424 repo-hours, 1274 releases; waiting 498 ms; commit 0 ms)
2026-11-08T04:58:57Z [load_day 2024-03-05] 2024-03-05 hour 15: 271748 events in 0 files, snapshot none (task 10536 ms: download 7628 ms overlapping gunzip 1691 ms, parse 7240 ms, sort 0 ms, write 0 ms, index 825 ms: 16 candidates, 103324 repo-hours, 1419 releases; waiting 496 ms; commit 0 ms)
2026-11-08T04:59:06Z [load_day 2024-03-05] 2024-03-05 hour 16: 273155 events in 0 files, snapshot none (task 9622 ms: download 7072 ms overlapping gunzip 1501 ms, parse 6648 ms, sort 0 ms, write 0 ms, index 738 ms: 7 candidates, 103458 repo-hours, 1234 releases; waiting 499 ms; commit 0 ms)
2026-11-08T04:59:06Z [load_day 2024-03-05] 2024-03-05 hour 17: 265138 events in 0 files, snapshot none (task 9444 ms: download 6913 ms overlapping gunzip 1433 ms, parse 6308 ms, sort 0 ms, write 0 ms, index 677 ms: 5 candidates, 95443 repo-hours, 1664 releases; waiting 676 ms; commit 0 ms)
2026-11-08T04:59:14Z [load_day 2024-03-05] 2024-03-05 hour 18: 259847 events in 0 files, snapshot none (task 7603 ms: download 5085 ms overlapping gunzip 1133 ms, parse 4973 ms, sort 0 ms, write 0 ms, index 674 ms: 6 candidates, 96046 repo-hours, 1397 releases; waiting 545 ms; commit 0 ms)
2026-11-08T04:59:14Z [load_day 2024-03-05] 2024-03-05 hour 19: 251244 events in 0 files, snapshot none (task 7123 ms: download 4704 ms overlapping gunzip 1098 ms, parse 4587 ms, sort 0 ms, write 0 ms, index 619 ms: 14 candidates, 85971 repo-hours, 1775 releases; waiting 544 ms; commit 0 ms)
2026-11-08T04:59:23Z [load_day 2024-03-05] 2024-03-05 hour 20: 237747 events in 0 files, snapshot none (task 7966 ms: download 4487 ms overlapping gunzip 1171 ms, parse 4988 ms, sort 0 ms, write 0 ms, index 1002 ms: 7 candidates, 81970 repo-hours, 1218 releases; waiting 516 ms; commit 0 ms)
2026-11-08T04:59:23Z [load_day 2024-03-05] 2024-03-05 hour 21: 224926 events in 0 files, snapshot none (task 7559 ms: download 4449 ms overlapping gunzip 1142 ms, parse 4806 ms, sort 0 ms, write 0 ms, index 865 ms: 5 candidates, 74223 repo-hours, 1063 releases; waiting 500 ms; commit 0 ms)
2026-11-08T04:59:31Z [load_day 2024-03-05] 2024-03-05 hour 22: 208549 events in 0 files, snapshot none (task 7871 ms: download 4530 ms overlapping gunzip 1225 ms, parse 5224 ms, sort 0 ms, write 0 ms, index 694 ms: 2 candidates, 67966 repo-hours, 1197 releases; waiting 508 ms; commit 0 ms)
2026-11-08T04:59:31Z [load_day 2024-03-05] 2024-03-05 hour 23: 199314 events in 0 files, snapshot none (task 6909 ms: download 4009 ms overlapping gunzip 1052 ms, parse 4321 ms, sort 0 ms, write 0 ms, index 643 ms: 5 candidates, 64358 repo-hours, 833 releases; waiting 610 ms; commit 0 ms)
2026-11-08T04:59:40Z [load_day 2024-03-05] 2024-03-05: repo_hour merged from 24 files to 1 (2114936 rows, 9144 ms)
2026-11-08T04:59:43Z [load_day 2024-03-05] 2024-03-05: index committed in 11700 ms (24 + 1 + 24 files)
2026-11-08T04:59:43Z [load_day 2024-03-05] 2024-03-05: 5760002 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:59:43Z [load_day 2024-03-05] attempt 1 succeeded