orcaLog in

Runs · run 1957

load_day 2024-01-11, attempt 1 succeeded

Host
73ccef5e07c2:17745
Started
2026-11-08T04:05:56Z
Ended
2026-11-08T04:07:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
695 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
173.7 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1957/load_day/2024-01-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:05:56Z [load_day 2024-01-11] attempt 1 started
2026-11-08T04:05:57Z [load_day 2024-01-11] 2024-01-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:06:04Z [load_day 2024-01-11] 2024-01-11 hour 0: 195195 events in 0 files, snapshot none (task 7228 ms: download 4473 ms overlapping gunzip 1128 ms, parse 4660 ms, sort 0 ms, write 0 ms, index 699 ms: 10 candidates, 87517 repo-hours, 1024 releases; waiting 534 ms; commit 0 ms)
2026-11-08T04:06:04Z [load_day 2024-01-11] 2024-01-11 hour 1: 202477 events in 0 files, snapshot none (task 7173 ms: download 4272 ms overlapping gunzip 1073 ms, parse 4680 ms, sort 0 ms, write 0 ms, index 686 ms: 8 candidates, 96275 repo-hours, 917 releases; waiting 515 ms; commit 0 ms)
2026-11-08T04:06:11Z [load_day 2024-01-11] 2024-01-11 hour 2: 171245 events in 0 files, snapshot none (task 6075 ms: download 3316 ms overlapping gunzip 938 ms, parse 3875 ms, sort 0 ms, write 0 ms, index 498 ms: 4 candidates, 64371 repo-hours, 906 releases; waiting 490 ms; commit 0 ms)
2026-11-08T04:06:12Z [load_day 2024-01-11] 2024-01-11 hour 3: 171124 events in 0 files, snapshot none (task 6975 ms: download 3497 ms overlapping gunzip 1110 ms, parse 4560 ms, sort 0 ms, write 0 ms, index 493 ms: 5 candidates, 63410 repo-hours, 759 releases; waiting 528 ms; commit 0 ms)
2026-11-08T04:06:17Z [load_day 2024-01-11] 2024-01-11 hour 4: 168666 events in 0 files, snapshot none (task 5702 ms: download 2943 ms overlapping gunzip 851 ms, parse 3548 ms, sort 0 ms, write 0 ms, index 507 ms: 4 candidates, 59784 repo-hours, 570 releases; waiting 185 ms; commit 0 ms)
2026-11-08T04:06:18Z [load_day 2024-01-11] 2024-01-11 hour 5: 172991 events in 0 files, snapshot none (task 5858 ms: download 3819 ms overlapping gunzip 841 ms, parse 3346 ms, sort 0 ms, write 0 ms, index 713 ms: 4 candidates, 63669 repo-hours, 750 releases; waiting 496 ms; commit 0 ms)
2026-11-08T04:06:25Z [load_day 2024-01-11] 2024-01-11 hour 6: 193028 events in 0 files, snapshot none (task 7485 ms: download 4484 ms overlapping gunzip 1158 ms, parse 4984 ms, sort 0 ms, write 0 ms, index 617 ms: 2 candidates, 75748 repo-hours, 779 releases; waiting 463 ms; commit 0 ms)
2026-11-08T04:06:25Z [load_day 2024-01-11] 2024-01-11 hour 7: 190068 events in 0 files, snapshot none (task 6567 ms: download 3839 ms overlapping gunzip 975 ms, parse 4065 ms, sort 0 ms, write 0 ms, index 745 ms: 2 candidates, 74554 repo-hours, 811 releases; waiting 474 ms; commit 0 ms)
2026-11-08T04:06:33Z [load_day 2024-01-11] 2024-01-11 hour 8: 215086 events in 0 files, snapshot none (task 8241 ms: download 5504 ms overlapping gunzip 1336 ms, parse 5554 ms, sort 0 ms, write 0 ms, index 619 ms: 3 candidates, 83239 repo-hours, 1174 releases; waiting 511 ms; commit 0 ms)
2026-11-08T04:06:35Z [load_day 2024-01-11] 2024-01-11 hour 9: 217212 events in 0 files, snapshot none (task 9015 ms: download 6370 ms overlapping gunzip 1445 ms, parse 6161 ms, sort 0 ms, write 0 ms, index 629 ms: 8 candidates, 86973 repo-hours, 1449 releases; waiting 511 ms; commit 0 ms)
2026-11-08T04:06:42Z [load_day 2024-01-11] 2024-01-11 hour 10: 200373 events in 0 files, snapshot none (task 8270 ms: download 5247 ms overlapping gunzip 1287 ms, parse 5441 ms, sort 0 ms, write 0 ms, index 732 ms: 6 candidates, 86056 repo-hours, 1198 releases; waiting 498 ms; commit 0 ms)
2026-11-08T04:06:43Z [load_day 2024-01-11] 2024-01-11 hour 11: 194379 events in 0 files, snapshot none (task 7681 ms: download 4925 ms overlapping gunzip 1292 ms, parse 5399 ms, sort 0 ms, write 0 ms, index 613 ms: 6 candidates, 80810 repo-hours, 1023 releases; waiting 172 ms; commit 0 ms)
2026-11-08T04:06:52Z [load_day 2024-01-11] 2024-01-11 hour 12: 247036 events in 0 files, snapshot none (task 8975 ms: download 5298 ms overlapping gunzip 1334 ms, parse 5910 ms, sort 0 ms, write 0 ms, index 993 ms: 4 candidates, 113241 repo-hours, 1186 releases; waiting 507 ms; commit 0 ms)
2026-11-08T04:06:53Z [load_day 2024-01-11] 2024-01-11 hour 13: 236599 events in 0 files, snapshot none (task 9714 ms: download 6530 ms overlapping gunzip 1576 ms, parse 6592 ms, sort 0 ms, write 0 ms, index 819 ms: 7 candidates, 106119 repo-hours, 1013 releases; waiting 189 ms; commit 0 ms)
2026-11-08T04:07:02Z [load_day 2024-01-11] 2024-01-11 hour 14: 238150 events in 0 files, snapshot none (task 9819 ms: download 7151 ms overlapping gunzip 1573 ms, parse 6556 ms, sort 0 ms, write 0 ms, index 698 ms: 8 candidates, 94157 repo-hours, 1112 releases; waiting 631 ms; commit 0 ms)
2026-11-08T04:07:02Z [load_day 2024-01-11] 2024-01-11 hour 15: 239323 events in 0 files, snapshot none (task 8924 ms: download 6379 ms overlapping gunzip 1438 ms, parse 5922 ms, sort 0 ms, write 0 ms, index 700 ms: 6 candidates, 96090 repo-hours, 1287 releases; waiting 584 ms; commit 0 ms)
2026-11-08T04:07:11Z [load_day 2024-01-11] 2024-01-11 hour 16: 238416 events in 0 files, snapshot none (task 8044 ms: download 5582 ms overlapping gunzip 1244 ms, parse 5381 ms, sort 0 ms, write 0 ms, index 677 ms: 5 candidates, 94347 repo-hours, 1133 releases; waiting 495 ms; commit 0 ms)
2026-11-08T04:07:11Z [load_day 2024-01-11] 2024-01-11 hour 17: 223596 events in 0 files, snapshot none (task 7619 ms: download 5144 ms overlapping gunzip 1185 ms, parse 4986 ms, sort 0 ms, write 0 ms, index 655 ms: 8 candidates, 88808 repo-hours, 972 releases; waiting 507 ms; commit 0 ms)
2026-11-08T04:07:19Z [load_day 2024-01-11] 2024-01-11 hour 18: 206971 events in 0 files, snapshot none (task 7990 ms: download 4292 ms overlapping gunzip 1206 ms, parse 4882 ms, sort 0 ms, write 0 ms, index 1072 ms: 5 candidates, 91667 repo-hours, 1074 releases; waiting 598 ms; commit 0 ms)
2026-11-08T04:07:20Z [load_day 2024-01-11] 2024-01-11 hour 19: 189951 events in 0 files, snapshot none (task 9274 ms: download 5991 ms overlapping gunzip 1302 ms, parse 5525 ms, sort 0 ms, write 0 ms, index 581 ms: 9 candidates, 78634 repo-hours, 912 releases; waiting 1573 ms; commit 0 ms)
2026-11-08T04:07:27Z [load_day 2024-01-11] 2024-01-11 hour 20: 189311 events in 0 files, snapshot none (task 7619 ms: download 4307 ms overlapping gunzip 1105 ms, parse 4907 ms, sort 0 ms, write 0 ms, index 819 ms: 5 candidates, 75263 repo-hours, 935 releases; waiting 539 ms; commit 0 ms)
2026-11-08T04:07:28Z [load_day 2024-01-11] 2024-01-11 hour 21: 193856 events in 0 files, snapshot none (task 7511 ms: download 4972 ms overlapping gunzip 1229 ms, parse 4995 ms, sort 0 ms, write 0 ms, index 535 ms: 5 candidates, 70230 repo-hours, 1017 releases; waiting 512 ms; commit 0 ms)
2026-11-08T04:07:34Z [load_day 2024-01-11] 2024-01-11 hour 22: 175353 events in 0 files, snapshot none (task 6559 ms: download 4009 ms overlapping gunzip 1018 ms, parse 4201 ms, sort 0 ms, write 0 ms, index 470 ms: 5 candidates, 62038 repo-hours, 1105 releases; waiting 560 ms; commit 0 ms)
2026-11-08T04:07:35Z [load_day 2024-01-11] 2024-01-11 hour 23: 161661 events in 0 files, snapshot none (task 5753 ms: download 3224 ms overlapping gunzip 857 ms, parse 3681 ms, sort 0 ms, write 0 ms, index 413 ms: 6 candidates, 57358 repo-hours, 828 releases; waiting 530 ms; commit 0 ms)
2026-11-08T04:07:43Z [load_day 2024-01-11] 2024-01-11: repo_hour merged from 24 files to 1 (1950358 rows, 8652 ms)
2026-11-08T04:07:47Z [load_day 2024-01-11] 2024-01-11: index committed in 12638 ms (24 + 1 + 24 files)
2026-11-08T04:07:47Z [load_day 2024-01-11] 2024-01-11: 4832067 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:07:47Z [load_day 2024-01-11] attempt 1 succeeded