orcaLog in

Runs · run 2406

load_day 2024-05-03, attempt 1 succeeded

Host
73ccef5e07c2:117620
Started
2026-11-08T05:55:18Z
Ended
2026-11-08T05:57:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
693 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
187.6 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2406/load_day/2024-05-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:55:18Z [load_day 2024-05-03] attempt 1 started
2026-11-08T05:55:19Z [load_day 2024-05-03] 2024-05-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:55:27Z [load_day 2024-05-03] 2024-05-03 hour 0: 204429 events in 0 files, snapshot none (task 7471 ms: download 4473 ms overlapping gunzip 1090 ms, parse 4921 ms, sort 0 ms, write 0 ms, index 721 ms: 14 candidates, 85983 repo-hours, 1038 releases; waiting 509 ms; commit 0 ms)
2026-11-08T05:55:27Z [load_day 2024-05-03] 2024-05-03 hour 1: 198390 events in 0 files, snapshot none (task 7512 ms: download 4576 ms overlapping gunzip 1063 ms, parse 4796 ms, sort 0 ms, write 0 ms, index 773 ms: 6 candidates, 95416 repo-hours, 835 releases; waiting 468 ms; commit 0 ms)
2026-11-08T05:55:35Z [load_day 2024-05-03] 2024-05-03 hour 2: 168342 events in 0 files, snapshot none (task 6769 ms: download 3927 ms overlapping gunzip 1037 ms, parse 4383 ms, sort 0 ms, write 0 ms, index 494 ms: 13 candidates, 57855 repo-hours, 675 releases; waiting 482 ms; commit 0 ms)
2026-11-08T05:55:35Z [load_day 2024-05-03] 2024-05-03 hour 3: 164808 events in 0 files, snapshot none (task 6589 ms: download 3578 ms overlapping gunzip 1041 ms, parse 4220 ms, sort 0 ms, write 0 ms, index 579 ms: 18 candidates, 61859 repo-hours, 2170 releases; waiting 385 ms; commit 0 ms)
2026-11-08T05:55:41Z [load_day 2024-05-03] 2024-05-03 hour 4: 160094 events in 0 files, snapshot none (task 6335 ms: download 3739 ms overlapping gunzip 949 ms, parse 4212 ms, sort 0 ms, write 0 ms, index 454 ms: 6 candidates, 58729 repo-hours, 668 releases; waiting 494 ms; commit 0 ms)
2026-11-08T05:55:42Z [load_day 2024-05-03] 2024-05-03 hour 5: 167687 events in 0 files, snapshot none (task 6620 ms: download 4073 ms overlapping gunzip 1084 ms, parse 4230 ms, sort 0 ms, write 0 ms, index 528 ms: 4 candidates, 61091 repo-hours, 784 releases; waiting 512 ms; commit 0 ms)
2026-11-08T05:55:49Z [load_day 2024-05-03] 2024-05-03 hour 6: 201896 events in 0 files, snapshot none (task 6722 ms: download 4163 ms overlapping gunzip 999 ms, parse 4550 ms, sort 0 ms, write 0 ms, index 551 ms: 5 candidates, 79132 repo-hours, 918 releases; waiting 326 ms; commit 0 ms)
2026-11-08T05:55:50Z [load_day 2024-05-03] 2024-05-03 hour 7: 204585 events in 0 files, snapshot none (task 7838 ms: download 5418 ms overlapping gunzip 1144 ms, parse 5408 ms, sort 0 ms, write 0 ms, index 547 ms: 8 candidates, 74693 repo-hours, 862 releases; waiting 465 ms; commit 0 ms)
2026-11-08T05:55:56Z [load_day 2024-05-03] 2024-05-03 hour 8: 219492 events in 0 files, snapshot none (task 7250 ms: download 4808 ms overlapping gunzip 1106 ms, parse 4800 ms, sort 0 ms, write 0 ms, index 566 ms: 14 candidates, 81807 repo-hours, 1105 releases; waiting 519 ms; commit 0 ms)
2026-11-08T05:55:58Z [load_day 2024-05-03] 2024-05-03 hour 9: 230864 events in 0 files, snapshot none (task 7959 ms: download 5417 ms overlapping gunzip 1202 ms, parse 5252 ms, sort 0 ms, write 0 ms, index 648 ms: 11 candidates, 87451 repo-hours, 1231 releases; waiting 545 ms; commit 0 ms)
2026-11-08T05:56:05Z [load_day 2024-05-03] 2024-05-03 hour 10: 225225 events in 0 files, snapshot none (task 7724 ms: download 4775 ms overlapping gunzip 1075 ms, parse 4680 ms, sort 0 ms, write 0 ms, index 946 ms: 9 candidates, 82691 repo-hours, 1055 releases; waiting 702 ms; commit 0 ms)
2026-11-08T05:56:07Z [load_day 2024-05-03] 2024-05-03 hour 11: 222289 events in 0 files, snapshot none (task 8528 ms: download 5090 ms overlapping gunzip 1188 ms, parse 5192 ms, sort 0 ms, write 0 ms, index 1072 ms: 6 candidates, 80909 repo-hours, 1087 releases; waiting 696 ms; commit 0 ms)
2026-11-08T05:56:15Z [load_day 2024-05-03] 2024-05-03 hour 12: 285092 events in 0 files, snapshot none (task 9534 ms: download 5927 ms overlapping gunzip 1378 ms, parse 6438 ms, sort 0 ms, write 0 ms, index 945 ms: 8 candidates, 119725 repo-hours, 1331 releases; waiting 504 ms; commit 0 ms)
2026-11-08T05:56:17Z [load_day 2024-05-03] 2024-05-03 hour 13: 265075 events in 0 files, snapshot none (task 9409 ms: download 6313 ms overlapping gunzip 1397 ms, parse 6045 ms, sort 0 ms, write 0 ms, index 1166 ms: 11 candidates, 107000 repo-hours, 1225 releases; waiting 510 ms; commit 0 ms)
2026-11-08T05:56:26Z [load_day 2024-05-03] 2024-05-03 hour 14: 245113 events in 0 files, snapshot none (task 11269 ms: download 8231 ms overlapping gunzip 1821 ms, parse 7983 ms, sort 0 ms, write 0 ms, index 711 ms: 19 candidates, 95902 repo-hours, 1146 releases; waiting 495 ms; commit 0 ms)
2026-11-08T05:56:28Z [load_day 2024-05-03] 2024-05-03 hour 15: 246546 events in 0 files, snapshot none (task 9497 ms: download 6739 ms overlapping gunzip 1466 ms, parse 6427 ms, sort 0 ms, write 0 ms, index 736 ms: 9 candidates, 96787 repo-hours, 1353 releases; waiting 499 ms; commit 0 ms)
2026-11-08T05:56:37Z [load_day 2024-05-03] 2024-05-03 hour 16: 238560 events in 0 files, snapshot none (task 9668 ms: download 6377 ms overlapping gunzip 1448 ms, parse 6531 ms, sort 0 ms, write 0 ms, index 777 ms: 15 candidates, 90308 repo-hours, 1180 releases; waiting 641 ms; commit 0 ms)
2026-11-08T05:56:37Z [load_day 2024-05-03] 2024-05-03 hour 17: 220773 events in 0 files, snapshot none (task 8603 ms: download 5529 ms overlapping gunzip 1300 ms, parse 5881 ms, sort 0 ms, write 0 ms, index 620 ms: 9 candidates, 82075 repo-hours, 1009 releases; waiting 472 ms; commit 0 ms)
2026-11-08T05:56:45Z [load_day 2024-05-03] 2024-05-03 hour 18: 229198 events in 0 files, snapshot none (task 8424 ms: download 5350 ms overlapping gunzip 1261 ms, parse 5673 ms, sort 0 ms, write 0 ms, index 736 ms: 16 candidates, 91025 repo-hours, 1743 releases; waiting 491 ms; commit 0 ms)
2026-11-08T05:56:46Z [load_day 2024-05-03] 2024-05-03 hour 19: 219546 events in 0 files, snapshot none (task 8516 ms: download 5978 ms overlapping gunzip 1398 ms, parse 5612 ms, sort 0 ms, write 0 ms, index 633 ms: 20 candidates, 75534 repo-hours, 1076 releases; waiting 528 ms; commit 0 ms)
2026-11-08T05:56:54Z [load_day 2024-05-03] 2024-05-03 hour 20: 207216 events in 0 files, snapshot none (task 8452 ms: download 6058 ms overlapping gunzip 1392 ms, parse 5724 ms, sort 0 ms, write 0 ms, index 534 ms: 12 candidates, 73880 repo-hours, 991 releases; waiting 516 ms; commit 0 ms)
2026-11-08T05:56:55Z [load_day 2024-05-03] 2024-05-03 hour 21: 199081 events in 0 files, snapshot none (task 9065 ms: download 6480 ms overlapping gunzip 1549 ms, parse 6183 ms, sort 0 ms, write 0 ms, index 557 ms: 22 candidates, 69716 repo-hours, 964 releases; waiting 200 ms; commit 0 ms)
2026-11-08T05:57:02Z [load_day 2024-05-03] 2024-05-03 hour 22: 177525 events in 0 files, snapshot none (task 7117 ms: download 4717 ms overlapping gunzip 1058 ms, parse 4717 ms, sort 0 ms, write 0 ms, index 533 ms: 14 candidates, 59500 repo-hours, 864 releases; waiting 521 ms; commit 0 ms)
2026-11-08T05:57:02Z [load_day 2024-05-03] 2024-05-03 hour 23: 153209 events in 0 files, snapshot none (task 5556 ms: download 3194 ms overlapping gunzip 829 ms, parse 3518 ms, sort 0 ms, write 0 ms, index 398 ms: 17 candidates, 52661 repo-hours, 799 releases; waiting 489 ms; commit 0 ms)
2026-11-08T05:57:10Z [load_day 2024-05-03] 2024-05-03: repo_hour merged from 24 files to 1 (1921729 rows, 8595 ms)
2026-11-08T05:57:13Z [load_day 2024-05-03] 2024-05-03: index committed in 10928 ms (24 + 1 + 24 files)
2026-11-08T05:57:13Z [load_day 2024-05-03] 2024-05-03: 5055035 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:57:13Z [load_day 2024-05-03] attempt 1 succeeded