orcaLog in

Runs · run 1869

load_day 2023-12-18, attempt 1 succeeded

Host
73ccef5e07c2:10497
Started
2026-11-08T03:48:10Z
Ended
2026-11-08T03:50:04Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
677 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
186.5 s, up to 3.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1869/load_day/2023-12-18/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T03:48:10Z [load_day 2023-12-18] attempt 1 started
2026-11-08T03:48:11Z [load_day 2023-12-18] 2023-12-18: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T03:48:17Z [load_day 2023-12-18] 2023-12-18 hour 0: 153499 events in 0 files, snapshot none (task 5808 ms: download 2936 ms overlapping gunzip 870 ms, parse 3534 ms, sort 0 ms, write 0 ms, index 573 ms: 6 candidates, 76850 repo-hours, 906 releases; waiting 528 ms; commit 0 ms)
2026-11-08T03:48:18Z [load_day 2023-12-18] 2023-12-18 hour 1: 173188 events in 0 files, snapshot none (task 6318 ms: download 3622 ms overlapping gunzip 980 ms, parse 3828 ms, sort 0 ms, write 0 ms, index 639 ms: 6 candidates, 89280 repo-hours, 834 releases; waiting 491 ms; commit 0 ms)
2026-11-08T03:48:24Z [load_day 2023-12-18] 2023-12-18 hour 2: 143034 events in 0 files, snapshot none (task 6005 ms: download 3542 ms overlapping gunzip 978 ms, parse 3756 ms, sort 0 ms, write 0 ms, index 373 ms: 4 candidates, 58566 repo-hours, 690 releases; waiting 534 ms; commit 0 ms)
2026-11-08T03:48:25Z [load_day 2023-12-18] 2023-12-18 hour 3: 145458 events in 0 files, snapshot none (task 6139 ms: download 3872 ms overlapping gunzip 1066 ms, parse 3912 ms, sort 0 ms, write 0 ms, index 409 ms: 2 candidates, 58902 repo-hours, 865 releases; waiting 443 ms; commit 0 ms)
2026-11-08T03:48:31Z [load_day 2023-12-18] 2023-12-18 hour 4: 144196 events in 0 files, snapshot none (task 6159 ms: download 3608 ms overlapping gunzip 948 ms, parse 3682 ms, sort 0 ms, write 0 ms, index 693 ms: 4 candidates, 55126 repo-hours, 578 releases; waiting 544 ms; commit 0 ms)
2026-11-08T03:48:31Z [load_day 2023-12-18] 2023-12-18 hour 5: 147217 events in 0 files, snapshot none (task 5844 ms: download 3191 ms overlapping gunzip 933 ms, parse 3560 ms, sort 0 ms, write 0 ms, index 617 ms: 7 candidates, 59243 repo-hours, 578 releases; waiting 428 ms; commit 0 ms)
2026-11-08T03:48:38Z [load_day 2023-12-18] 2023-12-18 hour 6: 170956 events in 0 files, snapshot none (task 6462 ms: download 3407 ms overlapping gunzip 939 ms, parse 3587 ms, sort 0 ms, write 0 ms, index 1032 ms: 7 candidates, 73858 repo-hours, 871 releases; waiting 541 ms; commit 0 ms)
2026-11-08T03:48:39Z [load_day 2023-12-18] 2023-12-18 hour 7: 182084 events in 0 files, snapshot none (task 7310 ms: download 4452 ms overlapping gunzip 1249 ms, parse 4663 ms, sort 0 ms, write 0 ms, index 563 ms: 6 candidates, 74158 repo-hours, 783 releases; waiting 564 ms; commit 0 ms)
2026-11-08T03:48:47Z [load_day 2023-12-18] 2023-12-18 hour 8: 194169 events in 0 files, snapshot none (task 9288 ms: download 5936 ms overlapping gunzip 1500 ms, parse 6328 ms, sort 0 ms, write 0 ms, index 582 ms: 12 candidates, 82433 repo-hours, 1067 releases; waiting 526 ms; commit 0 ms)
2026-11-08T03:48:49Z [load_day 2023-12-18] 2023-12-18 hour 9: 203236 events in 0 files, snapshot none (task 9472 ms: download 6864 ms overlapping gunzip 1570 ms, parse 6306 ms, sort 0 ms, write 0 ms, index 684 ms: 12 candidates, 86934 repo-hours, 1164 releases; waiting 606 ms; commit 0 ms)
2026-11-08T03:48:57Z [load_day 2023-12-18] 2023-12-18 hour 10: 203246 events in 0 files, snapshot none (task 9647 ms: download 6318 ms overlapping gunzip 1628 ms, parse 6376 ms, sort 0 ms, write 0 ms, index 707 ms: 11 candidates, 86146 repo-hours, 1093 releases; waiting 582 ms; commit 0 ms)
2026-11-08T03:48:58Z [load_day 2023-12-18] 2023-12-18 hour 11: 196140 events in 0 files, snapshot none (task 8311 ms: download 5440 ms overlapping gunzip 1387 ms, parse 5435 ms, sort 0 ms, write 0 ms, index 673 ms: 8 candidates, 81872 repo-hours, 1098 releases; waiting 504 ms; commit 0 ms)
2026-11-08T03:49:07Z [load_day 2023-12-18] 2023-12-18 hour 12: 238108 events in 0 files, snapshot none (task 8693 ms: download 6076 ms overlapping gunzip 1355 ms, parse 5738 ms, sort 0 ms, write 0 ms, index 730 ms: 6 candidates, 112381 repo-hours, 1122 releases; waiting 571 ms; commit 0 ms)
2026-11-08T03:49:07Z [load_day 2023-12-18] 2023-12-18 hour 13: 226621 events in 0 files, snapshot none (task 8735 ms: download 6279 ms overlapping gunzip 1428 ms, parse 5790 ms, sort 0 ms, write 0 ms, index 738 ms: 8 candidates, 108226 repo-hours, 1057 releases; waiting 503 ms; commit 0 ms)
2026-11-08T03:49:15Z [load_day 2023-12-18] 2023-12-18 hour 14: 218951 events in 0 files, snapshot none (task 7948 ms: download 5388 ms overlapping gunzip 1270 ms, parse 5139 ms, sort 0 ms, write 0 ms, index 678 ms: 6 candidates, 94619 repo-hours, 1170 releases; waiting 496 ms; commit 0 ms)
2026-11-08T03:49:15Z [load_day 2023-12-18] 2023-12-18 hour 15: 221542 events in 0 files, snapshot none (task 7786 ms: download 5306 ms overlapping gunzip 1259 ms, parse 5028 ms, sort 0 ms, write 0 ms, index 664 ms: 5 candidates, 95797 repo-hours, 1389 releases; waiting 521 ms; commit 0 ms)
2026-11-08T03:49:25Z [load_day 2023-12-18] 2023-12-18 hour 16: 216770 events in 0 files, snapshot none (task 9793 ms: download 7284 ms overlapping gunzip 1548 ms, parse 6732 ms, sort 0 ms, write 0 ms, index 753 ms: 11 candidates, 93981 repo-hours, 1199 releases; waiting 496 ms; commit 0 ms)
2026-11-08T03:49:25Z [load_day 2023-12-18] 2023-12-18 hour 17: 203817 events in 0 files, snapshot none (task 8553 ms: download 6113 ms overlapping gunzip 1447 ms, parse 5635 ms, sort 0 ms, write 0 ms, index 661 ms: 9 candidates, 84691 repo-hours, 1229 releases; waiting 581 ms; commit 0 ms)
2026-11-08T03:49:35Z [load_day 2023-12-18] 2023-12-18 hour 18: 204015 events in 0 files, snapshot none (task 8881 ms: download 5601 ms overlapping gunzip 1489 ms, parse 5842 ms, sort 0 ms, write 0 ms, index 686 ms: 12 candidates, 88380 repo-hours, 1149 releases; waiting 408 ms; commit 0 ms)
2026-11-08T03:49:35Z [load_day 2023-12-18] 2023-12-18 hour 19: 191003 events in 0 files, snapshot none (task 8739 ms: download 5381 ms overlapping gunzip 1564 ms, parse 6038 ms, sort 0 ms, write 0 ms, index 672 ms: 11 candidates, 77694 repo-hours, 1084 releases; waiting 181 ms; commit 0 ms)
2026-11-08T03:49:44Z [load_day 2023-12-18] 2023-12-18 hour 20: 185240 events in 0 files, snapshot none (task 9088 ms: download 6712 ms overlapping gunzip 1503 ms, parse 6176 ms, sort 0 ms, write 0 ms, index 598 ms: 12 candidates, 75727 repo-hours, 955 releases; waiting 514 ms; commit 0 ms)
2026-11-08T03:49:44Z [load_day 2023-12-18] 2023-12-18 hour 21: 179716 events in 0 files, snapshot none (task 8894 ms: download 6616 ms overlapping gunzip 1452 ms, parse 6122 ms, sort 0 ms, write 0 ms, index 515 ms: 13 candidates, 71153 repo-hours, 1027 releases; waiting 539 ms; commit 0 ms)
2026-11-08T03:49:53Z [load_day 2023-12-18] 2023-12-18 hour 22: 171099 events in 0 files, snapshot none (task 8170 ms: download 5841 ms overlapping gunzip 1406 ms, parse 5488 ms, sort 0 ms, write 0 ms, index 477 ms: 8 candidates, 65537 repo-hours, 1051 releases; waiting 507 ms; commit 0 ms)
2026-11-08T03:49:53Z [load_day 2023-12-18] 2023-12-18 hour 23: 163090 events in 0 files, snapshot none (task 8128 ms: download 5831 ms overlapping gunzip 1367 ms, parse 5495 ms, sort 0 ms, write 0 ms, index 427 ms: 6 candidates, 65237 repo-hours, 763 releases; waiting 528 ms; commit 0 ms)
2026-11-08T03:50:02Z [load_day 2023-12-18] 2023-12-18: repo_hour merged from 24 files to 1 (1916791 rows, 8686 ms)
2026-11-08T03:50:04Z [load_day 2023-12-18] 2023-12-18: index committed in 11587 ms (24 + 1 + 24 files)
2026-11-08T03:50:04Z [load_day 2023-12-18] 2023-12-18: 4476395 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T03:50:04Z [load_day 2023-12-18] attempt 1 succeeded