orcaLog in

Runs · run 1842

load_day 2023-12-11, attempt 1 succeeded

Host
73ccef5e07c2:8516
Started
2026-11-08T03:42:52Z
Ended
2026-11-08T03:44:50Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
694 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
195.1 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1842/load_day/2023-12-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T03:42:52Z [load_day 2023-12-11] attempt 1 started
2026-11-08T03:42:52Z [load_day 2023-12-11] 2023-12-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T03:43:00Z [load_day 2023-12-11] 2023-12-11 hour 0: 218432 events in 0 files, snapshot none (task 6791 ms: download 4083 ms overlapping gunzip 939 ms, parse 4105 ms, sort 0 ms, write 0 ms, index 574 ms: 9 candidates, 78092 repo-hours, 855 releases; waiting 524 ms; commit 0 ms)
2026-11-08T03:43:00Z [load_day 2023-12-11] 2023-12-11 hour 1: 231743 events in 0 files, snapshot none (task 7354 ms: download 4927 ms overlapping gunzip 1160 ms, parse 4752 ms, sort 0 ms, write 0 ms, index 644 ms: 9 candidates, 88914 repo-hours, 792 releases; waiting 529 ms; commit 0 ms)
2026-11-08T03:43:06Z [load_day 2023-12-11] 2023-12-11 hour 2: 202924 events in 0 files, snapshot none (task 5384 ms: download 3215 ms overlapping gunzip 858 ms, parse 3365 ms, sort 0 ms, write 0 ms, index 427 ms: 8 candidates, 60603 repo-hours, 702 releases; waiting 506 ms; commit 0 ms)
2026-11-08T03:43:06Z [load_day 2023-12-11] 2023-12-11 hour 3: 199998 events in 0 files, snapshot none (task 5613 ms: download 3463 ms overlapping gunzip 904 ms, parse 3540 ms, sort 0 ms, write 0 ms, index 427 ms: 9 candidates, 59553 repo-hours, 834 releases; waiting 530 ms; commit 0 ms)
2026-11-08T03:43:12Z [load_day 2023-12-11] 2023-12-11 hour 4: 202940 events in 0 files, snapshot none (task 5973 ms: download 3283 ms overlapping gunzip 909 ms, parse 3688 ms, sort 0 ms, write 0 ms, index 626 ms: 7 candidates, 56924 repo-hours, 693 releases; waiting 499 ms; commit 0 ms)
2026-11-08T03:43:13Z [load_day 2023-12-11] 2023-12-11 hour 5: 205679 events in 0 files, snapshot none (task 5909 ms: download 3484 ms overlapping gunzip 929 ms, parse 3642 ms, sort 0 ms, write 0 ms, index 510 ms: 10 candidates, 61418 repo-hours, 679 releases; waiting 562 ms; commit 0 ms)
2026-11-08T03:43:21Z [load_day 2023-12-11] 2023-12-11 hour 6: 223135 events in 0 files, snapshot none (task 7860 ms: download 4835 ms overlapping gunzip 1326 ms, parse 5100 ms, sort 0 ms, write 0 ms, index 667 ms: 5 candidates, 74345 repo-hours, 852 releases; waiting 540 ms; commit 0 ms)
2026-11-08T03:43:21Z [load_day 2023-12-11] 2023-12-11 hour 7: 229771 events in 0 files, snapshot none (task 7859 ms: download 5121 ms overlapping gunzip 1347 ms, parse 5176 ms, sort 0 ms, write 0 ms, index 570 ms: 9 candidates, 73988 repo-hours, 900 releases; waiting 518 ms; commit 0 ms)
2026-11-08T03:43:30Z [load_day 2023-12-11] 2023-12-11 hour 8: 236418 events in 0 files, snapshot none (task 8537 ms: download 5372 ms overlapping gunzip 1450 ms, parse 5702 ms, sort 0 ms, write 0 ms, index 643 ms: 14 candidates, 81409 repo-hours, 922 releases; waiting 468 ms; commit 0 ms)
2026-11-08T03:43:31Z [load_day 2023-12-11] 2023-12-11 hour 9: 241729 events in 0 files, snapshot none (task 9220 ms: download 6805 ms overlapping gunzip 1521 ms, parse 6334 ms, sort 0 ms, write 0 ms, index 616 ms: 12 candidates, 86939 repo-hours, 1355 releases; waiting 495 ms; commit 0 ms)
2026-11-08T03:43:40Z [load_day 2023-12-11] 2023-12-11 hour 10: 238452 events in 0 files, snapshot none (task 10210 ms: download 7588 ms overlapping gunzip 1670 ms, parse 7146 ms, sort 0 ms, write 0 ms, index 658 ms: 10 candidates, 86854 repo-hours, 1172 releases; waiting 486 ms; commit 0 ms)
2026-11-08T03:43:41Z [load_day 2023-12-11] 2023-12-11 hour 11: 252226 events in 0 files, snapshot none (task 10041 ms: download 7525 ms overlapping gunzip 1713 ms, parse 6819 ms, sort 0 ms, write 0 ms, index 603 ms: 5 candidates, 82569 repo-hours, 1149 releases; waiting 484 ms; commit 0 ms)
2026-11-08T03:43:51Z [load_day 2023-12-11] 2023-12-11 hour 12: 276759 events in 0 files, snapshot none (task 10046 ms: download 7003 ms overlapping gunzip 1515 ms, parse 6483 ms, sort 0 ms, write 0 ms, index 923 ms: 10 candidates, 112709 repo-hours, 1030 releases; waiting 698 ms; commit 0 ms)
2026-11-08T03:43:52Z [load_day 2023-12-11] 2023-12-11 hour 13: 265225 events in 0 files, snapshot none (task 9716 ms: download 6926 ms overlapping gunzip 1508 ms, parse 6456 ms, sort 0 ms, write 0 ms, index 904 ms: 11 candidates, 103365 repo-hours, 1078 releases; waiting 473 ms; commit 0 ms)
2026-11-08T03:44:01Z [load_day 2023-12-11] 2023-12-11 hour 14: 267146 events in 0 files, snapshot none (task 9954 ms: download 6830 ms overlapping gunzip 1670 ms, parse 6534 ms, sort 0 ms, write 0 ms, index 971 ms: 10 candidates, 95383 repo-hours, 1305 releases; waiting 505 ms; commit 0 ms)
2026-11-08T03:44:02Z [load_day 2023-12-11] 2023-12-11 hour 15: 263975 events in 0 files, snapshot none (task 10105 ms: download 6885 ms overlapping gunzip 1700 ms, parse 6984 ms, sort 0 ms, write 0 ms, index 740 ms: 8 candidates, 95368 repo-hours, 1295 releases; waiting 454 ms; commit 0 ms)
2026-11-08T03:44:12Z [load_day 2023-12-11] 2023-12-11 hour 16: 263143 events in 0 files, snapshot none (task 10118 ms: download 6689 ms overlapping gunzip 1609 ms, parse 6882 ms, sort 0 ms, write 0 ms, index 861 ms: 6 candidates, 93765 repo-hours, 1133 releases; waiting 508 ms; commit 0 ms)
2026-11-08T03:44:13Z [load_day 2023-12-11] 2023-12-11 hour 17: 250303 events in 0 files, snapshot none (task 9669 ms: download 6537 ms overlapping gunzip 1602 ms, parse 6860 ms, sort 0 ms, write 0 ms, index 717 ms: 17 candidates, 85570 repo-hours, 941 releases; waiting 185 ms; commit 0 ms)
2026-11-08T03:44:22Z [load_day 2023-12-11] 2023-12-11 hour 18: 245527 events in 0 files, snapshot none (task 9255 ms: download 6212 ms overlapping gunzip 1468 ms, parse 6315 ms, sort 0 ms, write 0 ms, index 709 ms: 10 candidates, 88680 repo-hours, 1086 releases; waiting 482 ms; commit 0 ms)
2026-11-08T03:44:22Z [load_day 2023-12-11] 2023-12-11 hour 19: 211752 events in 0 files, snapshot none (task 9279 ms: download 6185 ms overlapping gunzip 1548 ms, parse 6209 ms, sort 0 ms, write 0 ms, index 665 ms: 16 candidates, 82475 repo-hours, 1040 releases; waiting 468 ms; commit 0 ms)
2026-11-08T03:44:31Z [load_day 2023-12-11] 2023-12-11 hour 20: 225212 events in 0 files, snapshot none (task 8444 ms: download 4984 ms overlapping gunzip 1332 ms, parse 5457 ms, sort 0 ms, write 0 ms, index 845 ms: 19 candidates, 77555 repo-hours, 843 releases; waiting 528 ms; commit 0 ms)
2026-11-08T03:44:31Z [load_day 2023-12-11] 2023-12-11 hour 21: 232763 events in 0 files, snapshot none (task 8524 ms: download 5695 ms overlapping gunzip 1390 ms, parse 5761 ms, sort 0 ms, write 0 ms, index 541 ms: 11 candidates, 71992 repo-hours, 1009 releases; waiting 500 ms; commit 0 ms)
2026-11-08T03:44:39Z [load_day 2023-12-11] 2023-12-11 hour 22: 212922 events in 0 files, snapshot none (task 7736 ms: download 4619 ms overlapping gunzip 1259 ms, parse 5075 ms, sort 0 ms, write 0 ms, index 633 ms: 10 candidates, 65695 repo-hours, 980 releases; waiting 532 ms; commit 0 ms)
2026-11-08T03:44:39Z [load_day 2023-12-11] 2023-12-11 hour 23: 212246 events in 0 files, snapshot none (task 7168 ms: download 4198 ms overlapping gunzip 1189 ms, parse 4622 ms, sort 0 ms, write 0 ms, index 577 ms: 11 candidates, 59612 repo-hours, 785 releases; waiting 493 ms; commit 0 ms)
2026-11-08T03:44:47Z [load_day 2023-12-11] 2023-12-11: repo_hour merged from 24 files to 1 (1923777 rows, 8314 ms)
2026-11-08T03:44:50Z [load_day 2023-12-11] 2023-12-11: index committed in 10547 ms (24 + 1 + 24 files)
2026-11-08T03:44:50Z [load_day 2023-12-11] 2023-12-11: 5610420 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T03:44:50Z [load_day 2023-12-11] attempt 1 succeeded