orcaLog in

Runs · run 2169

load_day 2024-03-07, attempt 1 succeeded

Host
73ccef5e07c2:95265
Started
2026-11-08T04:59:44Z
Ended
2026-11-08T05:01:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
739 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
191.9 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2169/load_day/2024-03-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:59:44Z [load_day 2024-03-07] attempt 1 started
2026-11-08T04:59:45Z [load_day 2024-03-07] 2024-03-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:59:53Z [load_day 2024-03-07] 2024-03-07 hour 0: 256520 events in 0 files, snapshot none (task 8605 ms: download 5615 ms overlapping gunzip 1332 ms, parse 5805 ms, sort 0 ms, write 0 ms, index 756 ms: 10 candidates, 110495 repo-hours, 1234 releases; waiting 507 ms; commit 0 ms)
2026-11-08T04:59:53Z [load_day 2024-03-07] 2024-03-07 hour 1: 237852 events in 0 files, snapshot none (task 7873 ms: download 4960 ms overlapping gunzip 1255 ms, parse 5024 ms, sort 0 ms, write 0 ms, index 805 ms: 7 candidates, 94377 repo-hours, 794 releases; waiting 492 ms; commit 0 ms)
2026-11-08T05:00:01Z [load_day 2024-03-07] 2024-03-07 hour 2: 213515 events in 0 files, snapshot none (task 7333 ms: download 3691 ms overlapping gunzip 1106 ms, parse 4656 ms, sort 0 ms, write 0 ms, index 812 ms: 6 candidates, 66958 repo-hours, 708 releases; waiting 485 ms; commit 0 ms)
2026-11-08T05:00:01Z [load_day 2024-03-07] 2024-03-07 hour 3: 209497 events in 0 files, snapshot none (task 7139 ms: download 3678 ms overlapping gunzip 1091 ms, parse 4569 ms, sort 0 ms, write 0 ms, index 630 ms: 7 candidates, 65984 repo-hours, 833 releases; waiting 522 ms; commit 0 ms)
2026-11-08T05:00:08Z [load_day 2024-03-07] 2024-03-07 hour 4: 201740 events in 0 files, snapshot none (task 6726 ms: download 3298 ms overlapping gunzip 1010 ms, parse 4188 ms, sort 0 ms, write 0 ms, index 716 ms: 8 candidates, 61291 repo-hours, 590 releases; waiting 508 ms; commit 0 ms)
2026-11-08T05:00:09Z [load_day 2024-03-07] 2024-03-07 hour 5: 238971 events in 0 files, snapshot none (task 6927 ms: download 3697 ms overlapping gunzip 1039 ms, parse 4416 ms, sort 0 ms, write 0 ms, index 694 ms: 7 candidates, 67326 repo-hours, 678 releases; waiting 519 ms; commit 0 ms)
2026-11-08T05:00:16Z [load_day 2024-03-07] 2024-03-07 hour 6: 257119 events in 0 files, snapshot none (task 7254 ms: download 4698 ms overlapping gunzip 1084 ms, parse 4770 ms, sort 0 ms, write 0 ms, index 608 ms: 6 candidates, 80776 repo-hours, 804 releases; waiting 523 ms; commit 0 ms)
2026-11-08T05:00:17Z [load_day 2024-03-07] 2024-03-07 hour 7: 262119 events in 0 files, snapshot none (task 7986 ms: download 5324 ms overlapping gunzip 1204 ms, parse 5342 ms, sort 0 ms, write 0 ms, index 639 ms: 5 candidates, 81834 repo-hours, 871 releases; waiting 510 ms; commit 0 ms)
2026-11-08T05:00:27Z [load_day 2024-03-07] 2024-03-07 hour 8: 271118 events in 0 files, snapshot none (task 9632 ms: download 6886 ms overlapping gunzip 1621 ms, parse 6641 ms, sort 0 ms, write 0 ms, index 634 ms: 12 candidates, 86728 repo-hours, 1171 releases; waiting 487 ms; commit 0 ms)
2026-11-08T05:00:27Z [load_day 2024-03-07] 2024-03-07 hour 9: 291243 events in 0 files, snapshot none (task 9647 ms: download 7103 ms overlapping gunzip 1554 ms, parse 6651 ms, sort 0 ms, write 0 ms, index 715 ms: 13 candidates, 92295 repo-hours, 1268 releases; waiting 473 ms; commit 0 ms)
2026-11-08T05:00:37Z [load_day 2024-03-07] 2024-03-07 hour 10: 286824 events in 0 files, snapshot none (task 10146 ms: download 7602 ms overlapping gunzip 1502 ms, parse 7215 ms, sort 0 ms, write 0 ms, index 681 ms: 9 candidates, 90932 repo-hours, 1193 releases; waiting 495 ms; commit 0 ms)
2026-11-08T05:00:37Z [load_day 2024-03-07] 2024-03-07 hour 11: 286333 events in 0 files, snapshot none (task 9014 ms: download 6438 ms overlapping gunzip 1423 ms, parse 6231 ms, sort 0 ms, write 0 ms, index 657 ms: 10 candidates, 87697 repo-hours, 1066 releases; waiting 449 ms; commit 0 ms)
2026-11-08T05:00:47Z [load_day 2024-03-07] 2024-03-07 hour 12: 316499 events in 0 files, snapshot none (task 9640 ms: download 6752 ms overlapping gunzip 1381 ms, parse 6448 ms, sort 0 ms, write 0 ms, index 803 ms: 8 candidates, 115741 repo-hours, 1112 releases; waiting 743 ms; commit 0 ms)
2026-11-08T05:00:48Z [load_day 2024-03-07] 2024-03-07 hour 13: 302127 events in 0 files, snapshot none (task 9816 ms: download 7254 ms overlapping gunzip 1499 ms, parse 6846 ms, sort 0 ms, write 0 ms, index 759 ms: 10 candidates, 109103 repo-hours, 1181 releases; waiting 498 ms; commit 0 ms)
2026-11-08T05:00:58Z [load_day 2024-03-07] 2024-03-07 hour 14: 302836 events in 0 files, snapshot none (task 10312 ms: download 7768 ms overlapping gunzip 1623 ms, parse 6997 ms, sort 0 ms, write 0 ms, index 702 ms: 8 candidates, 99948 repo-hours, 1887 releases; waiting 722 ms; commit 0 ms)
2026-11-08T05:00:59Z [load_day 2024-03-07] 2024-03-07 hour 15: 302857 events in 0 files, snapshot none (task 10203 ms: download 7703 ms overlapping gunzip 1603 ms, parse 7215 ms, sort 0 ms, write 0 ms, index 720 ms: 7 candidates, 100765 repo-hours, 1294 releases; waiting 432 ms; commit 0 ms)
2026-11-08T05:01:08Z [load_day 2024-03-07] 2024-03-07 hour 16: 302253 events in 0 files, snapshot none (task 9252 ms: download 6738 ms overlapping gunzip 1499 ms, parse 6610 ms, sort 0 ms, write 0 ms, index 663 ms: 12 candidates, 96979 repo-hours, 1762 releases; waiting 212 ms; commit 0 ms)
2026-11-08T05:01:08Z [load_day 2024-03-07] 2024-03-07 hour 17: 291106 events in 0 files, snapshot none (task 9046 ms: download 6647 ms overlapping gunzip 1484 ms, parse 6229 ms, sort 0 ms, write 0 ms, index 619 ms: 9 candidates, 90738 repo-hours, 1124 releases; waiting 467 ms; commit 0 ms)
2026-11-08T05:01:16Z [load_day 2024-03-07] 2024-03-07 hour 18: 293760 events in 0 files, snapshot none (task 7515 ms: download 5046 ms overlapping gunzip 1191 ms, parse 4849 ms, sort 0 ms, write 0 ms, index 713 ms: 14 candidates, 94429 repo-hours, 1128 releases; waiting 518 ms; commit 0 ms)
2026-11-08T05:01:16Z [load_day 2024-03-07] 2024-03-07 hour 19: 278651 events in 0 files, snapshot none (task 7462 ms: download 5014 ms overlapping gunzip 1162 ms, parse 4967 ms, sort 0 ms, write 0 ms, index 624 ms: 9 candidates, 79340 repo-hours, 968 releases; waiting 481 ms; commit 0 ms)
2026-11-08T05:01:25Z [load_day 2024-03-07] 2024-03-07 hour 20: 267112 events in 0 files, snapshot none (task 8507 ms: download 5254 ms overlapping gunzip 1296 ms, parse 5845 ms, sort 0 ms, write 0 ms, index 640 ms: 9 candidates, 77355 repo-hours, 907 releases; waiting 492 ms; commit 0 ms)
2026-11-08T05:01:25Z [load_day 2024-03-07] 2024-03-07 hour 21: 256197 events in 0 files, snapshot none (task 7978 ms: download 5102 ms overlapping gunzip 1225 ms, parse 5398 ms, sort 0 ms, write 0 ms, index 548 ms: 5 candidates, 71357 repo-hours, 981 releases; waiting 530 ms; commit 0 ms)
2026-11-08T05:01:34Z [load_day 2024-03-07] 2024-03-07 hour 22: 242938 events in 0 files, snapshot none (task 8118 ms: download 5533 ms overlapping gunzip 1321 ms, parse 5485 ms, sort 0 ms, write 0 ms, index 529 ms: 6 candidates, 66930 repo-hours, 1002 releases; waiting 479 ms; commit 0 ms)
2026-11-08T05:01:34Z [load_day 2024-03-07] 2024-03-07 hour 23: 230815 events in 0 files, snapshot none (task 6869 ms: download 3591 ms overlapping gunzip 1080 ms, parse 4673 ms, sort 0 ms, write 0 ms, index 644 ms: 4 candidates, 63704 repo-hours, 746 releases; waiting 224 ms; commit 0 ms)
2026-11-08T05:01:43Z [load_day 2024-03-07] 2024-03-07: repo_hour merged from 24 files to 1 (2053082 rows, 8997 ms)
2026-11-08T05:01:45Z [load_day 2024-03-07] 2024-03-07: index committed in 11597 ms (24 + 1 + 24 files)
2026-11-08T05:01:45Z [load_day 2024-03-07] 2024-03-07: 6400002 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:01:45Z [load_day 2024-03-07] attempt 1 succeeded