orcaLog in

Runs · run 1877

load_day 2023-12-20, attempt 1 succeeded

Host
73ccef5e07c2:11324
Started
2026-11-08T03:50:05Z
Ended
2026-11-08T03:51:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
715 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
160.9 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1877/load_day/2023-12-20/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T03:50:05Z [load_day 2023-12-20] attempt 1 started
2026-11-08T03:50:06Z [load_day 2023-12-20] 2023-12-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T03:50:13Z [load_day 2023-12-20] 2023-12-20 hour 0: 174887 events in 0 files, snapshot none (task 6809 ms: download 3450 ms overlapping gunzip 992 ms, parse 4001 ms, sort 0 ms, write 0 ms, index 1040 ms: 5 candidates, 94338 repo-hours, 1032 releases; waiting 474 ms; commit 0 ms)
2026-11-08T03:50:13Z [load_day 2023-12-20] 2023-12-20 hour 1: 160156 events in 0 files, snapshot none (task 6962 ms: download 3587 ms overlapping gunzip 1057 ms, parse 4314 ms, sort 0 ms, write 0 ms, index 776 ms: 7 candidates, 84693 repo-hours, 795 releases; waiting 522 ms; commit 0 ms)
2026-11-08T03:50:19Z [load_day 2023-12-20] 2023-12-20 hour 2: 140494 events in 0 files, snapshot none (task 5786 ms: download 3486 ms overlapping gunzip 937 ms, parse 3600 ms, sort 0 ms, write 0 ms, index 420 ms: 7 candidates, 60328 repo-hours, 733 releases; waiting 541 ms; commit 0 ms)
2026-11-08T03:50:19Z [load_day 2023-12-20] 2023-12-20 hour 3: 134798 events in 0 files, snapshot none (task 5350 ms: download 3082 ms overlapping gunzip 843 ms, parse 3331 ms, sort 0 ms, write 0 ms, index 453 ms: 6 candidates, 58702 repo-hours, 858 releases; waiting 483 ms; commit 0 ms)
2026-11-08T03:50:26Z [load_day 2023-12-20] 2023-12-20 hour 4: 129366 events in 0 files, snapshot none (task 5911 ms: download 3129 ms overlapping gunzip 900 ms, parse 3798 ms, sort 0 ms, write 0 ms, index 460 ms: 6 candidates, 54904 repo-hours, 689 releases; waiting 514 ms; commit 0 ms)
2026-11-08T03:50:26Z [load_day 2023-12-20] 2023-12-20 hour 5: 149742 events in 0 files, snapshot none (task 6790 ms: download 4121 ms overlapping gunzip 1211 ms, parse 4426 ms, sort 0 ms, write 0 ms, index 418 ms: 5 candidates, 61383 repo-hours, 704 releases; waiting 211 ms; commit 0 ms)
2026-11-08T03:50:32Z [load_day 2023-12-20] 2023-12-20 hour 6: 160683 events in 0 files, snapshot none (task 6112 ms: download 2686 ms overlapping gunzip 888 ms, parse 3533 ms, sort 0 ms, write 0 ms, index 886 ms: 7 candidates, 73824 repo-hours, 860 releases; waiting 536 ms; commit 0 ms)
2026-11-08T03:50:34Z [load_day 2023-12-20] 2023-12-20 hour 7: 164982 events in 0 files, snapshot none (task 6754 ms: download 3736 ms overlapping gunzip 980 ms, parse 4205 ms, sort 0 ms, write 0 ms, index 837 ms: 7 candidates, 71270 repo-hours, 884 releases; waiting 411 ms; commit 0 ms)
2026-11-08T03:50:40Z [load_day 2023-12-20] 2023-12-20 hour 8: 181569 events in 0 files, snapshot none (task 6878 ms: download 3732 ms overlapping gunzip 1085 ms, parse 4393 ms, sort 0 ms, write 0 ms, index 672 ms: 8 candidates, 79978 repo-hours, 1005 releases; waiting 532 ms; commit 0 ms)
2026-11-08T03:50:42Z [load_day 2023-12-20] 2023-12-20 hour 9: 191806 events in 0 files, snapshot none (task 7595 ms: download 5049 ms overlapping gunzip 1143 ms, parse 5032 ms, sort 0 ms, write 0 ms, index 641 ms: 3 candidates, 85298 repo-hours, 1244 releases; waiting 522 ms; commit 0 ms)
2026-11-08T03:50:48Z [load_day 2023-12-20] 2023-12-20 hour 10: 191617 events in 0 files, snapshot none (task 7668 ms: download 4484 ms overlapping gunzip 1151 ms, parse 4793 ms, sort 0 ms, write 0 ms, index 807 ms: 9 candidates, 82770 repo-hours, 1107 releases; waiting 590 ms; commit 0 ms)
2026-11-08T03:50:50Z [load_day 2023-12-20] 2023-12-20 hour 11: 190976 events in 0 files, snapshot none (task 7751 ms: download 5100 ms overlapping gunzip 1155 ms, parse 5086 ms, sort 0 ms, write 0 ms, index 716 ms: 3 candidates, 79328 repo-hours, 1039 releases; waiting 517 ms; commit 0 ms)
2026-11-08T03:50:55Z [load_day 2023-12-20] 2023-12-20 hour 12: 255806 events in 0 files, snapshot none (task 6765 ms: download 3959 ms overlapping gunzip 924 ms, parse 4243 ms, sort 0 ms, write 0 ms, index 757 ms: 7 candidates, 108250 repo-hours, 1115 releases; waiting 579 ms; commit 0 ms)
2026-11-08T03:50:57Z [load_day 2023-12-20] 2023-12-20 hour 13: 218402 events in 0 files, snapshot none (task 6720 ms: download 4062 ms overlapping gunzip 968 ms, parse 4187 ms, sort 0 ms, write 0 ms, index 839 ms: 5 candidates, 103359 repo-hours, 1769 releases; waiting 476 ms; commit 0 ms)
2026-11-08T03:51:03Z [load_day 2023-12-20] 2023-12-20 hour 14: 218389 events in 0 files, snapshot none (task 7260 ms: download 4767 ms overlapping gunzip 1179 ms, parse 4645 ms, sort 0 ms, write 0 ms, index 630 ms: 8 candidates, 94268 repo-hours, 1133 releases; waiting 501 ms; commit 0 ms)
2026-11-08T03:51:05Z [load_day 2023-12-20] 2023-12-20 hour 15: 215220 events in 0 files, snapshot none (task 7121 ms: download 4347 ms overlapping gunzip 1084 ms, parse 4520 ms, sort 0 ms, write 0 ms, index 708 ms: 5 candidates, 93248 repo-hours, 1346 releases; waiting 248 ms; commit 0 ms)
2026-11-08T03:51:12Z [load_day 2023-12-20] 2023-12-20 hour 16: 209659 events in 0 files, snapshot none (task 8764 ms: download 5900 ms overlapping gunzip 1360 ms, parse 5750 ms, sort 0 ms, write 0 ms, index 843 ms: 11 candidates, 88618 repo-hours, 1109 releases; waiting 512 ms; commit 0 ms)
2026-11-08T03:51:13Z [load_day 2023-12-20] 2023-12-20 hour 17: 192765 events in 0 files, snapshot none (task 8115 ms: download 4965 ms overlapping gunzip 1268 ms, parse 5254 ms, sort 0 ms, write 0 ms, index 783 ms: 14 candidates, 80974 repo-hours, 1000 releases; waiting 466 ms; commit 0 ms)
2026-11-08T03:51:20Z [load_day 2023-12-20] 2023-12-20 hour 18: 189123 events in 0 files, snapshot none (task 7336 ms: download 4311 ms overlapping gunzip 1128 ms, parse 4686 ms, sort 0 ms, write 0 ms, index 691 ms: 11 candidates, 82656 repo-hours, 1498 releases; waiting 556 ms; commit 0 ms)
2026-11-08T03:51:21Z [load_day 2023-12-20] 2023-12-20 hour 19: 174084 events in 0 files, snapshot none (task 6852 ms: download 4331 ms overlapping gunzip 1095 ms, parse 4399 ms, sort 0 ms, write 0 ms, index 546 ms: 9 candidates, 69825 repo-hours, 1054 releases; waiting 498 ms; commit 0 ms)
2026-11-08T03:51:27Z [load_day 2023-12-20] 2023-12-20 hour 20: 167991 events in 0 files, snapshot none (task 6594 ms: download 3630 ms overlapping gunzip 1025 ms, parse 4251 ms, sort 0 ms, write 0 ms, index 514 ms: 4 candidates, 68323 repo-hours, 1551 releases; waiting 529 ms; commit 0 ms)
2026-11-08T03:51:28Z [load_day 2023-12-20] 2023-12-20 hour 21: 158335 events in 0 files, snapshot none (task 6495 ms: download 4225 ms overlapping gunzip 1046 ms, parse 4253 ms, sort 0 ms, write 0 ms, index 423 ms: 6 candidates, 63549 repo-hours, 1078 releases; waiting 492 ms; commit 0 ms)
2026-11-08T03:51:34Z [load_day 2023-12-20] 2023-12-20 hour 22: 146478 events in 0 files, snapshot none (task 6668 ms: download 4238 ms overlapping gunzip 1019 ms, parse 4395 ms, sort 0 ms, write 0 ms, index 482 ms: 9 candidates, 57672 repo-hours, 1163 releases; waiting 508 ms; commit 0 ms)
2026-11-08T03:51:34Z [load_day 2023-12-20] 2023-12-20 hour 23: 127773 events in 0 files, snapshot none (task 5634 ms: download 2978 ms overlapping gunzip 884 ms, parse 3755 ms, sort 0 ms, write 0 ms, index 413 ms: 6 candidates, 52240 repo-hours, 908 releases; waiting 246 ms; commit 0 ms)
2026-11-08T03:51:42Z [load_day 2023-12-20] 2023-12-20: repo_hour merged from 24 files to 1 (1849798 rows, 8088 ms)
2026-11-08T03:51:45Z [load_day 2023-12-20] 2023-12-20: index committed in 10318 ms (24 + 1 + 24 files)
2026-11-08T03:51:45Z [load_day 2023-12-20] 2023-12-20: 4245101 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T03:51:45Z [load_day 2023-12-20] attempt 1 succeeded