orcaLog in

Runs · run 2719

load_day 2024-07-15, attempt 1 succeeded

Host
73ccef5e07c2:150098
Started
2026-11-08T06:59:42Z
Ended
2026-11-08T07:01:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
730 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
196.2 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2719/load_day/2024-07-15/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:59:42Z [load_day 2024-07-15] attempt 1 started
2026-11-08T06:59:43Z [load_day 2024-07-15] 2024-07-15: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:59:50Z [load_day 2024-07-15] 2024-07-15 hour 0: 157941 events in 0 files, snapshot none (task 5838 ms: download 3244 ms overlapping gunzip 930 ms, parse 3776 ms, sort 0 ms, write 0 ms, index 599 ms: 5 candidates, 80703 repo-hours, 935 releases; waiting 205 ms; commit 0 ms)
2026-11-08T06:59:50Z [load_day 2024-07-15] 2024-07-15 hour 1: 178194 events in 0 files, snapshot none (task 6834 ms: download 4311 ms overlapping gunzip 1055 ms, parse 4332 ms, sort 0 ms, write 0 ms, index 653 ms: 9 candidates, 100089 repo-hours, 812 releases; waiting 530 ms; commit 0 ms)
2026-11-08T06:59:56Z [load_day 2024-07-15] 2024-07-15 hour 2: 149604 events in 0 files, snapshot none (task 5867 ms: download 3294 ms overlapping gunzip 1003 ms, parse 3775 ms, sort 0 ms, write 0 ms, index 562 ms: 2 candidates, 63643 repo-hours, 804 releases; waiting 258 ms; commit 0 ms)
2026-11-08T06:59:58Z [load_day 2024-07-15] 2024-07-15 hour 3: 175472 events in 0 files, snapshot none (task 6965 ms: download 4534 ms overlapping gunzip 1153 ms, parse 4508 ms, sort 0 ms, write 0 ms, index 643 ms: 6 candidates, 72208 repo-hours, 5364 releases; waiting 456 ms; commit 0 ms)
2026-11-08T07:00:04Z [load_day 2024-07-15] 2024-07-15 hour 4: 154735 events in 0 files, snapshot none (task 7407 ms: download 4881 ms overlapping gunzip 1293 ms, parse 4543 ms, sort 0 ms, write 0 ms, index 399 ms: 3 candidates, 57960 repo-hours, 619 releases; waiting 764 ms; commit 0 ms)
2026-11-08T07:00:06Z [load_day 2024-07-15] 2024-07-15 hour 5: 169447 events in 0 files, snapshot none (task 7136 ms: download 4459 ms overlapping gunzip 1147 ms, parse 4392 ms, sort 0 ms, write 0 ms, index 847 ms: 4 candidates, 65953 repo-hours, 792 releases; waiting 498 ms; commit 0 ms)
2026-11-08T07:00:13Z [load_day 2024-07-15] 2024-07-15 hour 6: 204778 events in 0 files, snapshot none (task 8563 ms: download 5455 ms overlapping gunzip 1343 ms, parse 5534 ms, sort 0 ms, write 0 ms, index 982 ms: 5 candidates, 93181 repo-hours, 924 releases; waiting 500 ms; commit 0 ms)
2026-11-08T07:00:15Z [load_day 2024-07-15] 2024-07-15 hour 7: 207819 events in 0 files, snapshot none (task 8164 ms: download 5346 ms overlapping gunzip 1347 ms, parse 5296 ms, sort 0 ms, write 0 ms, index 738 ms: 27 candidates, 84259 repo-hours, 1014 releases; waiting 514 ms; commit 0 ms)
2026-11-08T07:00:22Z [load_day 2024-07-15] 2024-07-15 hour 8: 222429 events in 0 files, snapshot none (task 8399 ms: download 6076 ms overlapping gunzip 1339 ms, parse 5707 ms, sort 0 ms, write 0 ms, index 640 ms: 26 candidates, 92921 repo-hours, 1115 releases; waiting 497 ms; commit 0 ms)
2026-11-08T07:00:24Z [load_day 2024-07-15] 2024-07-15 hour 9: 230375 events in 0 files, snapshot none (task 8965 ms: download 6519 ms overlapping gunzip 1478 ms, parse 6051 ms, sort 0 ms, write 0 ms, index 695 ms: 21 candidates, 98506 repo-hours, 1356 releases; waiting 523 ms; commit 0 ms)
2026-11-08T07:00:29Z [load_day 2024-07-15] 2024-07-15 hour 10: 217888 events in 0 files, snapshot none (task 6707 ms: download 4355 ms overlapping gunzip 1162 ms, parse 4663 ms, sort 0 ms, write 0 ms, index 648 ms: 19 candidates, 93467 repo-hours, 955 releases; waiting 17 ms; commit 0 ms)
2026-11-08T07:00:31Z [load_day 2024-07-15] 2024-07-15 hour 11: 217048 events in 0 files, snapshot none (task 6801 ms: download 4512 ms overlapping gunzip 1193 ms, parse 4791 ms, sort 0 ms, write 0 ms, index 606 ms: 13 candidates, 85333 repo-hours, 1064 releases; waiting 23 ms; commit 0 ms)
2026-11-08T07:00:39Z [load_day 2024-07-15] 2024-07-15 hour 12: 272658 events in 0 files, snapshot none (task 9638 ms: download 6602 ms overlapping gunzip 1591 ms, parse 6899 ms, sort 0 ms, write 0 ms, index 957 ms: 18 candidates, 132583 repo-hours, 1208 releases; waiting 13 ms; commit 0 ms)
2026-11-08T07:00:42Z [load_day 2024-07-15] 2024-07-15 hour 13: 252525 events in 0 files, snapshot none (task 10408 ms: download 7131 ms overlapping gunzip 1669 ms, parse 7116 ms, sort 0 ms, write 0 ms, index 1396 ms: 18 candidates, 114763 repo-hours, 1234 releases; waiting 22 ms; commit 0 ms)
2026-11-08T07:00:49Z [load_day 2024-07-15] 2024-07-15 hour 14: 244592 events in 0 files, snapshot none (task 9628 ms: download 6794 ms overlapping gunzip 1747 ms, parse 6857 ms, sort 0 ms, write 0 ms, index 795 ms: 22 candidates, 101633 repo-hours, 1346 releases; waiting 19 ms; commit 0 ms)
2026-11-08T07:00:53Z [load_day 2024-07-15] 2024-07-15 hour 15: 245225 events in 0 files, snapshot none (task 9798 ms: download 6787 ms overlapping gunzip 1611 ms, parse 6753 ms, sort 0 ms, write 0 ms, index 934 ms: 20 candidates, 106806 repo-hours, 1418 releases; waiting 228 ms; commit 0 ms)
2026-11-08T07:01:00Z [load_day 2024-07-15] 2024-07-15 hour 16: 228018 events in 0 files, snapshot none (task 10645 ms: download 6891 ms overlapping gunzip 1872 ms, parse 7430 ms, sort 0 ms, write 0 ms, index 1112 ms: 14 candidates, 94444 repo-hours, 1312 releases; waiting 18 ms; commit 0 ms)
2026-11-08T07:01:01Z [load_day 2024-07-15] 2024-07-15 hour 17: 221313 events in 0 files, snapshot none (task 8375 ms: download 5719 ms overlapping gunzip 1436 ms, parse 6000 ms, sort 0 ms, write 0 ms, index 702 ms: 21 candidates, 87705 repo-hours, 1142 releases; waiting 18 ms; commit 0 ms)
2026-11-08T07:01:11Z [load_day 2024-07-15] 2024-07-15 hour 18: 233962 events in 0 files, snapshot none (task 10144 ms: download 7232 ms overlapping gunzip 1688 ms, parse 6814 ms, sort 0 ms, write 0 ms, index 856 ms: 16 candidates, 108465 repo-hours, 1120 releases; waiting 528 ms; commit 0 ms)
2026-11-08T07:01:11Z [load_day 2024-07-15] 2024-07-15 hour 19: 206523 events in 0 files, snapshot none (task 8881 ms: download 6379 ms overlapping gunzip 1684 ms, parse 6303 ms, sort 0 ms, write 0 ms, index 680 ms: 15 candidates, 83563 repo-hours, 949 releases; waiting 11 ms; commit 0 ms)
2026-11-08T07:01:20Z [load_day 2024-07-15] 2024-07-15 hour 20: 204631 events in 0 files, snapshot none (task 8406 ms: download 5966 ms overlapping gunzip 1573 ms, parse 6050 ms, sort 0 ms, write 0 ms, index 578 ms: 13 candidates, 80169 repo-hours, 1076 releases; waiting 5 ms; commit 0 ms)
2026-11-08T07:01:20Z [load_day 2024-07-15] 2024-07-15 hour 21: 191282 events in 0 files, snapshot none (task 8163 ms: download 5500 ms overlapping gunzip 1455 ms, parse 5928 ms, sort 0 ms, write 0 ms, index 565 ms: 22 candidates, 75879 repo-hours, 1128 releases; waiting 18 ms; commit 0 ms)
2026-11-08T07:01:28Z [load_day 2024-07-15] 2024-07-15 hour 22: 169126 events in 0 files, snapshot none (task 7544 ms: download 4680 ms overlapping gunzip 1257 ms, parse 4745 ms, sort 0 ms, write 0 ms, index 500 ms: 12 candidates, 60997 repo-hours, 1017 releases; waiting 470 ms; commit 0 ms)
2026-11-08T07:01:28Z [load_day 2024-07-15] 2024-07-15 hour 23: 159166 events in 0 files, snapshot none (task 6228 ms: download 3540 ms overlapping gunzip 1078 ms, parse 4480 ms, sort 0 ms, write 0 ms, index 464 ms: 15 candidates, 57402 repo-hours, 706 releases; waiting 15 ms; commit 0 ms)
2026-11-08T07:01:37Z [load_day 2024-07-15] 2024-07-15: repo_hour merged from 24 files to 1 (2092632 rows, 8786 ms)
2026-11-08T07:01:39Z [load_day 2024-07-15] 2024-07-15: index committed in 11102 ms (24 + 1 + 24 files)
2026-11-08T07:01:39Z [load_day 2024-07-15] 2024-07-15: 4914751 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:01:39Z [load_day 2024-07-15] attempt 1 succeeded