orcaLog in

Runs · run 2728

load_day 2024-07-18, attempt 1 succeeded

Host
73ccef5e07c2:151136
Started
2026-11-08T07:02:25Z
Ended
2026-11-08T07:04:18Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
874 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
173.4 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2728/load_day/2024-07-18/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:02:25Z [load_day 2024-07-18] attempt 1 started
2026-11-08T07:02:26Z [load_day 2024-07-18] 2024-07-18: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:02:34Z [load_day 2024-07-18] 2024-07-18 hour 0: 171720 events in 0 files, snapshot none (task 7976 ms: download 4127 ms overlapping gunzip 1144 ms, parse 4968 ms, sort 0 ms, write 0 ms, index 1092 ms: 12 candidates, 94208 repo-hours, 1081 releases; waiting 529 ms; commit 0 ms)
2026-11-08T07:02:34Z [load_day 2024-07-18] 2024-07-18 hour 1: 185713 events in 0 files, snapshot none (task 7979 ms: download 3810 ms overlapping gunzip 1085 ms, parse 4695 ms, sort 0 ms, write 0 ms, index 1250 ms: 8 candidates, 106914 repo-hours, 780 releases; waiting 639 ms; commit 0 ms)
2026-11-08T07:02:41Z [load_day 2024-07-18] 2024-07-18 hour 2: 155836 events in 0 files, snapshot none (task 5980 ms: download 3594 ms overlapping gunzip 931 ms, parse 3821 ms, sort 0 ms, write 0 ms, index 525 ms: 9 candidates, 67742 repo-hours, 854 releases; waiting 465 ms; commit 0 ms)
2026-11-08T07:02:41Z [load_day 2024-07-18] 2024-07-18 hour 3: 175387 events in 0 files, snapshot none (task 6034 ms: download 3397 ms overlapping gunzip 893 ms, parse 3774 ms, sort 0 ms, write 0 ms, index 534 ms: 5 candidates, 76663 repo-hours, 5442 releases; waiting 464 ms; commit 0 ms)
2026-11-08T07:02:48Z [load_day 2024-07-18] 2024-07-18 hour 4: 149600 events in 0 files, snapshot none (task 6424 ms: download 3226 ms overlapping gunzip 943 ms, parse 4085 ms, sort 0 ms, write 0 ms, index 570 ms: 6 candidates, 60895 repo-hours, 662 releases; waiting 521 ms; commit 0 ms)
2026-11-08T07:02:48Z [load_day 2024-07-18] 2024-07-18 hour 5: 166149 events in 0 files, snapshot none (task 7011 ms: download 5383 ms overlapping gunzip 1112 ms, parse 4518 ms, sort 0 ms, write 0 ms, index 541 ms: 4 candidates, 67905 repo-hours, 748 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:02:56Z [load_day 2024-07-18] 2024-07-18 hour 6: 198181 events in 0 files, snapshot none (task 7991 ms: download 4701 ms overlapping gunzip 1187 ms, parse 5147 ms, sort 0 ms, write 0 ms, index 831 ms: 7 candidates, 93799 repo-hours, 1005 releases; waiting 516 ms; commit 0 ms)
2026-11-08T07:02:57Z [load_day 2024-07-18] 2024-07-18 hour 7: 204609 events in 0 files, snapshot none (task 8442 ms: download 5621 ms overlapping gunzip 1245 ms, parse 5670 ms, sort 0 ms, write 0 ms, index 661 ms: 7 candidates, 86975 repo-hours, 917 releases; waiting 565 ms; commit 0 ms)
2026-11-08T07:03:06Z [load_day 2024-07-18] 2024-07-18 hour 8: 219920 events in 0 files, snapshot none (task 9317 ms: download 6564 ms overlapping gunzip 1490 ms, parse 6332 ms, sort 0 ms, write 0 ms, index 654 ms: 15 candidates, 94449 repo-hours, 1099 releases; waiting 535 ms; commit 0 ms)
2026-11-08T07:03:06Z [load_day 2024-07-18] 2024-07-18 hour 9: 204751 events in 0 files, snapshot none (task 8380 ms: download 5460 ms overlapping gunzip 1299 ms, parse 5687 ms, sort 0 ms, write 0 ms, index 767 ms: 7 candidates, 94567 repo-hours, 1278 releases; waiting 358 ms; commit 0 ms)
2026-11-08T07:03:16Z [load_day 2024-07-18] 2024-07-18 hour 10: 202896 events in 0 files, snapshot none (task 9865 ms: download 7379 ms overlapping gunzip 1193 ms, parse 5284 ms, sort 0 ms, write 0 ms, index 623 ms: 8 candidates, 86987 repo-hours, 1056 releases; waiting 2492 ms; commit 0 ms)
2026-11-08T07:03:16Z [load_day 2024-07-18] 2024-07-18 hour 11: 209001 events in 0 files, snapshot none (task 8059 ms: download 4781 ms overlapping gunzip 1201 ms, parse 5271 ms, sort 0 ms, write 0 ms, index 797 ms: 11 candidates, 86038 repo-hours, 1013 releases; waiting 548 ms; commit 0 ms)
2026-11-08T07:03:25Z [load_day 2024-07-18] 2024-07-18 hour 12: 266500 events in 0 files, snapshot none (task 8429 ms: download 5487 ms overlapping gunzip 1245 ms, parse 5608 ms, sort 0 ms, write 0 ms, index 933 ms: 10 candidates, 139971 repo-hours, 1200 releases; waiting 285 ms; commit 0 ms)
2026-11-08T07:03:25Z [load_day 2024-07-18] 2024-07-18 hour 13: 247437 events in 0 files, snapshot none (task 8515 ms: download 5897 ms overlapping gunzip 1319 ms, parse 5614 ms, sort 0 ms, write 0 ms, index 804 ms: 16 candidates, 119623 repo-hours, 1276 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:03:34Z [load_day 2024-07-18] 2024-07-18 hour 14: 238563 events in 0 files, snapshot none (task 7958 ms: download 5461 ms overlapping gunzip 1248 ms, parse 5146 ms, sort 0 ms, write 0 ms, index 706 ms: 15 candidates, 105293 repo-hours, 1268 releases; waiting 605 ms; commit 0 ms)
2026-11-08T07:03:34Z [load_day 2024-07-18] 2024-07-18 hour 15: 246935 events in 0 files, snapshot none (task 7166 ms: download 4523 ms overlapping gunzip 1124 ms, parse 4628 ms, sort 0 ms, write 0 ms, index 781 ms: 9 candidates, 121120 repo-hours, 1328 releases; waiting 288 ms; commit 0 ms)
2026-11-08T07:03:41Z [load_day 2024-07-18] 2024-07-18 hour 16: 222324 events in 0 files, snapshot none (task 7053 ms: download 4510 ms overlapping gunzip 1076 ms, parse 4507 ms, sort 0 ms, write 0 ms, index 734 ms: 10 candidates, 97361 repo-hours, 1255 releases; waiting 506 ms; commit 0 ms)
2026-11-08T07:03:41Z [load_day 2024-07-18] 2024-07-18 hour 17: 212410 events in 0 files, snapshot none (task 6858 ms: download 4378 ms overlapping gunzip 1063 ms, parse 4356 ms, sort 0 ms, write 0 ms, index 676 ms: 4 candidates, 88798 repo-hours, 1131 releases; waiting 494 ms; commit 0 ms)
2026-11-08T07:03:50Z [load_day 2024-07-18] 2024-07-18 hour 18: 217675 events in 0 files, snapshot none (task 8682 ms: download 5821 ms overlapping gunzip 1342 ms, parse 5671 ms, sort 0 ms, write 0 ms, index 755 ms: 6 candidates, 100729 repo-hours, 1191 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:03:50Z [load_day 2024-07-18] 2024-07-18 hour 19: 190092 events in 0 files, snapshot none (task 8044 ms: download 5406 ms overlapping gunzip 1283 ms, parse 5238 ms, sort 0 ms, write 0 ms, index 826 ms: 11 candidates, 76440 repo-hours, 990 releases; waiting 471 ms; commit 0 ms)
2026-11-08T07:03:59Z [load_day 2024-07-18] 2024-07-18 hour 20: 192624 events in 0 files, snapshot none (task 7649 ms: download 4689 ms overlapping gunzip 1161 ms, parse 4933 ms, sort 0 ms, write 0 ms, index 737 ms: 15 candidates, 83348 repo-hours, 975 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:03:59Z [load_day 2024-07-18] 2024-07-18 hour 21: 175355 events in 0 files, snapshot none (task 7496 ms: download 3866 ms overlapping gunzip 1044 ms, parse 4346 ms, sort 0 ms, write 0 ms, index 1370 ms: 6 candidates, 73613 repo-hours, 1186 releases; waiting 468 ms; commit 0 ms)
2026-11-08T07:04:06Z [load_day 2024-07-18] 2024-07-18 hour 22: 148043 events in 0 files, snapshot none (task 6883 ms: download 4124 ms overlapping gunzip 1102 ms, parse 4423 ms, sort 0 ms, write 0 ms, index 509 ms: 4 candidates, 57198 repo-hours, 1062 releases; waiting 595 ms; commit 0 ms)
2026-11-08T07:04:06Z [load_day 2024-07-18] 2024-07-18 hour 23: 122495 events in 0 files, snapshot none (task 6082 ms: download 2626 ms overlapping gunzip 947 ms, parse 3914 ms, sort 0 ms, write 0 ms, index 426 ms: 2 candidates, 48338 repo-hours, 660 releases; waiting 523 ms; commit 0 ms)
2026-11-08T07:04:15Z [load_day 2024-07-18] 2024-07-18: repo_hour merged from 24 files to 1 (2128974 rows, 9239 ms)
2026-11-08T07:04:18Z [load_day 2024-07-18] 2024-07-18: index committed in 11631 ms (24 + 1 + 24 files)
2026-11-08T07:04:18Z [load_day 2024-07-18] 2024-07-18: 4724216 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:04:18Z [load_day 2024-07-18] attempt 1 succeeded