orcaLog in

Runs · run 2843

load_day 2024-08-14, attempt 1 succeeded

Host
73ccef5e07c2:164048
Started
2026-11-08T07:26:36Z
Ended
2026-11-08T07:28:32Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
750 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
175.5 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2843/load_day/2024-08-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:26:36Z [load_day 2024-08-14] attempt 1 started
2026-11-08T07:26:37Z [load_day 2024-08-14] 2024-08-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:26:44Z [load_day 2024-08-14] 2024-08-14 hour 0: 181811 events in 0 files, snapshot none (task 6871 ms: download 3678 ms overlapping gunzip 922 ms, parse 4173 ms, sort 0 ms, write 0 ms, index 902 ms: 7 candidates, 93041 repo-hours, 1264 releases; waiting 537 ms; commit 0 ms)
2026-11-08T07:26:45Z [load_day 2024-08-14] 2024-08-14 hour 1: 190909 events in 0 files, snapshot none (task 7377 ms: download 3814 ms overlapping gunzip 1048 ms, parse 4688 ms, sort 0 ms, write 0 ms, index 828 ms: 9 candidates, 107047 repo-hours, 889 releases; waiting 531 ms; commit 0 ms)
2026-11-08T07:26:52Z [load_day 2024-08-14] 2024-08-14 hour 2: 158325 events in 0 files, snapshot none (task 6877 ms: download 3801 ms overlapping gunzip 962 ms, parse 4056 ms, sort 0 ms, write 0 ms, index 982 ms: 8 candidates, 68184 repo-hours, 774 releases; waiting 524 ms; commit 0 ms)
2026-11-08T07:26:52Z [load_day 2024-08-14] 2024-08-14 hour 3: 177970 events in 0 files, snapshot none (task 6473 ms: download 3685 ms overlapping gunzip 939 ms, parse 4029 ms, sort 0 ms, write 0 ms, index 649 ms: 6 candidates, 75332 repo-hours, 4665 releases; waiting 533 ms; commit 0 ms)
2026-11-08T07:26:58Z [load_day 2024-08-14] 2024-08-14 hour 4: 154778 events in 0 files, snapshot none (task 6047 ms: download 3725 ms overlapping gunzip 896 ms, parse 3895 ms, sort 0 ms, write 0 ms, index 459 ms: 6 candidates, 60709 repo-hours, 630 releases; waiting 524 ms; commit 0 ms)
2026-11-08T07:26:59Z [load_day 2024-08-14] 2024-08-14 hour 5: 171342 events in 0 files, snapshot none (task 6327 ms: download 3994 ms overlapping gunzip 886 ms, parse 4085 ms, sort 0 ms, write 0 ms, index 500 ms: 6 candidates, 67855 repo-hours, 929 releases; waiting 542 ms; commit 0 ms)
2026-11-08T07:27:07Z [load_day 2024-08-14] 2024-08-14 hour 6: 202034 events in 0 files, snapshot none (task 8062 ms: download 5515 ms overlapping gunzip 1251 ms, parse 5275 ms, sort 0 ms, write 0 ms, index 675 ms: 5 candidates, 91850 repo-hours, 1034 releases; waiting 571 ms; commit 0 ms)
2026-11-08T07:27:07Z [load_day 2024-08-14] 2024-08-14 hour 7: 204845 events in 0 files, snapshot none (task 7554 ms: download 5128 ms overlapping gunzip 1257 ms, parse 5181 ms, sort 0 ms, write 0 ms, index 641 ms: 12 candidates, 82399 repo-hours, 940 releases; waiting 219 ms; commit 0 ms)
2026-11-08T07:27:14Z [load_day 2024-08-14] 2024-08-14 hour 8: 220831 events in 0 files, snapshot none (task 7136 ms: download 4512 ms overlapping gunzip 1113 ms, parse 4522 ms, sort 0 ms, write 0 ms, index 705 ms: 22 candidates, 90706 repo-hours, 1226 releases; waiting 512 ms; commit 0 ms)
2026-11-08T07:27:15Z [load_day 2024-08-14] 2024-08-14 hour 9: 223380 events in 0 files, snapshot none (task 7912 ms: download 5383 ms overlapping gunzip 1184 ms, parse 5057 ms, sort 0 ms, write 0 ms, index 727 ms: 14 candidates, 94893 repo-hours, 1246 releases; waiting 649 ms; commit 0 ms)
2026-11-08T07:27:24Z [load_day 2024-08-14] 2024-08-14 hour 10: 211245 events in 0 files, snapshot none (task 9114 ms: download 5831 ms overlapping gunzip 1563 ms, parse 5987 ms, sort 0 ms, write 0 ms, index 748 ms: 12 candidates, 85607 repo-hours, 1127 releases; waiting 505 ms; commit 0 ms)
2026-11-08T07:27:24Z [load_day 2024-08-14] 2024-08-14 hour 11: 211683 events in 0 files, snapshot none (task 8025 ms: download 5129 ms overlapping gunzip 1211 ms, parse 5291 ms, sort 0 ms, write 0 ms, index 787 ms: 8 candidates, 83383 repo-hours, 1109 releases; waiting 528 ms; commit 0 ms)
2026-11-08T07:27:35Z [load_day 2024-08-14] 2024-08-14 hour 12: 266137 events in 0 files, snapshot none (task 10697 ms: download 7311 ms overlapping gunzip 1630 ms, parse 7025 ms, sort 0 ms, write 0 ms, index 1243 ms: 7 candidates, 130925 repo-hours, 1313 releases; waiting 518 ms; commit 0 ms)
2026-11-08T07:27:36Z [load_day 2024-08-14] 2024-08-14 hour 13: 243027 events in 0 files, snapshot none (task 11091 ms: download 7863 ms overlapping gunzip 1750 ms, parse 7274 ms, sort 0 ms, write 0 ms, index 1342 ms: 8 candidates, 110748 repo-hours, 1340 releases; waiting 513 ms; commit 0 ms)
2026-11-08T07:27:46Z [load_day 2024-08-14] 2024-08-14 hour 14: 233812 events in 0 files, snapshot none (task 10515 ms: download 7180 ms overlapping gunzip 1608 ms, parse 7154 ms, sort 0 ms, write 0 ms, index 896 ms: 11 candidates, 97919 repo-hours, 1441 releases; waiting 486 ms; commit 0 ms)
2026-11-08T07:27:46Z [load_day 2024-08-14] 2024-08-14 hour 15: 239510 events in 0 files, snapshot none (task 10297 ms: download 6937 ms overlapping gunzip 1658 ms, parse 7154 ms, sort 0 ms, write 0 ms, index 849 ms: 6 candidates, 103963 repo-hours, 1340 releases; waiting 338 ms; commit 0 ms)
2026-11-08T07:27:57Z [load_day 2024-08-14] 2024-08-14 hour 16: 221099 events in 0 files, snapshot none (task 9982 ms: download 7268 ms overlapping gunzip 1690 ms, parse 6866 ms, sort 0 ms, write 0 ms, index 651 ms: 8 candidates, 91321 repo-hours, 1235 releases; waiting 503 ms; commit 0 ms)
2026-11-08T07:27:57Z [load_day 2024-08-14] 2024-08-14 hour 17: 216049 events in 0 files, snapshot none (task 9158 ms: download 6551 ms overlapping gunzip 1492 ms, parse 6012 ms, sort 0 ms, write 0 ms, index 622 ms: 14 candidates, 85618 repo-hours, 1086 releases; waiting 790 ms; commit 0 ms)
2026-11-08T07:28:06Z [load_day 2024-08-14] 2024-08-14 hour 18: 223567 events in 0 files, snapshot none (task 9037 ms: download 5932 ms overlapping gunzip 1308 ms, parse 5703 ms, sort 0 ms, write 0 ms, index 1238 ms: 15 candidates, 96529 repo-hours, 1128 releases; waiting 494 ms; commit 0 ms)
2026-11-08T07:28:06Z [load_day 2024-08-14] 2024-08-14 hour 19: 199126 events in 0 files, snapshot none (task 8359 ms: download 5774 ms overlapping gunzip 1357 ms, parse 5726 ms, sort 0 ms, write 0 ms, index 728 ms: 19 candidates, 75051 repo-hours, 1096 releases; waiting 225 ms; commit 0 ms)
2026-11-08T07:28:15Z [load_day 2024-08-14] 2024-08-14 hour 20: 192533 events in 0 files, snapshot none (task 8168 ms: download 5378 ms overlapping gunzip 1230 ms, parse 4991 ms, sort 0 ms, write 0 ms, index 798 ms: 9 candidates, 75084 repo-hours, 1004 releases; waiting 802 ms; commit 0 ms)
2026-11-08T07:28:15Z [load_day 2024-08-14] 2024-08-14 hour 21: 182598 events in 0 files, snapshot none (task 6889 ms: download 4367 ms overlapping gunzip 1071 ms, parse 4528 ms, sort 0 ms, write 0 ms, index 584 ms: 19 candidates, 72596 repo-hours, 1193 releases; waiting 482 ms; commit 0 ms)
2026-11-08T07:28:21Z [load_day 2024-08-14] 2024-08-14 hour 22: 151955 events in 0 files, snapshot none (task 5361 ms: download 3127 ms overlapping gunzip 834 ms, parse 3354 ms, sort 0 ms, write 0 ms, index 397 ms: 15 candidates, 56930 repo-hours, 989 releases; waiting 529 ms; commit 0 ms)
2026-11-08T07:28:21Z [load_day 2024-08-14] 2024-08-14 hour 23: 489 events in 0 files, snapshot none (task 498 ms: download 177 ms overlapping gunzip 2 ms, parse 10 ms, sort 0 ms, write 0 ms, index 27 ms: 0 candidates, 415 repo-hours, 2 releases; waiting 175 ms; commit 0 ms)
2026-11-08T07:28:29Z [load_day 2024-08-14] 2024-08-14: repo_hour merged from 24 files to 1 (1998105 rows, 8585 ms)
2026-11-08T07:28:32Z [load_day 2024-08-14] 2024-08-14: index committed in 11310 ms (23 + 1 + 24 files)
2026-11-08T07:28:32Z [load_day 2024-08-14] 2024-08-14: 4679055 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:28:32Z [load_day 2024-08-14] attempt 1 succeeded