orcaLog in

Runs · run 3975

load_day 2025-06-02, attempt 1 succeeded

Host
73ccef5e07c2:316102
Started
2026-11-08T12:15:40Z
Ended
2026-11-08T12:17:28Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
685 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
159.7 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3975/load_day/2025-06-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:15:40Z [load_day 2025-06-02] attempt 1 started
2026-11-08T12:15:41Z [load_day 2025-06-02] 2025-06-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:15:48Z [load_day 2025-06-02] 2025-06-02 hour 0: 142442 events in 0 files, snapshot none (task 6883 ms: download 4678 ms overlapping gunzip 870 ms, parse 3396 ms, sort 0 ms, write 0 ms, index 506 ms: 13 candidates, 66392 repo-hours, 1156 releases; waiting 1868 ms; commit 0 ms)
2026-11-08T12:15:48Z [load_day 2025-06-02] 2025-06-02 hour 1: 151733 events in 0 files, snapshot none (task 5748 ms: download 3133 ms overlapping gunzip 884 ms, parse 3459 ms, sort 0 ms, write 0 ms, index 573 ms: 6 candidates, 84264 repo-hours, 642 releases; waiting 515 ms; commit 0 ms)
2026-11-08T12:15:54Z [load_day 2025-06-02] 2025-06-02 hour 2: 147396 events in 0 files, snapshot none (task 5753 ms: download 4078 ms overlapping gunzip 921 ms, parse 3481 ms, sort 0 ms, write 0 ms, index 513 ms: 9 candidates, 71813 repo-hours, 661 releases; waiting 597 ms; commit 0 ms)
2026-11-08T12:15:54Z [load_day 2025-06-02] 2025-06-02 hour 3: 143315 events in 0 files, snapshot none (task 5586 ms: download 3312 ms overlapping gunzip 877 ms, parse 3304 ms, sort 0 ms, write 0 ms, index 459 ms: 6 candidates, 63894 repo-hours, 1650 releases; waiting 643 ms; commit 0 ms)
2026-11-08T12:16:00Z [load_day 2025-06-02] 2025-06-02 hour 4: 141433 events in 0 files, snapshot none (task 4950 ms: download 2896 ms overlapping gunzip 726 ms, parse 2817 ms, sort 0 ms, write 0 ms, index 510 ms: 6 candidates, 62979 repo-hours, 1041 releases; waiting 602 ms; commit 0 ms)
2026-11-08T12:16:00Z [load_day 2025-06-02] 2025-06-02 hour 5: 147051 events in 0 files, snapshot none (task 5254 ms: download 3062 ms overlapping gunzip 818 ms, parse 3145 ms, sort 0 ms, write 0 ms, index 472 ms: 11 candidates, 64239 repo-hours, 1267 releases; waiting 536 ms; commit 0 ms)
2026-11-08T12:16:08Z [load_day 2025-06-02] 2025-06-02 hour 6: 156176 events in 0 files, snapshot none (task 6892 ms: download 4439 ms overlapping gunzip 1087 ms, parse 4408 ms, sort 0 ms, write 0 ms, index 568 ms: 10 candidates, 76176 repo-hours, 941 releases; waiting 485 ms; commit 0 ms)
2026-11-08T12:16:08Z [load_day 2025-06-02] 2025-06-02 hour 7: 158161 events in 0 files, snapshot none (task 7134 ms: download 4741 ms overlapping gunzip 1229 ms, parse 4688 ms, sort 0 ms, write 0 ms, index 572 ms: 12 candidates, 73517 repo-hours, 830 releases; waiting 297 ms; commit 0 ms)
2026-11-08T12:16:16Z [load_day 2025-06-02] 2025-06-02 hour 8: 155583 events in 0 files, snapshot none (task 8085 ms: download 5180 ms overlapping gunzip 1248 ms, parse 5004 ms, sort 0 ms, write 0 ms, index 980 ms: 9 candidates, 76213 repo-hours, 775 releases; waiting 529 ms; commit 0 ms)
2026-11-08T12:16:16Z [load_day 2025-06-02] 2025-06-02 hour 9: 148226 events in 0 files, snapshot none (task 7521 ms: download 4903 ms overlapping gunzip 1197 ms, parse 4856 ms, sort 0 ms, write 0 ms, index 739 ms: 8 candidates, 74383 repo-hours, 838 releases; waiting 482 ms; commit 0 ms)
2026-11-08T12:16:24Z [load_day 2025-06-02] 2025-06-02 hour 10: 156123 events in 0 files, snapshot none (task 7467 ms: download 4338 ms overlapping gunzip 1253 ms, parse 4635 ms, sort 0 ms, write 0 ms, index 725 ms: 20 candidates, 76402 repo-hours, 846 releases; waiting 529 ms; commit 0 ms)
2026-11-08T12:16:25Z [load_day 2025-06-02] 2025-06-02 hour 11: 159491 events in 0 files, snapshot none (task 7922 ms: download 5087 ms overlapping gunzip 1274 ms, parse 5034 ms, sort 0 ms, write 0 ms, index 606 ms: 10 candidates, 75798 repo-hours, 782 releases; waiting 705 ms; commit 0 ms)
2026-11-08T12:16:32Z [load_day 2025-06-02] 2025-06-02 hour 12: 163358 events in 0 files, snapshot none (task 7150 ms: download 4271 ms overlapping gunzip 1158 ms, parse 4479 ms, sort 0 ms, write 0 ms, index 783 ms: 7 candidates, 94794 repo-hours, 867 releases; waiting 494 ms; commit 0 ms)
2026-11-08T12:16:33Z [load_day 2025-06-02] 2025-06-02 hour 13: 165133 events in 0 files, snapshot none (task 7583 ms: download 4675 ms overlapping gunzip 1226 ms, parse 4637 ms, sort 0 ms, write 0 ms, index 834 ms: 17 candidates, 92235 repo-hours, 854 releases; waiting 524 ms; commit 0 ms)
2026-11-08T12:16:41Z [load_day 2025-06-02] 2025-06-02 hour 14: 157120 events in 0 files, snapshot none (task 8189 ms: download 5251 ms overlapping gunzip 1349 ms, parse 5121 ms, sort 0 ms, write 0 ms, index 778 ms: 14 candidates, 82838 repo-hours, 903 releases; waiting 646 ms; commit 0 ms)
2026-11-08T12:16:41Z [load_day 2025-06-02] 2025-06-02 hour 15: 158437 events in 0 files, snapshot none (task 8154 ms: download 5058 ms overlapping gunzip 1302 ms, parse 5099 ms, sort 0 ms, write 0 ms, index 836 ms: 17 candidates, 84861 repo-hours, 840 releases; waiting 525 ms; commit 0 ms)
2026-11-08T12:16:49Z [load_day 2025-06-02] 2025-06-02 hour 16: 158309 events in 0 files, snapshot none (task 7428 ms: download 4543 ms overlapping gunzip 1187 ms, parse 4620 ms, sort 0 ms, write 0 ms, index 688 ms: 10 candidates, 80719 repo-hours, 923 releases; waiting 526 ms; commit 0 ms)
2026-11-08T12:16:50Z [load_day 2025-06-02] 2025-06-02 hour 17: 159012 events in 0 files, snapshot none (task 8248 ms: download 5914 ms overlapping gunzip 1271 ms, parse 4933 ms, sort 0 ms, write 0 ms, index 595 ms: 17 candidates, 79122 repo-hours, 1041 releases; waiting 1178 ms; commit 0 ms)
2026-11-08T12:16:57Z [load_day 2025-06-02] 2025-06-02 hour 18: 159812 events in 0 files, snapshot none (task 7479 ms: download 4154 ms overlapping gunzip 1199 ms, parse 4789 ms, sort 0 ms, write 0 ms, index 628 ms: 16 candidates, 84414 repo-hours, 940 releases; waiting 504 ms; commit 0 ms)
2026-11-08T12:16:58Z [load_day 2025-06-02] 2025-06-02 hour 19: 148679 events in 0 files, snapshot none (task 7280 ms: download 4788 ms overlapping gunzip 1054 ms, parse 4139 ms, sort 0 ms, write 0 ms, index 617 ms: 12 candidates, 70989 repo-hours, 822 releases; waiting 1149 ms; commit 0 ms)
2026-11-08T12:17:07Z [load_day 2025-06-02] 2025-06-02 hour 20: 156496 events in 0 files, snapshot none (task 9717 ms: download 6184 ms overlapping gunzip 1722 ms, parse 6732 ms, sort 0 ms, write 0 ms, index 712 ms: 8 candidates, 74454 repo-hours, 867 releases; waiting 238 ms; commit 0 ms)
2026-11-08T12:17:08Z [load_day 2025-06-02] 2025-06-02 hour 21: 150482 events in 0 files, snapshot none (task 8728 ms: download 5991 ms overlapping gunzip 1537 ms, parse 6129 ms, sort 0 ms, write 0 ms, index 520 ms: 11 candidates, 69551 repo-hours, 969 releases; waiting 170 ms; commit 0 ms)
2026-11-08T12:17:15Z [load_day 2025-06-02] 2025-06-02 hour 22: 148339 events in 0 files, snapshot none (task 7127 ms: download 4644 ms overlapping gunzip 1108 ms, parse 4632 ms, sort 0 ms, write 0 ms, index 550 ms: 7 candidates, 64349 repo-hours, 920 releases; waiting 586 ms; commit 0 ms)
2026-11-08T12:17:15Z [load_day 2025-06-02] 2025-06-02 hour 23: 139601 events in 0 files, snapshot none (task 6869 ms: download 4352 ms overlapping gunzip 1179 ms, parse 4657 ms, sort 0 ms, write 0 ms, index 450 ms: 7 candidates, 59682 repo-hours, 944 releases; waiting 22 ms; commit 0 ms)
2026-11-08T12:17:24Z [load_day 2025-06-02] 2025-06-02: repo_hour merged from 24 files to 1 (1804078 rows, 9188 ms)
2026-11-08T12:17:27Z [load_day 2025-06-02] 2025-06-02: index committed in 12161 ms (24 + 1 + 24 files)
2026-11-08T12:17:27Z [load_day 2025-06-02] 2025-06-02: 3671908 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:17:27Z [load_day 2025-06-02] attempt 1 succeeded