orcaLog in

Runs · run 3133

load_day 2024-10-27, attempt 1 succeeded

Host
73ccef5e07c2:198622
Started
2026-11-08T08:32:12Z
Ended
2026-11-08T08:33:31Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
648 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
110.3 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3133/load_day/2024-10-27/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:32:12Z [load_day 2024-10-27] attempt 1 started
2026-11-08T08:32:13Z [load_day 2024-10-27] 2024-10-27: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:32:17Z [load_day 2024-10-27] 2024-10-27 hour 0: 141862 events in 0 files, snapshot none (task 4027 ms: download 2001 ms overlapping gunzip 537 ms, parse 2157 ms, sort 0 ms, write 0 ms, index 532 ms: 3 candidates, 69071 repo-hours, 1028 releases; waiting 523 ms; commit 0 ms)
2026-11-08T08:32:17Z [load_day 2024-10-27] 2024-10-27 hour 1: 164034 events in 0 files, snapshot none (task 4025 ms: download 2169 ms overlapping gunzip 499 ms, parse 2110 ms, sort 0 ms, write 0 ms, index 618 ms: 6 candidates, 92952 repo-hours, 829 releases; waiting 504 ms; commit 0 ms)
2026-11-08T08:32:22Z [load_day 2024-10-27] 2024-10-27 hour 2: 126152 events in 0 files, snapshot none (task 3915 ms: download 2049 ms overlapping gunzip 511 ms, parse 2166 ms, sort 0 ms, write 0 ms, index 469 ms: 5 candidates, 56683 repo-hours, 625 releases; waiting 485 ms; commit 0 ms)
2026-11-08T08:32:22Z [load_day 2024-10-27] 2024-10-27 hour 3: 156868 events in 0 files, snapshot none (task 4315 ms: download 1815 ms overlapping gunzip 585 ms, parse 2495 ms, sort 0 ms, write 0 ms, index 470 ms: 3 candidates, 58786 repo-hours, 3884 releases; waiting 492 ms; commit 0 ms)
2026-11-08T08:32:26Z [load_day 2024-10-27] 2024-10-27 hour 4: 139782 events in 0 files, snapshot none (task 3676 ms: download 1681 ms overlapping gunzip 504 ms, parse 2121 ms, sort 0 ms, write 0 ms, index 395 ms: 2 candidates, 48555 repo-hours, 532 releases; waiting 398 ms; commit 0 ms)
2026-11-08T08:32:27Z [load_day 2024-10-27] 2024-10-27 hour 5: 147827 events in 0 files, snapshot none (task 3945 ms: download 2098 ms overlapping gunzip 576 ms, parse 2139 ms, sort 0 ms, write 0 ms, index 386 ms: 0 candidates, 51036 repo-hours, 645 releases; waiting 565 ms; commit 0 ms)
2026-11-08T08:32:30Z [load_day 2024-10-27] 2024-10-27 hour 6: 161824 events in 0 files, snapshot none (task 3550 ms: download 2397 ms overlapping gunzip 450 ms, parse 1915 ms, sort 0 ms, write 0 ms, index 534 ms: 1 candidates, 68928 repo-hours, 746 releases; waiting 400 ms; commit 0 ms)
2026-11-08T08:32:31Z [load_day 2024-10-27] 2024-10-27 hour 7: 157175 events in 0 files, snapshot none (task 3722 ms: download 1712 ms overlapping gunzip 515 ms, parse 2119 ms, sort 0 ms, write 0 ms, index 574 ms: 3 candidates, 55780 repo-hours, 649 releases; waiting 297 ms; commit 0 ms)
2026-11-08T08:32:35Z [load_day 2024-10-27] 2024-10-27 hour 8: 161331 events in 0 files, snapshot none (task 5032 ms: download 2372 ms overlapping gunzip 762 ms, parse 2939 ms, sort 0 ms, write 0 ms, index 545 ms: 6 candidates, 60584 repo-hours, 683 releases; waiting 512 ms; commit 0 ms)
2026-11-08T08:32:37Z [load_day 2024-10-27] 2024-10-27 hour 9: 181966 events in 0 files, snapshot none (task 5468 ms: download 3140 ms overlapping gunzip 828 ms, parse 3272 ms, sort 0 ms, write 0 ms, index 622 ms: 5 candidates, 68155 repo-hours, 833 releases; waiting 474 ms; commit 0 ms)
2026-11-08T08:32:41Z [load_day 2024-10-27] 2024-10-27 hour 10: 175749 events in 0 files, snapshot none (task 4923 ms: download 2107 ms overlapping gunzip 750 ms, parse 2991 ms, sort 0 ms, write 0 ms, index 613 ms: 5 candidates, 65085 repo-hours, 713 releases; waiting 305 ms; commit 0 ms)
2026-11-08T08:32:43Z [load_day 2024-10-27] 2024-10-27 hour 11: 182052 events in 0 files, snapshot none (task 4959 ms: download 2746 ms overlapping gunzip 790 ms, parse 3121 ms, sort 0 ms, write 0 ms, index 545 ms: 3 candidates, 64094 repo-hours, 790 releases; waiting 249 ms; commit 0 ms)
2026-11-08T08:32:47Z [load_day 2024-10-27] 2024-10-27 hour 12: 235572 events in 0 files, snapshot none (task 5880 ms: download 2288 ms overlapping gunzip 712 ms, parse 3399 ms, sort 0 ms, write 0 ms, index 1027 ms: 6 candidates, 115551 repo-hours, 1020 releases; waiting 487 ms; commit 0 ms)
2026-11-08T08:32:49Z [load_day 2024-10-27] 2024-10-27 hour 13: 212508 events in 0 files, snapshot none (task 5954 ms: download 3472 ms overlapping gunzip 896 ms, parse 3549 ms, sort 0 ms, write 0 ms, index 761 ms: 6 candidates, 92286 repo-hours, 1119 releases; waiting 494 ms; commit 0 ms)
2026-11-08T08:32:53Z [load_day 2024-10-27] 2024-10-27 hour 14: 197628 events in 0 files, snapshot none (task 5547 ms: download 2535 ms overlapping gunzip 750 ms, parse 3089 ms, sort 0 ms, write 0 ms, index 919 ms: 4 candidates, 75602 repo-hours, 917 releases; waiting 529 ms; commit 0 ms)
2026-11-08T08:32:56Z [load_day 2024-10-27] 2024-10-27 hour 15: 213009 events in 0 files, snapshot none (task 6290 ms: download 3478 ms overlapping gunzip 900 ms, parse 3465 ms, sort 0 ms, write 0 ms, index 1070 ms: 14 candidates, 84918 repo-hours, 1250 releases; waiting 544 ms; commit 0 ms)
2026-11-08T08:32:59Z [load_day 2024-10-27] 2024-10-27 hour 16: 199928 events in 0 files, snapshot none (task 5905 ms: download 2936 ms overlapping gunzip 802 ms, parse 3078 ms, sort 0 ms, write 0 ms, index 1238 ms: 7 candidates, 77162 repo-hours, 1108 releases; waiting 505 ms; commit 0 ms)
2026-11-08T08:33:02Z [load_day 2024-10-27] 2024-10-27 hour 17: 191329 events in 0 files, snapshot none (task 5597 ms: download 3134 ms overlapping gunzip 846 ms, parse 3074 ms, sort 0 ms, write 0 ms, index 866 ms: 8 candidates, 70784 repo-hours, 906 releases; waiting 507 ms; commit 0 ms)
2026-11-08T08:33:06Z [load_day 2024-10-27] 2024-10-27 hour 18: 205391 events in 0 files, snapshot none (task 6240 ms: download 3242 ms overlapping gunzip 925 ms, parse 3751 ms, sort 0 ms, write 0 ms, index 737 ms: 4 candidates, 86559 repo-hours, 1094 releases; waiting 536 ms; commit 0 ms)
2026-11-08T08:33:08Z [load_day 2024-10-27] 2024-10-27 hour 19: 183146 events in 0 files, snapshot none (task 5293 ms: download 3210 ms overlapping gunzip 883 ms, parse 3400 ms, sort 0 ms, write 0 ms, index 442 ms: 7 candidates, 64741 repo-hours, 875 releases; waiting 320 ms; commit 0 ms)
2026-11-08T08:33:12Z [load_day 2024-10-27] 2024-10-27 hour 20: 177712 events in 0 files, snapshot none (task 5169 ms: download 2192 ms overlapping gunzip 825 ms, parse 3246 ms, sort 0 ms, write 0 ms, index 591 ms: 7 candidates, 65067 repo-hours, 845 releases; waiting 275 ms; commit 0 ms)
2026-11-08T08:33:15Z [load_day 2024-10-27] 2024-10-27 hour 21: 179885 events in 0 files, snapshot none (task 6458 ms: download 3018 ms overlapping gunzip 1052 ms, parse 3730 ms, sort 0 ms, write 0 ms, index 831 ms: 9 candidates, 64629 repo-hours, 1248 releases; waiting 509 ms; commit 0 ms)
2026-11-08T08:33:18Z [load_day 2024-10-27] 2024-10-27 hour 22: 156977 events in 0 files, snapshot none (task 5619 ms: download 2503 ms overlapping gunzip 800 ms, parse 3347 ms, sort 0 ms, write 0 ms, index 628 ms: 8 candidates, 55358 repo-hours, 956 releases; waiting 526 ms; commit 0 ms)
2026-11-08T08:33:20Z [load_day 2024-10-27] 2024-10-27 hour 23: 154327 events in 0 files, snapshot none (task 4624 ms: download 2437 ms overlapping gunzip 728 ms, parse 2685 ms, sort 0 ms, write 0 ms, index 386 ms: 5 candidates, 53279 repo-hours, 815 releases; waiting 533 ms; commit 0 ms)
2026-11-08T08:33:28Z [load_day 2024-10-27] 2024-10-27: repo_hour merged from 24 files to 1 (1665645 rows, 7669 ms)
2026-11-08T08:33:31Z [load_day 2024-10-27] 2024-10-27: index committed in 10807 ms (23 + 1 + 24 files)
2026-11-08T08:33:31Z [load_day 2024-10-27] 2024-10-27: 4204034 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:33:31Z [load_day 2024-10-27] attempt 1 succeeded