orcaLog in

Runs · run 1888

load_day 2023-12-23, attempt 1 succeeded

Host
73ccef5e07c2:12118
Started
2026-11-08T03:52:38Z
Ended
2026-11-08T03:53:44Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
564 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
88.0 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1888/load_day/2023-12-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T03:52:38Z [load_day 2023-12-23] attempt 1 started
2026-11-08T03:52:39Z [load_day 2023-12-23] 2023-12-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T03:52:46Z [load_day 2023-12-23] 2023-12-23 hour 0: 133424 events in 0 files, snapshot none (task 5694 ms: download 3710 ms overlapping gunzip 720 ms, parse 3018 ms, sort 0 ms, write 0 ms, index 533 ms: 12 candidates, 72795 repo-hours, 876 releases; waiting 928 ms; commit 0 ms)
2026-11-08T03:52:46Z [load_day 2023-12-23] 2023-12-23 hour 1: 127834 events in 0 files, snapshot none (task 5407 ms: download 3260 ms overlapping gunzip 714 ms, parse 2925 ms, sort 0 ms, write 0 ms, index 622 ms: 5 candidates, 71454 repo-hours, 696 releases; waiting 676 ms; commit 0 ms)
2026-11-08T03:52:50Z [load_day 2023-12-23] 2023-12-23 hour 2: 92896 events in 0 files, snapshot none (task 3727 ms: download 2173 ms overlapping gunzip 408 ms, parse 1617 ms, sort 0 ms, write 0 ms, index 358 ms: 4 candidates, 38043 repo-hours, 545 releases; waiting 1009 ms; commit 0 ms)
2026-11-08T03:52:50Z [load_day 2023-12-23] 2023-12-23 hour 3: 94514 events in 0 files, snapshot none (task 2922 ms: download 1730 ms overlapping gunzip 340 ms, parse 1368 ms, sort 0 ms, write 0 ms, index 405 ms: 4 candidates, 39104 repo-hours, 660 releases; waiting 527 ms; commit 0 ms)
2026-11-08T03:52:54Z [load_day 2023-12-23] 2023-12-23 hour 4: 105888 events in 0 files, snapshot none (task 3444 ms: download 1896 ms overlapping gunzip 411 ms, parse 1775 ms, sort 0 ms, write 0 ms, index 321 ms: 4 candidates, 39290 repo-hours, 505 releases; waiting 612 ms; commit 0 ms)
2026-11-08T03:52:54Z [load_day 2023-12-23] 2023-12-23 hour 5: 108390 events in 0 files, snapshot none (task 3716 ms: download 2209 ms overlapping gunzip 516 ms, parse 2056 ms, sort 0 ms, write 0 ms, index 331 ms: 5 candidates, 41579 repo-hours, 492 releases; waiting 491 ms; commit 0 ms)
2026-11-08T03:52:59Z [load_day 2023-12-23] 2023-12-23 hour 6: 125221 events in 0 files, snapshot none (task 4176 ms: download 2118 ms overlapping gunzip 554 ms, parse 2430 ms, sort 0 ms, write 0 ms, index 376 ms: 4 candidates, 50325 repo-hours, 932 releases; waiting 487 ms; commit 0 ms)
2026-11-08T03:52:59Z [load_day 2023-12-23] 2023-12-23 hour 7: 120592 events in 0 files, snapshot none (task 4241 ms: download 2212 ms overlapping gunzip 550 ms, parse 2445 ms, sort 0 ms, write 0 ms, index 519 ms: 2 candidates, 45218 repo-hours, 1600 releases; waiting 515 ms; commit 0 ms)
2026-11-08T03:53:03Z [load_day 2023-12-23] 2023-12-23 hour 8: 125192 events in 0 files, snapshot none (task 4120 ms: download 2277 ms overlapping gunzip 527 ms, parse 2318 ms, sort 0 ms, write 0 ms, index 468 ms: 4 candidates, 48780 repo-hours, 790 releases; waiting 521 ms; commit 0 ms)
2026-11-08T03:53:04Z [load_day 2023-12-23] 2023-12-23 hour 9: 129011 events in 0 files, snapshot none (task 4368 ms: download 2185 ms overlapping gunzip 591 ms, parse 2527 ms, sort 0 ms, write 0 ms, index 369 ms: 5 candidates, 48801 repo-hours, 821 releases; waiting 535 ms; commit 0 ms)
2026-11-08T03:53:07Z [load_day 2023-12-23] 2023-12-23 hour 10: 135041 events in 0 files, snapshot none (task 3731 ms: download 1905 ms overlapping gunzip 483 ms, parse 2112 ms, sort 0 ms, write 0 ms, index 374 ms: 5 candidates, 51774 repo-hours, 605 releases; waiting 505 ms; commit 0 ms)
2026-11-08T03:53:07Z [load_day 2023-12-23] 2023-12-23 hour 11: 129804 events in 0 files, snapshot none (task 3397 ms: download 1973 ms overlapping gunzip 420 ms, parse 1808 ms, sort 0 ms, write 0 ms, index 377 ms: 4 candidates, 49362 repo-hours, 604 releases; waiting 489 ms; commit 0 ms)
2026-11-08T03:53:13Z [load_day 2023-12-23] 2023-12-23 hour 12: 209435 events in 0 files, snapshot none (task 4601 ms: download 2221 ms overlapping gunzip 547 ms, parse 2688 ms, sort 0 ms, write 0 ms, index 556 ms: 11 candidates, 82644 repo-hours, 727 releases; waiting 510 ms; commit 0 ms)
2026-11-08T03:53:13Z [load_day 2023-12-23] 2023-12-23 hour 13: 159370 events in 0 files, snapshot none (task 4291 ms: download 3026 ms overlapping gunzip 516 ms, parse 2206 ms, sort 0 ms, write 0 ms, index 519 ms: 5 candidates, 73976 repo-hours, 623 releases; waiting 778 ms; commit 0 ms)
2026-11-08T03:53:17Z [load_day 2023-12-23] 2023-12-23 hour 14: 144859 events in 0 files, snapshot none (task 3931 ms: download 2335 ms overlapping gunzip 476 ms, parse 2053 ms, sort 0 ms, write 0 ms, index 600 ms: 5 candidates, 57405 repo-hours, 714 releases; waiting 510 ms; commit 0 ms)
2026-11-08T03:53:17Z [load_day 2023-12-23] 2023-12-23 hour 15: 146403 events in 0 files, snapshot none (task 4539 ms: download 2420 ms overlapping gunzip 554 ms, parse 2440 ms, sort 0 ms, write 0 ms, index 657 ms: 7 candidates, 59797 repo-hours, 909 releases; waiting 552 ms; commit 0 ms)
2026-11-08T03:53:22Z [load_day 2023-12-23] 2023-12-23 hour 16: 147848 events in 0 files, snapshot none (task 4949 ms: download 2855 ms overlapping gunzip 669 ms, parse 2917 ms, sort 0 ms, write 0 ms, index 442 ms: 8 candidates, 59241 repo-hours, 786 releases; waiting 598 ms; commit 0 ms)
2026-11-08T03:53:22Z [load_day 2023-12-23] 2023-12-23 hour 17: 136899 events in 0 files, snapshot none (task 4065 ms: download 2075 ms overlapping gunzip 532 ms, parse 2254 ms, sort 0 ms, write 0 ms, index 491 ms: 4 candidates, 53265 repo-hours, 756 releases; waiting 514 ms; commit 0 ms)
2026-11-08T03:53:27Z [load_day 2023-12-23] 2023-12-23 hour 18: 144473 events in 0 files, snapshot none (task 4564 ms: download 2532 ms overlapping gunzip 626 ms, parse 2722 ms, sort 0 ms, write 0 ms, index 425 ms: 3 candidates, 58496 repo-hours, 1538 releases; waiting 510 ms; commit 0 ms)
2026-11-08T03:53:27Z [load_day 2023-12-23] 2023-12-23 hour 19: 124898 events in 0 files, snapshot none (task 3889 ms: download 1850 ms overlapping gunzip 548 ms, parse 2373 ms, sort 0 ms, write 0 ms, index 387 ms: 2 candidates, 45261 repo-hours, 710 releases; waiting 316 ms; commit 0 ms)
2026-11-08T03:53:32Z [load_day 2023-12-23] 2023-12-23 hour 20: 121745 events in 0 files, snapshot none (task 4077 ms: download 2020 ms overlapping gunzip 546 ms, parse 2363 ms, sort 0 ms, write 0 ms, index 370 ms: 4 candidates, 45724 repo-hours, 753 releases; waiting 485 ms; commit 0 ms)
2026-11-08T03:53:32Z [load_day 2023-12-23] 2023-12-23 hour 21: 115237 events in 0 files, snapshot none (task 3787 ms: download 1967 ms overlapping gunzip 526 ms, parse 2196 ms, sort 0 ms, write 0 ms, index 312 ms: 3 candidates, 41066 repo-hours, 1423 releases; waiting 507 ms; commit 0 ms)
2026-11-08T03:53:36Z [load_day 2023-12-23] 2023-12-23 hour 22: 108273 events in 0 files, snapshot none (task 3728 ms: download 1953 ms overlapping gunzip 493 ms, parse 2114 ms, sort 0 ms, write 0 ms, index 288 ms: 1 candidates, 38420 repo-hours, 730 releases; waiting 566 ms; commit 0 ms)
2026-11-08T03:53:36Z [load_day 2023-12-23] 2023-12-23 hour 23: 104223 events in 0 files, snapshot none (task 3267 ms: download 2042 ms overlapping gunzip 381 ms, parse 1749 ms, sort 0 ms, write 0 ms, index 280 ms: 4 candidates, 37188 repo-hours, 608 releases; waiting 492 ms; commit 0 ms)
2026-11-08T03:53:42Z [load_day 2023-12-23] 2023-12-23: repo_hour merged from 24 files to 1 (1249008 rows, 5621 ms)
2026-11-08T03:53:44Z [load_day 2023-12-23] 2023-12-23: index committed in 7908 ms (24 + 1 + 24 files)
2026-11-08T03:53:44Z [load_day 2023-12-23] 2023-12-23: 3091470 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T03:53:44Z [load_day 2023-12-23] attempt 1 succeeded