orcaLog in

Runs · run 1837

load_day 2023-12-10, attempt 1 succeeded

Host
73ccef5e07c2:8011
Started
2026-11-08T03:41:50Z
Ended
2026-11-08T03:43:07Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
588 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
102.4 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1837/load_day/2023-12-10/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T03:41:50Z [load_day 2023-12-10] attempt 1 started
2026-11-08T03:41:51Z [load_day 2023-12-10] 2023-12-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T03:41:56Z [load_day 2023-12-10] 2023-12-10 hour 0: 125657 events in 0 files, snapshot none (task 4571 ms: download 2212 ms overlapping gunzip 534 ms, parse 2342 ms, sort 0 ms, write 0 ms, index 560 ms: 5 candidates, 69000 repo-hours, 837 releases; waiting 776 ms; commit 0 ms)
2026-11-08T03:41:56Z [load_day 2023-12-10] 2023-12-10 hour 1: 130445 events in 0 files, snapshot none (task 3947 ms: download 1854 ms overlapping gunzip 479 ms, parse 2190 ms, sort 0 ms, write 0 ms, index 522 ms: 5 candidates, 76971 repo-hours, 822 releases; waiting 492 ms; commit 0 ms)
2026-11-08T03:42:00Z [load_day 2023-12-10] 2023-12-10 hour 2: 98024 events in 0 files, snapshot none (task 3114 ms: download 1628 ms overlapping gunzip 377 ms, parse 1613 ms, sort 0 ms, write 0 ms, index 333 ms: 7 candidates, 42306 repo-hours, 603 releases; waiting 526 ms; commit 0 ms)
2026-11-08T03:42:00Z [load_day 2023-12-10] 2023-12-10 hour 3: 98179 events in 0 files, snapshot none (task 3150 ms: download 1627 ms overlapping gunzip 389 ms, parse 1638 ms, sort 0 ms, write 0 ms, index 349 ms: 5 candidates, 42107 repo-hours, 731 releases; waiting 491 ms; commit 0 ms)
2026-11-08T03:42:05Z [load_day 2023-12-10] 2023-12-10 hour 4: 104186 events in 0 files, snapshot none (task 4332 ms: download 2122 ms overlapping gunzip 546 ms, parse 2325 ms, sort 0 ms, write 0 ms, index 663 ms: 5 candidates, 43150 repo-hours, 555 releases; waiting 530 ms; commit 0 ms)
2026-11-08T03:42:05Z [load_day 2023-12-10] 2023-12-10 hour 5: 104672 events in 0 files, snapshot none (task 4019 ms: download 2086 ms overlapping gunzip 593 ms, parse 2347 ms, sort 0 ms, write 0 ms, index 349 ms: 5 candidates, 44528 repo-hours, 575 releases; waiting 488 ms; commit 0 ms)
2026-11-08T03:42:09Z [load_day 2023-12-10] 2023-12-10 hour 6: 113704 events in 0 files, snapshot none (task 4226 ms: download 2174 ms overlapping gunzip 548 ms, parse 2355 ms, sort 0 ms, write 0 ms, index 432 ms: 8 candidates, 53011 repo-hours, 618 releases; waiting 587 ms; commit 0 ms)
2026-11-08T03:42:09Z [load_day 2023-12-10] 2023-12-10 hour 7: 113054 events in 0 files, snapshot none (task 3906 ms: download 1530 ms overlapping gunzip 497 ms, parse 2145 ms, sort 0 ms, write 0 ms, index 686 ms: 3 candidates, 48028 repo-hours, 558 releases; waiting 333 ms; commit 0 ms)
2026-11-08T03:42:14Z [load_day 2023-12-10] 2023-12-10 hour 8: 120473 events in 0 files, snapshot none (task 3991 ms: download 2031 ms overlapping gunzip 540 ms, parse 2346 ms, sort 0 ms, write 0 ms, index 359 ms: 8 candidates, 51480 repo-hours, 654 releases; waiting 486 ms; commit 0 ms)
2026-11-08T03:42:14Z [load_day 2023-12-10] 2023-12-10 hour 9: 125979 events in 0 files, snapshot none (task 4496 ms: download 2245 ms overlapping gunzip 602 ms, parse 2568 ms, sort 0 ms, write 0 ms, index 469 ms: 5 candidates, 55359 repo-hours, 724 releases; waiting 594 ms; commit 0 ms)
2026-11-08T03:42:20Z [load_day 2023-12-10] 2023-12-10 hour 10: 136533 events in 0 files, snapshot none (task 5847 ms: download 2999 ms overlapping gunzip 900 ms, parse 3706 ms, sort 0 ms, write 0 ms, index 444 ms: 3 candidates, 59438 repo-hours, 637 releases; waiting 497 ms; commit 0 ms)
2026-11-08T03:42:20Z [load_day 2023-12-10] 2023-12-10 hour 11: 135460 events in 0 files, snapshot none (task 5440 ms: download 2724 ms overlapping gunzip 834 ms, parse 3407 ms, sort 0 ms, write 0 ms, index 415 ms: 4 candidates, 59097 repo-hours, 648 releases; waiting 484 ms; commit 0 ms)
2026-11-08T03:42:27Z [load_day 2023-12-10] 2023-12-10 hour 12: 213903 events in 0 files, snapshot none (task 6062 ms: download 3031 ms overlapping gunzip 804 ms, parse 3876 ms, sort 0 ms, write 0 ms, index 628 ms: 3 candidates, 94470 repo-hours, 822 releases; waiting 518 ms; commit 0 ms)
2026-11-08T03:42:27Z [load_day 2023-12-10] 2023-12-10 hour 13: 175905 events in 0 files, snapshot none (task 6146 ms: download 3132 ms overlapping gunzip 816 ms, parse 3715 ms, sort 0 ms, write 0 ms, index 777 ms: 9 candidates, 87245 repo-hours, 802 releases; waiting 509 ms; commit 0 ms)
2026-11-08T03:42:33Z [load_day 2023-12-10] 2023-12-10 hour 14: 167631 events in 0 files, snapshot none (task 5536 ms: download 2819 ms overlapping gunzip 770 ms, parse 3402 ms, sort 0 ms, write 0 ms, index 533 ms: 7 candidates, 69835 repo-hours, 844 releases; waiting 524 ms; commit 0 ms)
2026-11-08T03:42:33Z [load_day 2023-12-10] 2023-12-10 hour 15: 179449 events in 0 files, snapshot none (task 6274 ms: download 3320 ms overlapping gunzip 831 ms, parse 3571 ms, sort 0 ms, write 0 ms, index 1085 ms: 5 candidates, 72383 repo-hours, 1001 releases; waiting 520 ms; commit 0 ms)
2026-11-08T03:42:40Z [load_day 2023-12-10] 2023-12-10 hour 16: 176213 events in 0 files, snapshot none (task 6099 ms: download 3590 ms overlapping gunzip 839 ms, parse 3932 ms, sort 0 ms, write 0 ms, index 526 ms: 11 candidates, 69772 repo-hours, 908 releases; waiting 518 ms; commit 0 ms)
2026-11-08T03:42:40Z [load_day 2023-12-10] 2023-12-10 hour 17: 167807 events in 0 files, snapshot none (task 5271 ms: download 2889 ms overlapping gunzip 747 ms, parse 3308 ms, sort 0 ms, write 0 ms, index 436 ms: 7 candidates, 65027 repo-hours, 808 releases; waiting 510 ms; commit 0 ms)
2026-11-08T03:42:45Z [load_day 2023-12-10] 2023-12-10 hour 18: 203753 events in 0 files, snapshot none (task 5362 ms: download 2899 ms overlapping gunzip 714 ms, parse 3310 ms, sort 0 ms, write 0 ms, index 502 ms: 8 candidates, 71099 repo-hours, 860 releases; waiting 509 ms; commit 0 ms)
2026-11-08T03:42:45Z [load_day 2023-12-10] 2023-12-10 hour 19: 181675 events in 0 files, snapshot none (task 4739 ms: download 2367 ms overlapping gunzip 633 ms, parse 2896 ms, sort 0 ms, write 0 ms, index 417 ms: 6 candidates, 60083 repo-hours, 801 releases; waiting 469 ms; commit 0 ms)
2026-11-08T03:42:51Z [load_day 2023-12-10] 2023-12-10 hour 20: 188102 events in 0 files, snapshot none (task 4558 ms: download 2248 ms overlapping gunzip 626 ms, parse 2900 ms, sort 0 ms, write 0 ms, index 417 ms: 5 candidates, 60534 repo-hours, 826 releases; waiting 330 ms; commit 0 ms)
2026-11-08T03:42:51Z [load_day 2023-12-10] 2023-12-10 hour 21: 175648 events in 0 files, snapshot none (task 4470 ms: download 2186 ms overlapping gunzip 592 ms, parse 2705 ms, sort 0 ms, write 0 ms, index 405 ms: 5 candidates, 55498 repo-hours, 887 releases; waiting 507 ms; commit 0 ms)
2026-11-08T03:42:56Z [load_day 2023-12-10] 2023-12-10 hour 22: 172024 events in 0 files, snapshot none (task 5190 ms: download 2240 ms overlapping gunzip 689 ms, parse 3059 ms, sort 0 ms, write 0 ms, index 667 ms: 3 candidates, 52324 repo-hours, 862 releases; waiting 519 ms; commit 0 ms)
2026-11-08T03:42:57Z [load_day 2023-12-10] 2023-12-10 hour 23: 181142 events in 0 files, snapshot none (task 6026 ms: download 2188 ms overlapping gunzip 868 ms, parse 3709 ms, sort 0 ms, write 0 ms, index 680 ms: 10 candidates, 49055 repo-hours, 702 releases; waiting 497 ms; commit 0 ms)
2026-11-08T03:43:04Z [load_day 2023-12-10] 2023-12-10: repo_hour merged from 24 files to 1 (1451800 rows, 7316 ms)
2026-11-08T03:43:07Z [load_day 2023-12-10] 2023-12-10: index committed in 9561 ms (24 + 1 + 24 files)
2026-11-08T03:43:07Z [load_day 2023-12-10] 2023-12-10: 3589618 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T03:43:07Z [load_day 2023-12-10] attempt 1 succeeded