orcaLog in

Runs · run 1899

load_day 2023-12-26, attempt 1 succeeded

Host
73ccef5e07c2:12971
Started
2026-11-08T03:54:18Z
Ended
2026-11-08T03:55:32Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
583 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
106.6 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1899/load_day/2023-12-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T03:54:18Z [load_day 2023-12-26] attempt 1 started
2026-11-08T03:54:19Z [load_day 2023-12-26] 2023-12-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T03:54:24Z [load_day 2023-12-26] 2023-12-26 hour 0: 141545 events in 0 files, snapshot none (task 4443 ms: download 2489 ms overlapping gunzip 607 ms, parse 2524 ms, sort 0 ms, write 0 ms, index 531 ms: 6 candidates, 70468 repo-hours, 732 releases; waiting 471 ms; commit 0 ms)
2026-11-08T03:54:24Z [load_day 2023-12-26] 2023-12-26 hour 1: 147275 events in 0 files, snapshot none (task 4694 ms: download 1998 ms overlapping gunzip 623 ms, parse 2750 ms, sort 0 ms, write 0 ms, index 552 ms: 5 candidates, 80969 repo-hours, 639 releases; waiting 477 ms; commit 0 ms)
2026-11-08T03:54:29Z [load_day 2023-12-26] 2023-12-26 hour 2: 124723 events in 0 files, snapshot none (task 4403 ms: download 2285 ms overlapping gunzip 694 ms, parse 2735 ms, sort 0 ms, write 0 ms, index 359 ms: 4 candidates, 51823 repo-hours, 646 releases; waiting 331 ms; commit 0 ms)
2026-11-08T03:54:29Z [load_day 2023-12-26] 2023-12-26 hour 3: 121367 events in 0 files, snapshot none (task 4288 ms: download 2339 ms overlapping gunzip 588 ms, parse 2512 ms, sort 0 ms, write 0 ms, index 347 ms: 7 candidates, 46115 repo-hours, 758 releases; waiting 506 ms; commit 0 ms)
2026-11-08T03:54:33Z [load_day 2023-12-26] 2023-12-26 hour 4: 119373 events in 0 files, snapshot none (task 3925 ms: download 1937 ms overlapping gunzip 582 ms, parse 2555 ms, sort 0 ms, write 0 ms, index 346 ms: 5 candidates, 43789 repo-hours, 499 releases; waiting 178 ms; commit 0 ms)
2026-11-08T03:54:34Z [load_day 2023-12-26] 2023-12-26 hour 5: 130021 events in 0 files, snapshot none (task 4581 ms: download 2641 ms overlapping gunzip 663 ms, parse 2753 ms, sort 0 ms, write 0 ms, index 361 ms: 5 candidates, 49502 repo-hours, 552 releases; waiting 528 ms; commit 0 ms)
2026-11-08T03:54:39Z [load_day 2023-12-26] 2023-12-26 hour 6: 150642 events in 0 files, snapshot none (task 5124 ms: download 2643 ms overlapping gunzip 710 ms, parse 3021 ms, sort 0 ms, write 0 ms, index 536 ms: 7 candidates, 62471 repo-hours, 713 releases; waiting 537 ms; commit 0 ms)
2026-11-08T03:54:39Z [load_day 2023-12-26] 2023-12-26 hour 7: 150094 events in 0 files, snapshot none (task 5401 ms: download 2900 ms overlapping gunzip 818 ms, parse 3338 ms, sort 0 ms, write 0 ms, index 399 ms: 3 candidates, 57598 repo-hours, 633 releases; waiting 528 ms; commit 0 ms)
2026-11-08T03:54:44Z [load_day 2023-12-26] 2023-12-26 hour 8: 159536 events in 0 files, snapshot none (task 5087 ms: download 1763 ms overlapping gunzip 814 ms, parse 3280 ms, sort 0 ms, write 0 ms, index 522 ms: 12 candidates, 62524 repo-hours, 724 releases; waiting 204 ms; commit 0 ms)
2026-11-08T03:54:45Z [load_day 2023-12-26] 2023-12-26 hour 9: 163187 events in 0 files, snapshot none (task 5791 ms: download 2942 ms overlapping gunzip 788 ms, parse 3304 ms, sort 0 ms, write 0 ms, index 470 ms: 5 candidates, 62234 repo-hours, 827 releases; waiting 489 ms; commit 0 ms)
2026-11-08T03:54:50Z [load_day 2023-12-26] 2023-12-26 hour 10: 159845 events in 0 files, snapshot none (task 5320 ms: download 2575 ms overlapping gunzip 762 ms, parse 3225 ms, sort 0 ms, write 0 ms, index 523 ms: 4 candidates, 61250 repo-hours, 680 releases; waiting 528 ms; commit 0 ms)
2026-11-08T03:54:51Z [load_day 2023-12-26] 2023-12-26 hour 11: 156317 events in 0 files, snapshot none (task 5729 ms: download 3195 ms overlapping gunzip 796 ms, parse 3573 ms, sort 0 ms, write 0 ms, index 491 ms: 17 candidates, 59178 repo-hours, 760 releases; waiting 485 ms; commit 0 ms)
2026-11-08T03:54:55Z [load_day 2023-12-26] 2023-12-26 hour 12: 220653 events in 0 files, snapshot none (task 4943 ms: download 2558 ms overlapping gunzip 652 ms, parse 2967 ms, sort 0 ms, write 0 ms, index 624 ms: 26 candidates, 91812 repo-hours, 855 releases; waiting 489 ms; commit 0 ms)
2026-11-08T03:54:56Z [load_day 2023-12-26] 2023-12-26 hour 13: 183271 events in 0 files, snapshot none (task 4628 ms: download 2453 ms overlapping gunzip 653 ms, parse 2760 ms, sort 0 ms, write 0 ms, index 550 ms: 4 candidates, 83344 repo-hours, 736 releases; waiting 481 ms; commit 0 ms)
2026-11-08T03:55:01Z [load_day 2023-12-26] 2023-12-26 hour 14: 177294 events in 0 files, snapshot none (task 5070 ms: download 2330 ms overlapping gunzip 643 ms, parse 2722 ms, sort 0 ms, write 0 ms, index 565 ms: 9 candidates, 67738 repo-hours, 714 releases; waiting 522 ms; commit 0 ms)
2026-11-08T03:55:01Z [load_day 2023-12-26] 2023-12-26 hour 15: 172479 events in 0 files, snapshot none (task 4711 ms: download 2313 ms overlapping gunzip 665 ms, parse 2777 ms, sort 0 ms, write 0 ms, index 514 ms: 7 candidates, 69510 repo-hours, 1046 releases; waiting 503 ms; commit 0 ms)
2026-11-08T03:55:07Z [load_day 2023-12-26] 2023-12-26 hour 16: 171841 events in 0 files, snapshot none (task 6134 ms: download 3761 ms overlapping gunzip 895 ms, parse 3888 ms, sort 0 ms, write 0 ms, index 596 ms: 13 candidates, 66667 repo-hours, 786 releases; waiting 529 ms; commit 0 ms)
2026-11-08T03:55:07Z [load_day 2023-12-26] 2023-12-26 hour 17: 162525 events in 0 files, snapshot none (task 4915 ms: download 2665 ms overlapping gunzip 692 ms, parse 2960 ms, sort 0 ms, write 0 ms, index 467 ms: 11 candidates, 61341 repo-hours, 743 releases; waiting 525 ms; commit 0 ms)
2026-11-08T03:55:13Z [load_day 2023-12-26] 2023-12-26 hour 18: 165748 events in 0 files, snapshot none (task 5323 ms: download 2961 ms overlapping gunzip 745 ms, parse 3333 ms, sort 0 ms, write 0 ms, index 515 ms: 5 candidates, 66732 repo-hours, 905 releases; waiting 422 ms; commit 0 ms)
2026-11-08T03:55:13Z [load_day 2023-12-26] 2023-12-26 hour 19: 149611 events in 0 files, snapshot none (task 4774 ms: download 2314 ms overlapping gunzip 672 ms, parse 2924 ms, sort 0 ms, write 0 ms, index 424 ms: 9 candidates, 58200 repo-hours, 714 releases; waiting 474 ms; commit 0 ms)
2026-11-08T03:55:18Z [load_day 2023-12-26] 2023-12-26 hour 20: 139844 events in 0 files, snapshot none (task 4866 ms: download 2344 ms overlapping gunzip 697 ms, parse 2970 ms, sort 0 ms, write 0 ms, index 402 ms: 4 candidates, 51623 repo-hours, 677 releases; waiting 487 ms; commit 0 ms)
2026-11-08T03:55:18Z [load_day 2023-12-26] 2023-12-26 hour 21: 133661 events in 0 files, snapshot none (task 4550 ms: download 2926 ms overlapping gunzip 635 ms, parse 2542 ms, sort 0 ms, write 0 ms, index 610 ms: 3 candidates, 47574 repo-hours, 1086 releases; waiting 462 ms; commit 0 ms)
2026-11-08T03:55:23Z [load_day 2023-12-26] 2023-12-26 hour 22: 123523 events in 0 files, snapshot none (task 4339 ms: download 2460 ms overlapping gunzip 642 ms, parse 2530 ms, sort 0 ms, write 0 ms, index 310 ms: 5 candidates, 43554 repo-hours, 1163 releases; waiting 515 ms; commit 0 ms)
2026-11-08T03:55:23Z [load_day 2023-12-26] 2023-12-26 hour 23: 118162 events in 0 files, snapshot none (task 4056 ms: download 2170 ms overlapping gunzip 584 ms, parse 2352 ms, sort 0 ms, write 0 ms, index 318 ms: 4 candidates, 42833 repo-hours, 637 releases; waiting 523 ms; commit 0 ms)
2026-11-08T03:55:30Z [load_day 2023-12-26] 2023-12-26: repo_hour merged from 24 files to 1 (1458849 rows, 6444 ms)
2026-11-08T03:55:32Z [load_day 2023-12-26] 2023-12-26: index committed in 8644 ms (24 + 1 + 24 files)
2026-11-08T03:55:32Z [load_day 2023-12-26] 2023-12-26: 3642537 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T03:55:32Z [load_day 2023-12-26] attempt 1 succeeded