orcaLog in

Runs · run 2741

load_day 2024-07-21, attempt 1 succeeded

Host
73ccef5e07c2:152553
Started
2026-11-08T07:05:24Z
Ended
2026-11-08T07:06:42Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
647 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
106.1 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2741/load_day/2024-07-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:05:24Z [load_day 2024-07-21] attempt 1 started
2026-11-08T07:05:25Z [load_day 2024-07-21] 2024-07-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:05:29Z [load_day 2024-07-21] 2024-07-21 hour 0: 136968 events in 0 files, snapshot none (task 3988 ms: download 2179 ms overlapping gunzip 504 ms, parse 2224 ms, sort 0 ms, write 0 ms, index 499 ms: 8 candidates, 74223 repo-hours, 998 releases; waiting 501 ms; commit 0 ms)
2026-11-08T07:05:29Z [load_day 2024-07-21] 2024-07-21 hour 1: 147299 events in 0 files, snapshot none (task 4080 ms: download 1835 ms overlapping gunzip 499 ms, parse 2255 ms, sort 0 ms, write 0 ms, index 567 ms: 4 candidates, 89681 repo-hours, 807 releases; waiting 535 ms; commit 0 ms)
2026-11-08T07:05:33Z [load_day 2024-07-21] 2024-07-21 hour 2: 108467 events in 0 files, snapshot none (task 3565 ms: download 2331 ms overlapping gunzip 447 ms, parse 1898 ms, sort 0 ms, write 0 ms, index 364 ms: 1 candidates, 46754 repo-hours, 635 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:05:33Z [load_day 2024-07-21] 2024-07-21 hour 3: 132300 events in 0 files, snapshot none (task 3521 ms: download 1822 ms overlapping gunzip 417 ms, parse 1941 ms, sort 0 ms, write 0 ms, index 366 ms: 3 candidates, 55333 repo-hours, 5297 releases; waiting 528 ms; commit 0 ms)
2026-11-08T07:05:37Z [load_day 2024-07-21] 2024-07-21 hour 4: 114872 events in 0 files, snapshot none (task 3406 ms: download 1716 ms overlapping gunzip 467 ms, parse 1869 ms, sort 0 ms, write 0 ms, index 315 ms: 3 candidates, 44049 repo-hours, 515 releases; waiting 531 ms; commit 0 ms)
2026-11-08T07:05:37Z [load_day 2024-07-21] 2024-07-21 hour 5: 123754 events in 0 files, snapshot none (task 3494 ms: download 1945 ms overlapping gunzip 472 ms, parse 1936 ms, sort 0 ms, write 0 ms, index 348 ms: 12 candidates, 48193 repo-hours, 643 releases; waiting 515 ms; commit 0 ms)
2026-11-08T07:05:43Z [load_day 2024-07-21] 2024-07-21 hour 6: 148899 events in 0 files, snapshot none (task 5582 ms: download 2752 ms overlapping gunzip 761 ms, parse 3459 ms, sort 0 ms, write 0 ms, index 572 ms: 3 candidates, 68770 repo-hours, 648 releases; waiting 516 ms; commit 0 ms)
2026-11-08T07:05:43Z [load_day 2024-07-21] 2024-07-21 hour 7: 139054 events in 0 files, snapshot none (task 5087 ms: download 2357 ms overlapping gunzip 732 ms, parse 3128 ms, sort 0 ms, write 0 ms, index 588 ms: 6 candidates, 53525 repo-hours, 562 releases; waiting 368 ms; commit 0 ms)
2026-11-08T07:05:48Z [load_day 2024-07-21] 2024-07-21 hour 8: 147466 events in 0 files, snapshot none (task 4649 ms: download 2036 ms overlapping gunzip 591 ms, parse 2525 ms, sort 0 ms, write 0 ms, index 787 ms: 3 candidates, 58566 repo-hours, 599 releases; waiting 498 ms; commit 0 ms)
2026-11-08T07:05:48Z [load_day 2024-07-21] 2024-07-21 hour 9: 155419 events in 0 files, snapshot none (task 4656 ms: download 1862 ms overlapping gunzip 581 ms, parse 2596 ms, sort 0 ms, write 0 ms, index 846 ms: 4 candidates, 65873 repo-hours, 813 releases; waiting 366 ms; commit 0 ms)
2026-11-08T07:05:54Z [load_day 2024-07-21] 2024-07-21 hour 10: 144853 events in 0 files, snapshot none (task 4483 ms: download 2345 ms overlapping gunzip 585 ms, parse 2686 ms, sort 0 ms, write 0 ms, index 411 ms: 4 candidates, 59491 repo-hours, 664 releases; waiting 523 ms; commit 0 ms)
2026-11-08T07:05:54Z [load_day 2024-07-21] 2024-07-21 hour 11: 146843 events in 0 files, snapshot none (task 4205 ms: download 2124 ms overlapping gunzip 582 ms, parse 2517 ms, sort 0 ms, write 0 ms, index 416 ms: 7 candidates, 58239 repo-hours, 698 releases; waiting 460 ms; commit 0 ms)
2026-11-08T07:06:01Z [load_day 2024-07-21] 2024-07-21 hour 12: 227348 events in 0 files, snapshot none (task 6498 ms: download 3484 ms overlapping gunzip 851 ms, parse 3920 ms, sort 0 ms, write 0 ms, index 716 ms: 3 candidates, 109354 repo-hours, 933 releases; waiting 520 ms; commit 0 ms)
2026-11-08T07:06:01Z [load_day 2024-07-21] 2024-07-21 hour 13: 188013 events in 0 files, snapshot none (task 6115 ms: download 3453 ms overlapping gunzip 874 ms, parse 3772 ms, sort 0 ms, write 0 ms, index 709 ms: 6 candidates, 89496 repo-hours, 822 releases; waiting 484 ms; commit 0 ms)
2026-11-08T07:06:08Z [load_day 2024-07-21] 2024-07-21 hour 14: 173313 events in 0 files, snapshot none (task 7081 ms: download 3750 ms overlapping gunzip 1021 ms, parse 4317 ms, sort 0 ms, write 0 ms, index 575 ms: 3 candidates, 69503 repo-hours, 800 releases; waiting 524 ms; commit 0 ms)
2026-11-08T07:06:08Z [load_day 2024-07-21] 2024-07-21 hour 15: 182534 events in 0 files, snapshot none (task 6461 ms: download 3475 ms overlapping gunzip 934 ms, parse 4043 ms, sort 0 ms, write 0 ms, index 743 ms: 7 candidates, 81454 repo-hours, 973 releases; waiting 478 ms; commit 0 ms)
2026-11-08T07:06:15Z [load_day 2024-07-21] 2024-07-21 hour 16: 171400 events in 0 files, snapshot none (task 6651 ms: download 2845 ms overlapping gunzip 968 ms, parse 4079 ms, sort 0 ms, write 0 ms, index 838 ms: 11 candidates, 73034 repo-hours, 869 releases; waiting 511 ms; commit 0 ms)
2026-11-08T07:06:16Z [load_day 2024-07-21] 2024-07-21 hour 17: 168165 events in 0 files, snapshot none (task 7252 ms: download 4197 ms overlapping gunzip 962 ms, parse 4149 ms, sort 0 ms, write 0 ms, index 835 ms: 11 candidates, 70390 repo-hours, 922 releases; waiting 995 ms; commit 0 ms)
2026-11-08T07:06:22Z [load_day 2024-07-21] 2024-07-21 hour 18: 176019 events in 0 files, snapshot none (task 5798 ms: download 3139 ms overlapping gunzip 807 ms, parse 3677 ms, sort 0 ms, write 0 ms, index 574 ms: 9 candidates, 81417 repo-hours, 975 releases; waiting 501 ms; commit 0 ms)
2026-11-08T07:06:22Z [load_day 2024-07-21] 2024-07-21 hour 19: 147216 events in 0 files, snapshot none (task 5167 ms: download 2665 ms overlapping gunzip 786 ms, parse 3380 ms, sort 0 ms, write 0 ms, index 376 ms: 7 candidates, 55338 repo-hours, 748 releases; waiting 363 ms; commit 0 ms)
2026-11-08T07:06:27Z [load_day 2024-07-21] 2024-07-21 hour 20: 143849 events in 0 files, snapshot none (task 5242 ms: download 2829 ms overlapping gunzip 767 ms, parse 3212 ms, sort 0 ms, write 0 ms, index 511 ms: 9 candidates, 58666 repo-hours, 816 releases; waiting 513 ms; commit 0 ms)
2026-11-08T07:06:28Z [load_day 2024-07-21] 2024-07-21 hour 21: 141848 events in 0 files, snapshot none (task 5981 ms: download 2425 ms overlapping gunzip 803 ms, parse 3827 ms, sort 0 ms, write 0 ms, index 495 ms: 9 candidates, 57664 repo-hours, 912 releases; waiting 501 ms; commit 0 ms)
2026-11-08T07:06:32Z [load_day 2024-07-21] 2024-07-21 hour 22: 123684 events in 0 files, snapshot none (task 3811 ms: download 2105 ms overlapping gunzip 502 ms, parse 2135 ms, sort 0 ms, write 0 ms, index 371 ms: 6 candidates, 45530 repo-hours, 805 releases; waiting 488 ms; commit 0 ms)
2026-11-08T07:06:33Z [load_day 2024-07-21] 2024-07-21 hour 23: 125780 events in 0 files, snapshot none (task 4146 ms: download 1855 ms overlapping gunzip 544 ms, parse 2430 ms, sort 0 ms, write 0 ms, index 400 ms: 7 candidates, 48100 repo-hours, 573 releases; waiting 322 ms; commit 0 ms)
2026-11-08T07:06:40Z [load_day 2024-07-21] 2024-07-21: repo_hour merged from 24 files to 1 (1562643 rows, 7297 ms)
2026-11-08T07:06:42Z [load_day 2024-07-21] 2024-07-21: index committed in 9640 ms (24 + 1 + 24 files)
2026-11-08T07:06:42Z [load_day 2024-07-21] 2024-07-21: 3615363 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:06:42Z [load_day 2024-07-21] attempt 1 succeeded