orcaLog in

Runs · run 2886

load_day 2024-08-24, attempt 1 succeeded

Host
73ccef5e07c2:168911
Started
2026-11-08T07:35:37Z
Ended
2026-11-08T07:36:54Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
618 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
108.1 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2886/load_day/2024-08-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:35:37Z [load_day 2024-08-24] attempt 1 started
2026-11-08T07:35:38Z [load_day 2024-08-24] 2024-08-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:35:44Z [load_day 2024-08-24] 2024-08-24 hour 0: 164894 events in 0 files, snapshot none (task 5922 ms: download 2349 ms overlapping gunzip 846 ms, parse 3576 ms, sort 0 ms, write 0 ms, index 778 ms: 5 candidates, 81082 repo-hours, 1165 releases; waiting 397 ms; commit 0 ms)
2026-11-08T07:35:45Z [load_day 2024-08-24] 2024-08-24 hour 1: 163337 events in 0 files, snapshot none (task 6026 ms: download 2745 ms overlapping gunzip 840 ms, parse 3664 ms, sort 0 ms, write 0 ms, index 691 ms: 4 candidates, 89841 repo-hours, 750 releases; waiting 518 ms; commit 0 ms)
2026-11-08T07:35:49Z [load_day 2024-08-24] 2024-08-24 hour 2: 129733 events in 0 files, snapshot none (task 4061 ms: download 1964 ms overlapping gunzip 611 ms, parse 2617 ms, sort 0 ms, write 0 ms, index 376 ms: 5 candidates, 53715 repo-hours, 726 releases; waiting 193 ms; commit 0 ms)
2026-11-08T07:35:50Z [load_day 2024-08-24] 2024-08-24 hour 3: 150854 events in 0 files, snapshot none (task 4451 ms: download 2245 ms overlapping gunzip 592 ms, parse 2525 ms, sort 0 ms, write 0 ms, index 534 ms: 2 candidates, 59492 repo-hours, 4842 releases; waiting 527 ms; commit 0 ms)
2026-11-08T07:35:54Z [load_day 2024-08-24] 2024-08-24 hour 4: 130329 events in 0 files, snapshot none (task 4700 ms: download 2151 ms overlapping gunzip 693 ms, parse 2856 ms, sort 0 ms, write 0 ms, index 351 ms: 2 candidates, 47704 repo-hours, 598 releases; waiting 489 ms; commit 0 ms)
2026-11-08T07:35:55Z [load_day 2024-08-24] 2024-08-24 hour 5: 138643 events in 0 files, snapshot none (task 4491 ms: download 2036 ms overlapping gunzip 594 ms, parse 2549 ms, sort 0 ms, write 0 ms, index 461 ms: 3 candidates, 51329 repo-hours, 830 releases; waiting 512 ms; commit 0 ms)
2026-11-08T07:36:00Z [load_day 2024-08-24] 2024-08-24 hour 6: 159729 events in 0 files, snapshot none (task 5654 ms: download 3057 ms overlapping gunzip 733 ms, parse 3201 ms, sort 0 ms, write 0 ms, index 665 ms: 4 candidates, 69358 repo-hours, 958 releases; waiting 705 ms; commit 0 ms)
2026-11-08T07:36:01Z [load_day 2024-08-24] 2024-08-24 hour 7: 152411 events in 0 files, snapshot none (task 5406 ms: download 2709 ms overlapping gunzip 807 ms, parse 3296 ms, sort 0 ms, write 0 ms, index 458 ms: 4 candidates, 56220 repo-hours, 876 releases; waiting 577 ms; commit 0 ms)
2026-11-08T07:36:05Z [load_day 2024-08-24] 2024-08-24 hour 8: 158223 events in 0 files, snapshot none (task 4551 ms: download 3074 ms overlapping gunzip 542 ms, parse 2399 ms, sort 0 ms, write 0 ms, index 383 ms: 5 candidates, 59854 repo-hours, 876 releases; waiting 865 ms; commit 0 ms)
2026-11-08T07:36:06Z [load_day 2024-08-24] 2024-08-24 hour 9: 163281 events in 0 files, snapshot none (task 4155 ms: download 2424 ms overlapping gunzip 556 ms, parse 2299 ms, sort 0 ms, write 0 ms, index 476 ms: 4 candidates, 67557 repo-hours, 1057 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:36:10Z [load_day 2024-08-24] 2024-08-24 hour 10: 157451 events in 0 files, snapshot none (task 3977 ms: download 2176 ms overlapping gunzip 526 ms, parse 2287 ms, sort 0 ms, write 0 ms, index 412 ms: 9 candidates, 61724 repo-hours, 791 releases; waiting 523 ms; commit 0 ms)
2026-11-08T07:36:11Z [load_day 2024-08-24] 2024-08-24 hour 11: 155511 events in 0 files, snapshot none (task 4512 ms: download 2385 ms overlapping gunzip 611 ms, parse 2528 ms, sort 0 ms, write 0 ms, index 419 ms: 5 candidates, 57063 repo-hours, 738 releases; waiting 524 ms; commit 0 ms)
2026-11-08T07:36:16Z [load_day 2024-08-24] 2024-08-24 hour 12: 219687 events in 0 files, snapshot none (task 5288 ms: download 3448 ms overlapping gunzip 613 ms, parse 2881 ms, sort 0 ms, write 0 ms, index 721 ms: 22 candidates, 105974 repo-hours, 880 releases; waiting 843 ms; commit 0 ms)
2026-11-08T07:36:16Z [load_day 2024-08-24] 2024-08-24 hour 13: 186402 events in 0 files, snapshot none (task 4291 ms: download 1793 ms overlapping gunzip 613 ms, parse 2690 ms, sort 0 ms, write 0 ms, index 592 ms: 9 candidates, 84450 repo-hours, 765 releases; waiting 175 ms; commit 0 ms)
2026-11-08T07:36:22Z [load_day 2024-08-24] 2024-08-24 hour 14: 174210 events in 0 files, snapshot none (task 5501 ms: download 2997 ms overlapping gunzip 797 ms, parse 3365 ms, sort 0 ms, write 0 ms, index 588 ms: 4 candidates, 68011 repo-hours, 735 releases; waiting 477 ms; commit 0 ms)
2026-11-08T07:36:22Z [load_day 2024-08-24] 2024-08-24 hour 15: 186325 events in 0 files, snapshot none (task 5470 ms: download 3129 ms overlapping gunzip 781 ms, parse 3336 ms, sort 0 ms, write 0 ms, index 568 ms: 7 candidates, 76215 repo-hours, 917 releases; waiting 511 ms; commit 0 ms)
2026-11-08T07:36:28Z [load_day 2024-08-24] 2024-08-24 hour 16: 176826 events in 0 files, snapshot none (task 5599 ms: download 3551 ms overlapping gunzip 841 ms, parse 3515 ms, sort 0 ms, write 0 ms, index 509 ms: 3 candidates, 68478 repo-hours, 871 releases; waiting 480 ms; commit 0 ms)
2026-11-08T07:36:28Z [load_day 2024-08-24] 2024-08-24 hour 17: 169938 events in 0 files, snapshot none (task 5324 ms: download 2801 ms overlapping gunzip 736 ms, parse 3281 ms, sort 0 ms, write 0 ms, index 530 ms: 5 candidates, 63809 repo-hours, 775 releases; waiting 494 ms; commit 0 ms)
2026-11-08T07:36:34Z [load_day 2024-08-24] 2024-08-24 hour 18: 181162 events in 0 files, snapshot none (task 5325 ms: download 2422 ms overlapping gunzip 642 ms, parse 2847 ms, sort 0 ms, write 0 ms, index 1044 ms: 11 candidates, 80230 repo-hours, 872 releases; waiting 506 ms; commit 0 ms)
2026-11-08T07:36:34Z [load_day 2024-08-24] 2024-08-24 hour 19: 152696 events in 0 files, snapshot none (task 4801 ms: download 2508 ms overlapping gunzip 583 ms, parse 2667 ms, sort 0 ms, write 0 ms, index 750 ms: 2 candidates, 53946 repo-hours, 825 releases; waiting 489 ms; commit 0 ms)
2026-11-08T07:36:40Z [load_day 2024-08-24] 2024-08-24 hour 20: 151415 events in 0 files, snapshot none (task 5913 ms: download 2570 ms overlapping gunzip 866 ms, parse 3738 ms, sort 0 ms, write 0 ms, index 508 ms: 12 candidates, 53920 repo-hours, 688 releases; waiting 492 ms; commit 0 ms)
2026-11-08T07:36:40Z [load_day 2024-08-24] 2024-08-24 hour 21: 146287 events in 0 files, snapshot none (task 4965 ms: download 1567 ms overlapping gunzip 711 ms, parse 3160 ms, sort 0 ms, write 0 ms, index 606 ms: 3 candidates, 55980 repo-hours, 992 releases; waiting 188 ms; commit 0 ms)
2026-11-08T07:36:45Z [load_day 2024-08-24] 2024-08-24 hour 22: 131252 events in 0 files, snapshot none (task 4281 ms: download 2585 ms overlapping gunzip 560 ms, parse 2450 ms, sort 0 ms, write 0 ms, index 421 ms: 5 candidates, 48299 repo-hours, 834 releases; waiting 545 ms; commit 0 ms)
2026-11-08T07:36:45Z [load_day 2024-08-24] 2024-08-24 hour 23: 130451 events in 0 files, snapshot none (task 4384 ms: download 1830 ms overlapping gunzip 614 ms, parse 2521 ms, sort 0 ms, write 0 ms, index 461 ms: 10 candidates, 48026 repo-hours, 581 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:36:51Z [load_day 2024-08-24] 2024-08-24: repo_hour merged from 24 files to 1 (1562277 rows, 6621 ms)
2026-11-08T07:36:54Z [load_day 2024-08-24] 2024-08-24: index committed in 9099 ms (24 + 1 + 24 files)
2026-11-08T07:36:54Z [load_day 2024-08-24] 2024-08-24: 3831047 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:36:54Z [load_day 2024-08-24] attempt 1 succeeded