orcaLog in

Runs · run 2229

load_day 2024-03-23, attempt 1 succeeded

Host
73ccef5e07c2:100829
Started
2026-11-08T05:16:01Z
Ended
2026-11-08T05:17:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
601 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
110.5 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2229/load_day/2024-03-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:16:01Z [load_day 2024-03-23] attempt 1 started
2026-11-08T05:16:02Z [load_day 2024-03-23] 2024-03-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:16:08Z [load_day 2024-03-23] 2024-03-23 hour 0: 180215 events in 0 files, snapshot none (task 6219 ms: download 3319 ms overlapping gunzip 954 ms, parse 3606 ms, sort 0 ms, write 0 ms, index 834 ms: 7 candidates, 88950 repo-hours, 1279 releases; waiting 504 ms; commit 0 ms)
2026-11-08T05:16:08Z [load_day 2024-03-23] 2024-03-23 hour 1: 167893 events in 0 files, snapshot none (task 5739 ms: download 2782 ms overlapping gunzip 783 ms, parse 3365 ms, sort 0 ms, write 0 ms, index 860 ms: 7 candidates, 85727 repo-hours, 836 releases; waiting 442 ms; commit 0 ms)
2026-11-08T05:16:14Z [load_day 2024-03-23] 2024-03-23 hour 2: 132544 events in 0 files, snapshot none (task 4996 ms: download 2596 ms overlapping gunzip 800 ms, parse 3180 ms, sort 0 ms, write 0 ms, index 374 ms: 5 candidates, 50437 repo-hours, 728 releases; waiting 403 ms; commit 0 ms)
2026-11-08T05:16:14Z [load_day 2024-03-23] 2024-03-23 hour 3: 128818 events in 0 files, snapshot none (task 4821 ms: download 2699 ms overlapping gunzip 706 ms, parse 2805 ms, sort 0 ms, write 0 ms, index 497 ms: 8 candidates, 49403 repo-hours, 749 releases; waiting 494 ms; commit 0 ms)
2026-11-08T05:16:19Z [load_day 2024-03-23] 2024-03-23 hour 4: 126353 events in 0 files, snapshot none (task 4512 ms: download 2725 ms overlapping gunzip 673 ms, parse 2705 ms, sort 0 ms, write 0 ms, index 357 ms: 1 candidates, 47330 repo-hours, 498 releases; waiting 485 ms; commit 0 ms)
2026-11-08T05:16:19Z [load_day 2024-03-23] 2024-03-23 hour 5: 135040 events in 0 files, snapshot none (task 4770 ms: download 2330 ms overlapping gunzip 702 ms, parse 2842 ms, sort 0 ms, write 0 ms, index 400 ms: 3 candidates, 50244 repo-hours, 536 releases; waiting 522 ms; commit 0 ms)
2026-11-08T05:16:25Z [load_day 2024-03-23] 2024-03-23 hour 6: 143567 events in 0 files, snapshot none (task 5026 ms: download 2875 ms overlapping gunzip 707 ms, parse 2978 ms, sort 0 ms, write 0 ms, index 526 ms: 7 candidates, 59449 repo-hours, 886 releases; waiting 479 ms; commit 0 ms)
2026-11-08T05:16:25Z [load_day 2024-03-23] 2024-03-23 hour 7: 138853 events in 0 files, snapshot none (task 4713 ms: download 2274 ms overlapping gunzip 639 ms, parse 2637 ms, sort 0 ms, write 0 ms, index 570 ms: 1 candidates, 53291 repo-hours, 754 releases; waiting 518 ms; commit 0 ms)
2026-11-08T05:16:30Z [load_day 2024-03-23] 2024-03-23 hour 8: 149369 events in 0 files, snapshot none (task 5080 ms: download 2335 ms overlapping gunzip 679 ms, parse 3012 ms, sort 0 ms, write 0 ms, index 512 ms: 5 candidates, 58663 repo-hours, 792 releases; waiting 525 ms; commit 0 ms)
2026-11-08T05:16:30Z [load_day 2024-03-23] 2024-03-23 hour 9: 150885 events in 0 files, snapshot none (task 5137 ms: download 2516 ms overlapping gunzip 719 ms, parse 2981 ms, sort 0 ms, write 0 ms, index 671 ms: 3 candidates, 59875 repo-hours, 1017 releases; waiting 493 ms; commit 0 ms)
2026-11-08T05:16:36Z [load_day 2024-03-23] 2024-03-23 hour 10: 156472 events in 0 files, snapshot none (task 5280 ms: download 3068 ms overlapping gunzip 735 ms, parse 3038 ms, sort 0 ms, write 0 ms, index 484 ms: 3 candidates, 60497 repo-hours, 651 releases; waiting 744 ms; commit 0 ms)
2026-11-08T05:16:36Z [load_day 2024-03-23] 2024-03-23 hour 11: 157364 events in 0 files, snapshot none (task 5332 ms: download 2855 ms overlapping gunzip 757 ms, parse 3117 ms, sort 0 ms, write 0 ms, index 574 ms: 2 candidates, 61586 repo-hours, 655 releases; waiting 603 ms; commit 0 ms)
2026-11-08T05:16:42Z [load_day 2024-03-23] 2024-03-23 hour 12: 236088 events in 0 files, snapshot none (task 5955 ms: download 2953 ms overlapping gunzip 748 ms, parse 3618 ms, sort 0 ms, write 0 ms, index 767 ms: 5 candidates, 96346 repo-hours, 855 releases; waiting 525 ms; commit 0 ms)
2026-11-08T05:16:42Z [load_day 2024-03-23] 2024-03-23 hour 13: 186193 events in 0 files, snapshot none (task 5309 ms: download 3037 ms overlapping gunzip 745 ms, parse 3205 ms, sort 0 ms, write 0 ms, index 675 ms: 3 candidates, 86393 repo-hours, 706 releases; waiting 461 ms; commit 0 ms)
2026-11-08T05:16:48Z [load_day 2024-03-23] 2024-03-23 hour 14: 177431 events in 0 files, snapshot none (task 5485 ms: download 2856 ms overlapping gunzip 770 ms, parse 3373 ms, sort 0 ms, write 0 ms, index 597 ms: 3 candidates, 71295 repo-hours, 821 releases; waiting 526 ms; commit 0 ms)
2026-11-08T05:16:48Z [load_day 2024-03-23] 2024-03-23 hour 15: 183251 events in 0 files, snapshot none (task 5503 ms: download 3047 ms overlapping gunzip 797 ms, parse 3286 ms, sort 0 ms, write 0 ms, index 600 ms: 3 candidates, 74346 repo-hours, 958 releases; waiting 534 ms; commit 0 ms)
2026-11-08T05:16:55Z [load_day 2024-03-23] 2024-03-23 hour 16: 180679 events in 0 files, snapshot none (task 6661 ms: download 3662 ms overlapping gunzip 950 ms, parse 4207 ms, sort 0 ms, write 0 ms, index 723 ms: 8 candidates, 73480 repo-hours, 911 releases; waiting 515 ms; commit 0 ms)
2026-11-08T05:16:55Z [load_day 2024-03-23] 2024-03-23 hour 17: 173096 events in 0 files, snapshot none (task 5949 ms: download 3145 ms overlapping gunzip 855 ms, parse 3653 ms, sort 0 ms, write 0 ms, index 656 ms: 3 candidates, 68853 repo-hours, 1507 releases; waiting 505 ms; commit 0 ms)
2026-11-08T05:17:02Z [load_day 2024-03-23] 2024-03-23 hour 18: 177780 events in 0 files, snapshot none (task 6944 ms: download 3976 ms overlapping gunzip 1003 ms, parse 4487 ms, sort 0 ms, write 0 ms, index 565 ms: 6 candidates, 76671 repo-hours, 993 releases; waiting 517 ms; commit 0 ms)
2026-11-08T05:17:02Z [load_day 2024-03-23] 2024-03-23 hour 19: 157384 events in 0 files, snapshot none (task 6358 ms: download 2938 ms overlapping gunzip 942 ms, parse 4115 ms, sort 0 ms, write 0 ms, index 529 ms: 7 candidates, 64112 repo-hours, 1065 releases; waiting 481 ms; commit 0 ms)
2026-11-08T05:17:08Z [load_day 2024-03-23] 2024-03-23 hour 20: 149947 events in 0 files, snapshot none (task 4906 ms: download 2523 ms overlapping gunzip 666 ms, parse 2911 ms, sort 0 ms, write 0 ms, index 589 ms: 7 candidates, 59532 repo-hours, 732 releases; waiting 499 ms; commit 0 ms)
2026-11-08T05:17:08Z [load_day 2024-03-23] 2024-03-23 hour 21: 145035 events in 0 files, snapshot none (task 4406 ms: download 2258 ms overlapping gunzip 571 ms, parse 2523 ms, sort 0 ms, write 0 ms, index 567 ms: 5 candidates, 54318 repo-hours, 851 releases; waiting 514 ms; commit 0 ms)
2026-11-08T05:17:12Z [load_day 2024-03-23] 2024-03-23 hour 22: 128838 events in 0 files, snapshot none (task 3898 ms: download 2339 ms overlapping gunzip 546 ms, parse 2229 ms, sort 0 ms, write 0 ms, index 401 ms: 3 candidates, 50059 repo-hours, 760 releases; waiting 387 ms; commit 0 ms)
2026-11-08T05:17:12Z [load_day 2024-03-23] 2024-03-23 hour 23: 127307 events in 0 files, snapshot none (task 3757 ms: download 2254 ms overlapping gunzip 503 ms, parse 2087 ms, sort 0 ms, write 0 ms, index 351 ms: 3 candidates, 48183 repo-hours, 585 releases; waiting 511 ms; commit 0 ms)
2026-11-08T05:17:19Z [load_day 2024-03-23] 2024-03-23: repo_hour merged from 24 files to 1 (1549040 rows, 6569 ms)
2026-11-08T05:17:21Z [load_day 2024-03-23] 2024-03-23: index committed in 8995 ms (24 + 1 + 24 files)
2026-11-08T05:17:21Z [load_day 2024-03-23] 2024-03-23: 3790402 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:17:21Z [load_day 2024-03-23] attempt 1 succeeded