orcaLog in

Runs · run 2067

load_day 2024-02-10, attempt 1 succeeded

Host
73ccef5e07c2:85009
Started
2026-11-08T04:34:52Z
Ended
2026-11-08T04:36:18Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
574 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
113.4 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2067/load_day/2024-02-10/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:34:52Z [load_day 2024-02-10] attempt 1 started
2026-11-08T04:34:53Z [load_day 2024-02-10] 2024-02-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:35:02Z [load_day 2024-02-10] 2024-02-10 hour 0: 217677 events in 0 files, snapshot none (task 8181 ms: download 4852 ms overlapping gunzip 1170 ms, parse 5504 ms, sort 0 ms, write 0 ms, index 756 ms: 12 candidates, 83551 repo-hours, 1105 releases; waiting 454 ms; commit 0 ms)
2026-11-08T04:35:02Z [load_day 2024-02-10] 2024-02-10 hour 1: 200236 events in 0 files, snapshot none (task 7513 ms: download 4179 ms overlapping gunzip 1059 ms, parse 4964 ms, sort 0 ms, write 0 ms, index 649 ms: 5 candidates, 75676 repo-hours, 699 releases; waiting 507 ms; commit 0 ms)
2026-11-08T04:35:09Z [load_day 2024-02-10] 2024-02-10 hour 2: 161915 events in 0 files, snapshot none (task 6064 ms: download 2733 ms overlapping gunzip 910 ms, parse 3853 ms, sort 0 ms, write 0 ms, index 465 ms: 2 candidates, 40062 repo-hours, 554 releases; waiting 516 ms; commit 0 ms)
2026-11-08T04:35:09Z [load_day 2024-02-10] 2024-02-10 hour 3: 163244 events in 0 files, snapshot none (task 5240 ms: download 2213 ms overlapping gunzip 802 ms, parse 3409 ms, sort 0 ms, write 0 ms, index 435 ms: 0 candidates, 40535 repo-hours, 642 releases; waiting 357 ms; commit 0 ms)
2026-11-08T04:35:13Z [load_day 2024-02-10] 2024-02-10 hour 4: 166899 events in 0 files, snapshot none (task 4259 ms: download 2040 ms overlapping gunzip 593 ms, parse 2557 ms, sort 0 ms, write 0 ms, index 338 ms: 5 candidates, 41762 repo-hours, 469 releases; waiting 497 ms; commit 0 ms)
2026-11-08T04:35:14Z [load_day 2024-02-10] 2024-02-10 hour 5: 169657 events in 0 files, snapshot none (task 4747 ms: download 2247 ms overlapping gunzip 646 ms, parse 3030 ms, sort 0 ms, write 0 ms, index 330 ms: 4 candidates, 44178 repo-hours, 524 releases; waiting 499 ms; commit 0 ms)
2026-11-08T04:35:19Z [load_day 2024-02-10] 2024-02-10 hour 6: 181038 events in 0 files, snapshot none (task 5330 ms: download 2159 ms overlapping gunzip 709 ms, parse 3481 ms, sort 0 ms, write 0 ms, index 566 ms: 4 candidates, 52004 repo-hours, 883 releases; waiting 329 ms; commit 0 ms)
2026-11-08T04:35:20Z [load_day 2024-02-10] 2024-02-10 hour 7: 171860 events in 0 files, snapshot none (task 5246 ms: download 2192 ms overlapping gunzip 764 ms, parse 3302 ms, sort 0 ms, write 0 ms, index 538 ms: 6 candidates, 45834 repo-hours, 727 releases; waiting 414 ms; commit 0 ms)
2026-11-08T04:35:25Z [load_day 2024-02-10] 2024-02-10 hour 8: 176763 events in 0 files, snapshot none (task 4963 ms: download 2357 ms overlapping gunzip 664 ms, parse 2940 ms, sort 0 ms, write 0 ms, index 601 ms: 5 candidates, 48828 repo-hours, 754 releases; waiting 505 ms; commit 0 ms)
2026-11-08T04:35:25Z [load_day 2024-02-10] 2024-02-10 hour 9: 183737 events in 0 files, snapshot none (task 4549 ms: download 2393 ms overlapping gunzip 593 ms, parse 2636 ms, sort 0 ms, write 0 ms, index 524 ms: 3 candidates, 51558 repo-hours, 892 releases; waiting 534 ms; commit 0 ms)
2026-11-08T04:35:31Z [load_day 2024-02-10] 2024-02-10 hour 10: 193097 events in 0 files, snapshot none (task 5782 ms: download 2984 ms overlapping gunzip 827 ms, parse 3721 ms, sort 0 ms, write 0 ms, index 409 ms: 5 candidates, 55161 repo-hours, 607 releases; waiting 484 ms; commit 0 ms)
2026-11-08T04:35:31Z [load_day 2024-02-10] 2024-02-10 hour 11: 189829 events in 0 files, snapshot none (task 5807 ms: download 3161 ms overlapping gunzip 831 ms, parse 3759 ms, sort 0 ms, write 0 ms, index 431 ms: 8 candidates, 53851 repo-hours, 660 releases; waiting 508 ms; commit 0 ms)
2026-11-08T04:35:39Z [load_day 2024-02-10] 2024-02-10 hour 12: 269466 events in 0 files, snapshot none (task 7592 ms: download 3917 ms overlapping gunzip 1053 ms, parse 5012 ms, sort 0 ms, write 0 ms, index 774 ms: 7 candidates, 88053 repo-hours, 699 releases; waiting 476 ms; commit 0 ms)
2026-11-08T04:35:39Z [load_day 2024-02-10] 2024-02-10 hour 13: 219592 events in 0 files, snapshot none (task 7078 ms: download 3165 ms overlapping gunzip 947 ms, parse 4307 ms, sort 0 ms, write 0 ms, index 1037 ms: 4 candidates, 78047 repo-hours, 669 releases; waiting 527 ms; commit 0 ms)
2026-11-08T04:35:45Z [load_day 2024-02-10] 2024-02-10 hour 14: 205019 events in 0 files, snapshot none (task 5483 ms: download 2608 ms overlapping gunzip 758 ms, parse 3369 ms, sort 0 ms, write 0 ms, index 612 ms: 7 candidates, 62970 repo-hours, 652 releases; waiting 487 ms; commit 0 ms)
2026-11-08T04:35:46Z [load_day 2024-02-10] 2024-02-10 hour 15: 213165 events in 0 files, snapshot none (task 5987 ms: download 2804 ms overlapping gunzip 826 ms, parse 3716 ms, sort 0 ms, write 0 ms, index 717 ms: 3 candidates, 66935 repo-hours, 913 releases; waiting 477 ms; commit 0 ms)
2026-11-08T04:35:52Z [load_day 2024-02-10] 2024-02-10 hour 16: 213242 events in 0 files, snapshot none (task 5724 ms: download 3094 ms overlapping gunzip 886 ms, parse 3874 ms, sort 0 ms, write 0 ms, index 482 ms: 9 candidates, 66149 repo-hours, 760 releases; waiting 186 ms; commit 0 ms)
2026-11-08T04:35:52Z [load_day 2024-02-10] 2024-02-10 hour 17: 211270 events in 0 files, snapshot none (task 5713 ms: download 3090 ms overlapping gunzip 780 ms, parse 3635 ms, sort 0 ms, write 0 ms, index 517 ms: 8 candidates, 62837 repo-hours, 646 releases; waiting 522 ms; commit 0 ms)
2026-11-08T04:35:59Z [load_day 2024-02-10] 2024-02-10 hour 18: 213362 events in 0 files, snapshot none (task 6352 ms: download 3485 ms overlapping gunzip 918 ms, parse 4032 ms, sort 0 ms, write 0 ms, index 635 ms: 5 candidates, 68892 repo-hours, 843 releases; waiting 498 ms; commit 0 ms)
2026-11-08T04:35:59Z [load_day 2024-02-10] 2024-02-10 hour 19: 197086 events in 0 files, snapshot none (task 5751 ms: download 2949 ms overlapping gunzip 806 ms, parse 3648 ms, sort 0 ms, write 0 ms, index 486 ms: 5 candidates, 58981 repo-hours, 809 releases; waiting 535 ms; commit 0 ms)
2026-11-08T04:36:04Z [load_day 2024-02-10] 2024-02-10 hour 20: 198759 events in 0 files, snapshot none (task 5045 ms: download 2647 ms overlapping gunzip 686 ms, parse 3175 ms, sort 0 ms, write 0 ms, index 408 ms: 4 candidates, 60384 repo-hours, 693 releases; waiting 525 ms; commit 0 ms)
2026-11-08T04:36:04Z [load_day 2024-02-10] 2024-02-10 hour 21: 188917 events in 0 files, snapshot none (task 4587 ms: download 2208 ms overlapping gunzip 628 ms, parse 2857 ms, sort 0 ms, write 0 ms, index 365 ms: 21 candidates, 53394 repo-hours, 830 releases; waiting 496 ms; commit 0 ms)
2026-11-08T04:36:09Z [load_day 2024-02-10] 2024-02-10 hour 22: 180829 events in 0 files, snapshot none (task 4372 ms: download 2901 ms overlapping gunzip 530 ms, parse 2377 ms, sort 0 ms, write 0 ms, index 328 ms: 13 candidates, 47001 repo-hours, 823 releases; waiting 845 ms; commit 0 ms)
2026-11-08T04:36:09Z [load_day 2024-02-10] 2024-02-10 hour 23: 169370 events in 0 files, snapshot none (task 3824 ms: download 1967 ms overlapping gunzip 484 ms, parse 2255 ms, sort 0 ms, write 0 ms, index 336 ms: 6 candidates, 44042 repo-hours, 583 releases; waiting 482 ms; commit 0 ms)
2026-11-08T04:36:15Z [load_day 2024-02-10] 2024-02-10: repo_hour merged from 24 files to 1 (1390685 rows, 6289 ms)
2026-11-08T04:36:17Z [load_day 2024-02-10] 2024-02-10: index committed in 8656 ms (23 + 1 + 24 files)
2026-11-08T04:36:17Z [load_day 2024-02-10] 2024-02-10: 4656029 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:36:17Z [load_day 2024-02-10] attempt 1 succeeded