orcaLog in

Runs · run 2409

load_day 2024-05-04, attempt 1 succeeded

Host
73ccef5e07c2:117886
Started
2026-11-08T05:56:02Z
Ended
2026-11-08T05:57:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
619 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
119.9 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2409/load_day/2024-05-04/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:56:02Z [load_day 2024-05-04] attempt 1 started
2026-11-08T05:56:02Z [load_day 2024-05-04] 2024-05-04: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:56:09Z [load_day 2024-05-04] 2024-05-04 hour 0: 176256 events in 0 files, snapshot none (task 6040 ms: download 3083 ms overlapping gunzip 837 ms, parse 3876 ms, sort 0 ms, write 0 ms, index 581 ms: 16 candidates, 85070 repo-hours, 1036 releases; waiting 477 ms; commit 0 ms)
2026-11-08T05:56:09Z [load_day 2024-05-04] 2024-05-04 hour 1: 167380 events in 0 files, snapshot none (task 5832 ms: download 2838 ms overlapping gunzip 812 ms, parse 3583 ms, sort 0 ms, write 0 ms, index 650 ms: 15 candidates, 85299 repo-hours, 720 releases; waiting 475 ms; commit 0 ms)
2026-11-08T05:56:14Z [load_day 2024-05-04] 2024-05-04 hour 2: 131934 events in 0 files, snapshot none (task 5033 ms: download 2649 ms overlapping gunzip 684 ms, parse 3058 ms, sort 0 ms, write 0 ms, index 459 ms: 8 candidates, 47094 repo-hours, 711 releases; waiting 524 ms; commit 0 ms)
2026-11-08T05:56:15Z [load_day 2024-05-04] 2024-05-04 hour 3: 141917 events in 0 files, snapshot none (task 5119 ms: download 3165 ms overlapping gunzip 708 ms, parse 3219 ms, sort 0 ms, write 0 ms, index 395 ms: 10 candidates, 53148 repo-hours, 2276 releases; waiting 502 ms; commit 0 ms)
2026-11-08T05:56:21Z [load_day 2024-05-04] 2024-05-04 hour 4: 136528 events in 0 files, snapshot none (task 5607 ms: download 2850 ms overlapping gunzip 746 ms, parse 3513 ms, sort 0 ms, write 0 ms, index 457 ms: 5 candidates, 47437 repo-hours, 580 releases; waiting 531 ms; commit 0 ms)
2026-11-08T05:56:21Z [load_day 2024-05-04] 2024-05-04 hour 5: 142703 events in 0 files, snapshot none (task 4870 ms: download 3223 ms overlapping gunzip 681 ms, parse 2962 ms, sort 0 ms, write 0 ms, index 455 ms: 4 candidates, 49993 repo-hours, 777 releases; waiting 498 ms; commit 0 ms)
2026-11-08T05:56:26Z [load_day 2024-05-04] 2024-05-04 hour 6: 159784 events in 0 files, snapshot none (task 5058 ms: download 2609 ms overlapping gunzip 680 ms, parse 3164 ms, sort 0 ms, write 0 ms, index 447 ms: 7 candidates, 63634 repo-hours, 1014 releases; waiting 520 ms; commit 0 ms)
2026-11-08T05:56:26Z [load_day 2024-05-04] 2024-05-04 hour 7: 161055 events in 0 files, snapshot none (task 5257 ms: download 2679 ms overlapping gunzip 725 ms, parse 3083 ms, sort 0 ms, write 0 ms, index 400 ms: 4 candidates, 56347 repo-hours, 888 releases; waiting 730 ms; commit 0 ms)
2026-11-08T05:56:33Z [load_day 2024-05-04] 2024-05-04 hour 8: 168579 events in 0 files, snapshot none (task 5907 ms: download 3730 ms overlapping gunzip 787 ms, parse 3595 ms, sort 0 ms, write 0 ms, index 532 ms: 6 candidates, 59512 repo-hours, 924 releases; waiting 659 ms; commit 0 ms)
2026-11-08T05:56:33Z [load_day 2024-05-04] 2024-05-04 hour 9: 175821 events in 0 files, snapshot none (task 6061 ms: download 3143 ms overlapping gunzip 825 ms, parse 3844 ms, sort 0 ms, write 0 ms, index 584 ms: 7 candidates, 64586 repo-hours, 1057 releases; waiting 513 ms; commit 0 ms)
2026-11-08T05:56:38Z [load_day 2024-05-04] 2024-05-04 hour 10: 162712 events in 0 files, snapshot none (task 5215 ms: download 2747 ms overlapping gunzip 730 ms, parse 3145 ms, sort 0 ms, write 0 ms, index 507 ms: 8 candidates, 62681 repo-hours, 843 releases; waiting 512 ms; commit 0 ms)
2026-11-08T05:56:39Z [load_day 2024-05-04] 2024-05-04 hour 11: 173066 events in 0 files, snapshot none (task 5269 ms: download 2545 ms overlapping gunzip 747 ms, parse 3283 ms, sort 0 ms, write 0 ms, index 609 ms: 2 candidates, 68112 repo-hours, 906 releases; waiting 323 ms; commit 0 ms)
2026-11-08T05:56:46Z [load_day 2024-05-04] 2024-05-04 hour 12: 247129 events in 0 files, snapshot none (task 7034 ms: download 4514 ms overlapping gunzip 876 ms, parse 4377 ms, sort 0 ms, write 0 ms, index 735 ms: 9 candidates, 101244 repo-hours, 1026 releases; waiting 500 ms; commit 0 ms)
2026-11-08T05:56:46Z [load_day 2024-05-04] 2024-05-04 hour 13: 191836 events in 0 files, snapshot none (task 6136 ms: download 3406 ms overlapping gunzip 839 ms, parse 3926 ms, sort 0 ms, write 0 ms, index 651 ms: 8 candidates, 84457 repo-hours, 687 releases; waiting 468 ms; commit 0 ms)
2026-11-08T05:56:53Z [load_day 2024-05-04] 2024-05-04 hour 14: 182964 events in 0 files, snapshot none (task 7114 ms: download 3855 ms overlapping gunzip 995 ms, parse 4672 ms, sort 0 ms, write 0 ms, index 727 ms: 10 candidates, 69496 repo-hours, 766 releases; waiting 485 ms; commit 0 ms)
2026-11-08T05:56:53Z [load_day 2024-05-04] 2024-05-04 hour 15: 194030 events in 0 files, snapshot none (task 7116 ms: download 3951 ms overlapping gunzip 1030 ms, parse 4638 ms, sort 0 ms, write 0 ms, index 625 ms: 8 candidates, 75138 repo-hours, 902 releases; waiting 504 ms; commit 0 ms)
2026-11-08T05:57:00Z [load_day 2024-05-04] 2024-05-04 hour 16: 192182 events in 0 files, snapshot none (task 6264 ms: download 3334 ms overlapping gunzip 904 ms, parse 4002 ms, sort 0 ms, write 0 ms, index 540 ms: 9 candidates, 68940 repo-hours, 935 releases; waiting 531 ms; commit 0 ms)
2026-11-08T05:57:00Z [load_day 2024-05-04] 2024-05-04 hour 17: 172412 events in 0 files, snapshot none (task 5936 ms: download 2971 ms overlapping gunzip 857 ms, parse 3773 ms, sort 0 ms, write 0 ms, index 532 ms: 7 candidates, 64085 repo-hours, 973 releases; waiting 511 ms; commit 0 ms)
2026-11-08T05:57:06Z [load_day 2024-05-04] 2024-05-04 hour 18: 189630 events in 0 files, snapshot none (task 5073 ms: download 2729 ms overlapping gunzip 661 ms, parse 2974 ms, sort 0 ms, write 0 ms, index 552 ms: 10 candidates, 74807 repo-hours, 924 releases; waiting 577 ms; commit 0 ms)
2026-11-08T05:57:06Z [load_day 2024-05-04] 2024-05-04 hour 19: 158028 events in 0 files, snapshot none (task 4194 ms: download 2118 ms overlapping gunzip 584 ms, parse 2545 ms, sort 0 ms, write 0 ms, index 417 ms: 14 candidates, 56799 repo-hours, 801 releases; waiting 389 ms; commit 0 ms)
2026-11-08T05:57:11Z [load_day 2024-05-04] 2024-05-04 hour 20: 155606 events in 0 files, snapshot none (task 4556 ms: download 2771 ms overlapping gunzip 608 ms, parse 2638 ms, sort 0 ms, write 0 ms, index 453 ms: 8 candidates, 57420 repo-hours, 786 releases; waiting 516 ms; commit 0 ms)
2026-11-08T05:57:11Z [load_day 2024-05-04] 2024-05-04 hour 21: 170588 events in 0 files, snapshot none (task 4232 ms: download 2083 ms overlapping gunzip 547 ms, parse 2516 ms, sort 0 ms, write 0 ms, index 394 ms: 5 candidates, 54636 repo-hours, 799 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:57:15Z [load_day 2024-05-04] 2024-05-04 hour 22: 136947 events in 0 files, snapshot none (task 3811 ms: download 1791 ms overlapping gunzip 486 ms, parse 2099 ms, sort 0 ms, write 0 ms, index 429 ms: 5 candidates, 46524 repo-hours, 761 releases; waiting 513 ms; commit 0 ms)
2026-11-08T05:57:15Z [load_day 2024-05-04] 2024-05-04 hour 23: 124271 events in 0 files, snapshot none (task 3588 ms: download 2175 ms overlapping gunzip 429 ms, parse 1974 ms, sort 0 ms, write 0 ms, index 354 ms: 6 candidates, 44668 repo-hours, 566 releases; waiting 489 ms; commit 0 ms)
2026-11-08T05:57:22Z [load_day 2024-05-04] 2024-05-04: repo_hour merged from 24 files to 1 (1541127 rows, 7330 ms)
2026-11-08T05:57:25Z [load_day 2024-05-04] 2024-05-04: index committed in 10139 ms (24 + 1 + 24 files)
2026-11-08T05:57:25Z [load_day 2024-05-04] 2024-05-04: 4013358 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:57:25Z [load_day 2024-05-04] attempt 1 succeeded