orcaLog in

Runs · run 2287

load_day 2024-04-06, attempt 1 succeeded

Host
73ccef5e07c2:106151
Started
2026-11-08T05:28:37Z
Ended
2026-11-08T05:30:03Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
590 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
121.0 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2287/load_day/2024-04-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:28:37Z [load_day 2024-04-06] attempt 1 started
2026-11-08T05:28:39Z [load_day 2024-04-06] 2024-04-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:28:45Z [load_day 2024-04-06] 2024-04-06 hour 0: 220492 events in 0 files, snapshot none (task 6019 ms: download 2956 ms overlapping gunzip 791 ms, parse 3413 ms, sort 0 ms, write 0 ms, index 1026 ms: 9 candidates, 86749 repo-hours, 1144 releases; waiting 474 ms; commit 0 ms)
2026-11-08T05:28:45Z [load_day 2024-04-06] 2024-04-06 hour 1: 210960 events in 0 files, snapshot none (task 6045 ms: download 2862 ms overlapping gunzip 761 ms, parse 3388 ms, sort 0 ms, write 0 ms, index 1076 ms: 7 candidates, 83230 repo-hours, 724 releases; waiting 477 ms; commit 0 ms)
2026-11-08T05:28:50Z [load_day 2024-04-06] 2024-04-06 hour 2: 183937 events in 0 files, snapshot none (task 4340 ms: download 2983 ms overlapping gunzip 623 ms, parse 2544 ms, sort 0 ms, write 0 ms, index 368 ms: 6 candidates, 50757 repo-hours, 579 releases; waiting 505 ms; commit 0 ms)
2026-11-08T05:28:51Z [load_day 2024-04-06] 2024-04-06 hour 3: 179340 events in 0 files, snapshot none (task 4626 ms: download 2327 ms overlapping gunzip 669 ms, parse 2798 ms, sort 0 ms, write 0 ms, index 349 ms: 8 candidates, 48658 repo-hours, 694 releases; waiting 477 ms; commit 0 ms)
2026-11-08T05:28:56Z [load_day 2024-04-06] 2024-04-06 hour 4: 176290 events in 0 files, snapshot none (task 5261 ms: download 2401 ms overlapping gunzip 692 ms, parse 3069 ms, sort 0 ms, write 0 ms, index 434 ms: 7 candidates, 48555 repo-hours, 554 releases; waiting 540 ms; commit 0 ms)
2026-11-08T05:28:57Z [load_day 2024-04-06] 2024-04-06 hour 5: 188761 events in 0 files, snapshot none (task 5661 ms: download 3386 ms overlapping gunzip 863 ms, parse 3605 ms, sort 0 ms, write 0 ms, index 360 ms: 6 candidates, 51129 repo-hours, 678 releases; waiting 505 ms; commit 0 ms)
2026-11-08T05:29:03Z [load_day 2024-04-06] 2024-04-06 hour 6: 199183 events in 0 files, snapshot none (task 6311 ms: download 2911 ms overlapping gunzip 815 ms, parse 3525 ms, sort 0 ms, write 0 ms, index 874 ms: 6 candidates, 60260 repo-hours, 697 releases; waiting 782 ms; commit 0 ms)
2026-11-08T05:29:03Z [load_day 2024-04-06] 2024-04-06 hour 7: 191475 events in 0 files, snapshot none (task 5728 ms: download 2664 ms overlapping gunzip 854 ms, parse 3577 ms, sort 0 ms, write 0 ms, index 463 ms: 5 candidates, 55398 repo-hours, 509 releases; waiting 467 ms; commit 0 ms)
2026-11-08T05:29:09Z [load_day 2024-04-06] 2024-04-06 hour 8: 197572 events in 0 files, snapshot none (task 6271 ms: download 2885 ms overlapping gunzip 912 ms, parse 4014 ms, sort 0 ms, write 0 ms, index 686 ms: 5 candidates, 58737 repo-hours, 661 releases; waiting 363 ms; commit 0 ms)
2026-11-08T05:29:10Z [load_day 2024-04-06] 2024-04-06 hour 9: 199186 events in 0 files, snapshot none (task 6255 ms: download 3117 ms overlapping gunzip 934 ms, parse 3939 ms, sort 0 ms, write 0 ms, index 502 ms: 9 candidates, 59292 repo-hours, 771 releases; waiting 498 ms; commit 0 ms)
2026-11-08T05:29:16Z [load_day 2024-04-06] 2024-04-06 hour 10: 200036 events in 0 files, snapshot none (task 5959 ms: download 2965 ms overlapping gunzip 835 ms, parse 3814 ms, sort 0 ms, write 0 ms, index 520 ms: 4 candidates, 60408 repo-hours, 829 releases; waiting 468 ms; commit 0 ms)
2026-11-08T05:29:16Z [load_day 2024-04-06] 2024-04-06 hour 11: 198862 events in 0 files, snapshot none (task 6040 ms: download 3378 ms overlapping gunzip 879 ms, parse 3891 ms, sort 0 ms, write 0 ms, index 432 ms: 5 candidates, 57809 repo-hours, 733 releases; waiting 493 ms; commit 0 ms)
2026-11-08T05:29:24Z [load_day 2024-04-06] 2024-04-06 hour 12: 277155 events in 0 files, snapshot none (task 7740 ms: download 3917 ms overlapping gunzip 998 ms, parse 5114 ms, sort 0 ms, write 0 ms, index 802 ms: 7 candidates, 93729 repo-hours, 848 releases; waiting 511 ms; commit 0 ms)
2026-11-08T05:29:24Z [load_day 2024-04-06] 2024-04-06 hour 13: 227458 events in 0 files, snapshot none (task 6690 ms: download 3113 ms overlapping gunzip 902 ms, parse 3892 ms, sort 0 ms, write 0 ms, index 1009 ms: 8 candidates, 85271 repo-hours, 843 releases; waiting 520 ms; commit 0 ms)
2026-11-08T05:29:31Z [load_day 2024-04-06] 2024-04-06 hour 14: 220828 events in 0 files, snapshot none (task 6189 ms: download 3558 ms overlapping gunzip 900 ms, parse 3915 ms, sort 0 ms, write 0 ms, index 555 ms: 11 candidates, 72015 repo-hours, 886 releases; waiting 515 ms; commit 0 ms)
2026-11-08T05:29:31Z [load_day 2024-04-06] 2024-04-06 hour 15: 226280 events in 0 files, snapshot none (task 5540 ms: download 3104 ms overlapping gunzip 808 ms, parse 3343 ms, sort 0 ms, write 0 ms, index 649 ms: 14 candidates, 74555 repo-hours, 1024 releases; waiting 464 ms; commit 0 ms)
2026-11-08T05:29:37Z [load_day 2024-04-06] 2024-04-06 hour 16: 215579 events in 0 files, snapshot none (task 5598 ms: download 2942 ms overlapping gunzip 865 ms, parse 3667 ms, sort 0 ms, write 0 ms, index 587 ms: 9 candidates, 67408 repo-hours, 939 releases; waiting 182 ms; commit 0 ms)
2026-11-08T05:29:37Z [load_day 2024-04-06] 2024-04-06 hour 17: 209006 events in 0 files, snapshot none (task 5398 ms: download 2982 ms overlapping gunzip 744 ms, parse 3421 ms, sort 0 ms, write 0 ms, index 463 ms: 8 candidates, 62681 repo-hours, 828 releases; waiting 486 ms; commit 0 ms)
2026-11-08T05:29:43Z [load_day 2024-04-06] 2024-04-06 hour 18: 214964 events in 0 files, snapshot none (task 5642 ms: download 3164 ms overlapping gunzip 790 ms, parse 3448 ms, sort 0 ms, write 0 ms, index 577 ms: 12 candidates, 70775 repo-hours, 981 releases; waiting 474 ms; commit 0 ms)
2026-11-08T05:29:43Z [load_day 2024-04-06] 2024-04-06 hour 19: 196680 events in 0 files, snapshot none (task 5415 ms: download 2802 ms overlapping gunzip 731 ms, parse 3399 ms, sort 0 ms, write 0 ms, index 483 ms: 9 candidates, 58225 repo-hours, 803 releases; waiting 506 ms; commit 0 ms)
2026-11-08T05:29:48Z [load_day 2024-04-06] 2024-04-06 hour 20: 196476 events in 0 files, snapshot none (task 5227 ms: download 2936 ms overlapping gunzip 748 ms, parse 3244 ms, sort 0 ms, write 0 ms, index 477 ms: 6 candidates, 59422 repo-hours, 755 releases; waiting 501 ms; commit 0 ms)
2026-11-08T05:29:48Z [load_day 2024-04-06] 2024-04-06 hour 21: 187664 events in 0 files, snapshot none (task 5051 ms: download 2619 ms overlapping gunzip 681 ms, parse 3079 ms, sort 0 ms, write 0 ms, index 402 ms: 6 candidates, 51904 repo-hours, 857 releases; waiting 562 ms; commit 0 ms)
2026-11-08T05:29:54Z [load_day 2024-04-06] 2024-04-06 hour 22: 188243 events in 0 files, snapshot none (task 4968 ms: download 2436 ms overlapping gunzip 710 ms, parse 3040 ms, sort 0 ms, write 0 ms, index 379 ms: 7 candidates, 48932 repo-hours, 699 releases; waiting 570 ms; commit 0 ms)
2026-11-08T05:29:54Z [load_day 2024-04-06] 2024-04-06 hour 23: 176818 events in 0 files, snapshot none (task 4603 ms: download 2139 ms overlapping gunzip 607 ms, parse 2741 ms, sort 0 ms, write 0 ms, index 474 ms: 7 candidates, 47322 repo-hours, 585 releases; waiting 482 ms; commit 0 ms)
2026-11-08T05:30:01Z [load_day 2024-04-06] 2024-04-06: repo_hour merged from 24 files to 1 (1513221 rows, 6850 ms)
2026-11-08T05:30:03Z [load_day 2024-04-06] 2024-04-06: index committed in 9635 ms (24 + 1 + 24 files)
2026-11-08T05:30:03Z [load_day 2024-04-06] 2024-04-06: 4883245 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:30:03Z [load_day 2024-04-06] attempt 1 succeeded