orcaLog in

Runs · run 3160

load_day 2024-11-03, attempt 1 succeeded

Host
73ccef5e07c2:201909
Started
2026-11-08T08:37:58Z
Ended
2026-11-08T08:39:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
672 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
128.2 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3160/load_day/2024-11-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:37:58Z [load_day 2024-11-03] attempt 1 started
2026-11-08T08:37:59Z [load_day 2024-11-03] 2024-11-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:38:04Z [load_day 2024-11-03] 2024-11-03 hour 0: 144586 events in 0 files, snapshot none (task 4656 ms: download 2305 ms overlapping gunzip 639 ms, parse 2714 ms, sort 0 ms, write 0 ms, index 550 ms: 4 candidates, 70122 repo-hours, 1252 releases; waiting 471 ms; commit 0 ms)
2026-11-08T08:38:05Z [load_day 2024-11-03] 2024-11-03 hour 1: 167428 events in 0 files, snapshot none (task 5359 ms: download 2534 ms overlapping gunzip 683 ms, parse 3066 ms, sort 0 ms, write 0 ms, index 789 ms: 4 candidates, 93061 repo-hours, 978 releases; waiting 480 ms; commit 0 ms)
2026-11-08T08:38:09Z [load_day 2024-11-03] 2024-11-03 hour 2: 129576 events in 0 files, snapshot none (task 4182 ms: download 1792 ms overlapping gunzip 593 ms, parse 2427 ms, sort 0 ms, write 0 ms, index 449 ms: 10 candidates, 57117 repo-hours, 851 releases; waiting 486 ms; commit 0 ms)
2026-11-08T08:38:10Z [load_day 2024-11-03] 2024-11-03 hour 3: 161595 events in 0 files, snapshot none (task 5107 ms: download 2535 ms overlapping gunzip 719 ms, parse 2961 ms, sort 0 ms, write 0 ms, index 557 ms: 8 candidates, 59623 repo-hours, 4050 releases; waiting 537 ms; commit 0 ms)
2026-11-08T08:38:15Z [load_day 2024-11-03] 2024-11-03 hour 4: 146822 events in 0 files, snapshot none (task 5412 ms: download 3058 ms overlapping gunzip 801 ms, parse 3385 ms, sort 0 ms, write 0 ms, index 381 ms: 2 candidates, 49968 repo-hours, 571 releases; waiting 533 ms; commit 0 ms)
2026-11-08T08:38:16Z [load_day 2024-11-03] 2024-11-03 hour 5: 149886 events in 0 files, snapshot none (task 5119 ms: download 2837 ms overlapping gunzip 822 ms, parse 3148 ms, sort 0 ms, write 0 ms, index 372 ms: 2 candidates, 50229 repo-hours, 679 releases; waiting 511 ms; commit 0 ms)
2026-11-08T08:38:21Z [load_day 2024-11-03] 2024-11-03 hour 6: 163509 events in 0 files, snapshot none (task 5955 ms: download 2380 ms overlapping gunzip 878 ms, parse 3703 ms, sort 0 ms, write 0 ms, index 577 ms: 3 candidates, 66529 repo-hours, 784 releases; waiting 441 ms; commit 0 ms)
2026-11-08T08:38:22Z [load_day 2024-11-03] 2024-11-03 hour 7: 156476 events in 0 files, snapshot none (task 5596 ms: download 3310 ms overlapping gunzip 888 ms, parse 3436 ms, sort 0 ms, write 0 ms, index 417 ms: 3 candidates, 52682 repo-hours, 599 releases; waiting 522 ms; commit 0 ms)
2026-11-08T08:38:28Z [load_day 2024-11-03] 2024-11-03 hour 8: 158914 events in 0 files, snapshot none (task 6232 ms: download 3118 ms overlapping gunzip 879 ms, parse 3782 ms, sort 0 ms, write 0 ms, index 600 ms: 4 candidates, 56948 repo-hours, 696 releases; waiting 579 ms; commit 0 ms)
2026-11-08T08:38:28Z [load_day 2024-11-03] 2024-11-03 hour 9: 156836 events in 0 files, snapshot none (task 5623 ms: download 3641 ms overlapping gunzip 820 ms, parse 3502 ms, sort 0 ms, write 0 ms, index 462 ms: 2 candidates, 59714 repo-hours, 728 releases; waiting 489 ms; commit 0 ms)
2026-11-08T08:38:34Z [load_day 2024-11-03] 2024-11-03 hour 10: 173994 events in 0 files, snapshot none (task 5094 ms: download 3126 ms overlapping gunzip 724 ms, parse 2995 ms, sort 0 ms, write 0 ms, index 440 ms: 6 candidates, 61572 repo-hours, 744 releases; waiting 582 ms; commit 0 ms)
2026-11-08T08:38:34Z [load_day 2024-11-03] 2024-11-03 hour 11: 177496 events in 0 files, snapshot none (task 5062 ms: download 2865 ms overlapping gunzip 760 ms, parse 3088 ms, sort 0 ms, write 0 ms, index 453 ms: 1 candidates, 60282 repo-hours, 738 releases; waiting 531 ms; commit 0 ms)
2026-11-08T08:38:40Z [load_day 2024-11-03] 2024-11-03 hour 12: 236198 events in 0 files, snapshot none (task 5764 ms: download 3005 ms overlapping gunzip 732 ms, parse 3360 ms, sort 0 ms, write 0 ms, index 845 ms: 8 candidates, 113388 repo-hours, 1084 releases; waiting 527 ms; commit 0 ms)
2026-11-08T08:38:40Z [load_day 2024-11-03] 2024-11-03 hour 13: 218299 events in 0 files, snapshot none (task 5801 ms: download 3358 ms overlapping gunzip 788 ms, parse 3352 ms, sort 0 ms, write 0 ms, index 671 ms: 8 candidates, 91291 repo-hours, 942 releases; waiting 681 ms; commit 0 ms)
2026-11-08T08:38:47Z [load_day 2024-11-03] 2024-11-03 hour 14: 200627 events in 0 files, snapshot none (task 6587 ms: download 3476 ms overlapping gunzip 1039 ms, parse 3994 ms, sort 0 ms, write 0 ms, index 757 ms: 5 candidates, 74866 repo-hours, 883 releases; waiting 498 ms; commit 0 ms)
2026-11-08T08:38:47Z [load_day 2024-11-03] 2024-11-03 hour 15: 212302 events in 0 files, snapshot none (task 6851 ms: download 4261 ms overlapping gunzip 1031 ms, parse 4370 ms, sort 0 ms, write 0 ms, index 652 ms: 5 candidates, 83115 repo-hours, 1112 releases; waiting 506 ms; commit 0 ms)
2026-11-08T08:38:53Z [load_day 2024-11-03] 2024-11-03 hour 16: 199659 events in 0 files, snapshot none (task 5961 ms: download 3045 ms overlapping gunzip 903 ms, parse 3718 ms, sort 0 ms, write 0 ms, index 724 ms: 7 candidates, 75675 repo-hours, 977 releases; waiting 346 ms; commit 0 ms)
2026-11-08T08:38:53Z [load_day 2024-11-03] 2024-11-03 hour 17: 193123 events in 0 files, snapshot none (task 5748 ms: download 3094 ms overlapping gunzip 823 ms, parse 3366 ms, sort 0 ms, write 0 ms, index 763 ms: 8 candidates, 69490 repo-hours, 890 releases; waiting 508 ms; commit 0 ms)
2026-11-08T08:39:00Z [load_day 2024-11-03] 2024-11-03 hour 18: 206533 events in 0 files, snapshot none (task 6609 ms: download 3747 ms overlapping gunzip 904 ms, parse 4000 ms, sort 0 ms, write 0 ms, index 987 ms: 7 candidates, 86640 repo-hours, 1152 releases; waiting 494 ms; commit 0 ms)
2026-11-08T08:39:00Z [load_day 2024-11-03] 2024-11-03 hour 19: 185477 events in 0 files, snapshot none (task 6290 ms: download 3561 ms overlapping gunzip 967 ms, parse 3982 ms, sort 0 ms, write 0 ms, index 633 ms: 12 candidates, 63815 repo-hours, 879 releases; waiting 488 ms; commit 0 ms)
2026-11-08T08:39:07Z [load_day 2024-11-03] 2024-11-03 hour 20: 181514 events in 0 files, snapshot none (task 6040 ms: download 3742 ms overlapping gunzip 849 ms, parse 3900 ms, sort 0 ms, write 0 ms, index 454 ms: 9 candidates, 65050 repo-hours, 991 releases; waiting 505 ms; commit 0 ms)
2026-11-08T08:39:07Z [load_day 2024-11-03] 2024-11-03 hour 21: 187674 events in 0 files, snapshot none (task 5764 ms: download 3336 ms overlapping gunzip 857 ms, parse 3422 ms, sort 0 ms, write 0 ms, index 529 ms: 6 candidates, 71547 repo-hours, 1252 releases; waiting 546 ms; commit 0 ms)
2026-11-08T08:39:14Z [load_day 2024-11-03] 2024-11-03 hour 22: 165313 events in 0 files, snapshot none (task 6467 ms: download 3637 ms overlapping gunzip 981 ms, parse 4109 ms, sort 0 ms, write 0 ms, index 488 ms: 5 candidates, 58867 repo-hours, 1251 releases; waiting 494 ms; commit 0 ms)
2026-11-08T08:39:14Z [load_day 2024-11-03] 2024-11-03 hour 23: 163476 events in 0 files, snapshot none (task 6065 ms: download 3174 ms overlapping gunzip 990 ms, parse 3783 ms, sort 0 ms, write 0 ms, index 429 ms: 8 candidates, 58493 repo-hours, 910 releases; waiting 233 ms; commit 0 ms)
2026-11-08T08:39:22Z [load_day 2024-11-03] 2024-11-03: repo_hour merged from 24 files to 1 (1650084 rows, 8066 ms)
2026-11-08T08:39:25Z [load_day 2024-11-03] 2024-11-03: index committed in 11007 ms (24 + 1 + 24 files)
2026-11-08T08:39:25Z [load_day 2024-11-03] 2024-11-03: 4237313 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:39:25Z [load_day 2024-11-03] attempt 1 succeeded