orcaLog in

Runs · run 2479

load_day 2024-05-20, attempt 1 succeeded

Host
73ccef5e07c2:124765
Started
2026-11-08T06:10:09Z
Ended
2026-11-08T06:12:11Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
724 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
189.5 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2479/load_day/2024-05-20/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:10:09Z [load_day 2024-05-20] attempt 1 started
2026-11-08T06:10:11Z [load_day 2024-05-20] 2024-05-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:10:17Z [load_day 2024-05-20] 2024-05-20 hour 0: 180716 events in 0 files, snapshot none (task 6207 ms: download 3634 ms overlapping gunzip 956 ms, parse 4051 ms, sort 0 ms, write 0 ms, index 603 ms: 12 candidates, 87113 repo-hours, 1079 releases; waiting 331 ms; commit 0 ms)
2026-11-08T06:10:18Z [load_day 2024-05-20] 2024-05-20 hour 1: 198299 events in 0 files, snapshot none (task 6759 ms: download 4255 ms overlapping gunzip 1069 ms, parse 4251 ms, sort 0 ms, write 0 ms, index 684 ms: 21 candidates, 99225 repo-hours, 995 releases; waiting 533 ms; commit 0 ms)
2026-11-08T06:10:25Z [load_day 2024-05-20] 2024-05-20 hour 2: 170339 events in 0 files, snapshot none (task 6618 ms: download 4359 ms overlapping gunzip 1158 ms, parse 4283 ms, sort 0 ms, write 0 ms, index 425 ms: 15 candidates, 64376 repo-hours, 834 releases; waiting 508 ms; commit 0 ms)
2026-11-08T06:10:25Z [load_day 2024-05-20] 2024-05-20 hour 3: 186303 events in 0 files, snapshot none (task 6336 ms: download 4047 ms overlapping gunzip 1028 ms, parse 3979 ms, sort 0 ms, write 0 ms, index 551 ms: 23 candidates, 70287 repo-hours, 2835 releases; waiting 496 ms; commit 0 ms)
2026-11-08T06:10:32Z [load_day 2024-05-20] 2024-05-20 hour 4: 172696 events in 0 files, snapshot none (task 6660 ms: download 4769 ms overlapping gunzip 1137 ms, parse 4280 ms, sort 0 ms, write 0 ms, index 413 ms: 14 candidates, 60949 repo-hours, 634 releases; waiting 534 ms; commit 0 ms)
2026-11-08T06:10:32Z [load_day 2024-05-20] 2024-05-20 hour 5: 184090 events in 0 files, snapshot none (task 7115 ms: download 4838 ms overlapping gunzip 1095 ms, parse 4635 ms, sort 0 ms, write 0 ms, index 513 ms: 18 candidates, 68392 repo-hours, 780 releases; waiting 529 ms; commit 0 ms)
2026-11-08T06:10:41Z [load_day 2024-05-20] 2024-05-20 hour 6: 216086 events in 0 files, snapshot none (task 8356 ms: download 5442 ms overlapping gunzip 1285 ms, parse 5246 ms, sort 0 ms, write 0 ms, index 972 ms: 16 candidates, 90998 repo-hours, 938 releases; waiting 529 ms; commit 0 ms)
2026-11-08T06:10:41Z [load_day 2024-05-20] 2024-05-20 hour 7: 217644 events in 0 files, snapshot none (task 7978 ms: download 5204 ms overlapping gunzip 1244 ms, parse 5146 ms, sort 0 ms, write 0 ms, index 824 ms: 18 candidates, 82113 repo-hours, 1000 releases; waiting 513 ms; commit 0 ms)
2026-11-08T06:10:50Z [load_day 2024-05-20] 2024-05-20 hour 8: 232119 events in 0 files, snapshot none (task 9138 ms: download 6502 ms overlapping gunzip 1478 ms, parse 6120 ms, sort 0 ms, write 0 ms, index 690 ms: 22 candidates, 89290 repo-hours, 1111 releases; waiting 573 ms; commit 0 ms)
2026-11-08T06:10:50Z [load_day 2024-05-20] 2024-05-20 hour 9: 237265 events in 0 files, snapshot none (task 8988 ms: download 6416 ms overlapping gunzip 1383 ms, parse 6127 ms, sort 0 ms, write 0 ms, index 667 ms: 14 candidates, 93589 repo-hours, 1814 releases; waiting 523 ms; commit 0 ms)
2026-11-08T06:11:00Z [load_day 2024-05-20] 2024-05-20 hour 10: 240689 events in 0 files, snapshot none (task 8992 ms: download 5942 ms overlapping gunzip 1443 ms, parse 5834 ms, sort 0 ms, write 0 ms, index 800 ms: 9 candidates, 85969 repo-hours, 1103 releases; waiting 519 ms; commit 0 ms)
2026-11-08T06:11:00Z [load_day 2024-05-20] 2024-05-20 hour 11: 225907 events in 0 files, snapshot none (task 9050 ms: download 6166 ms overlapping gunzip 1524 ms, parse 6005 ms, sort 0 ms, write 0 ms, index 781 ms: 14 candidates, 84838 repo-hours, 1104 releases; waiting 507 ms; commit 0 ms)
2026-11-08T06:11:08Z [load_day 2024-05-20] 2024-05-20 hour 12: 283381 events in 0 files, snapshot none (task 7477 ms: download 4769 ms overlapping gunzip 1134 ms, parse 4726 ms, sort 0 ms, write 0 ms, index 881 ms: 12 candidates, 125225 repo-hours, 1200 releases; waiting 517 ms; commit 0 ms)
2026-11-08T06:11:08Z [load_day 2024-05-20] 2024-05-20 hour 13: 258572 events in 0 files, snapshot none (task 7865 ms: download 5288 ms overlapping gunzip 1198 ms, parse 5059 ms, sort 0 ms, write 0 ms, index 771 ms: 20 candidates, 112984 repo-hours, 1224 releases; waiting 518 ms; commit 0 ms)
2026-11-08T06:11:18Z [load_day 2024-05-20] 2024-05-20 hour 14: 250408 events in 0 files, snapshot none (task 9520 ms: download 5429 ms overlapping gunzip 1547 ms, parse 5997 ms, sort 0 ms, write 0 ms, index 1216 ms: 21 candidates, 101541 repo-hours, 1334 releases; waiting 513 ms; commit 0 ms)
2026-11-08T06:11:18Z [load_day 2024-05-20] 2024-05-20 hour 15: 267993 events in 0 files, snapshot none (task 9218 ms: download 5437 ms overlapping gunzip 1435 ms, parse 5930 ms, sort 0 ms, write 0 ms, index 1049 ms: 23 candidates, 103226 repo-hours, 1305 releases; waiting 526 ms; commit 0 ms)
2026-11-08T06:11:29Z [load_day 2024-05-20] 2024-05-20 hour 16: 247004 events in 0 files, snapshot none (task 10443 ms: download 7209 ms overlapping gunzip 1701 ms, parse 7013 ms, sort 0 ms, write 0 ms, index 879 ms: 19 candidates, 95994 repo-hours, 1087 releases; waiting 514 ms; commit 0 ms)
2026-11-08T06:11:29Z [load_day 2024-05-20] 2024-05-20 hour 17: 235788 events in 0 files, snapshot none (task 10153 ms: download 6612 ms overlapping gunzip 1565 ms, parse 6707 ms, sort 0 ms, write 0 ms, index 1096 ms: 13 candidates, 89352 repo-hours, 1065 releases; waiting 160 ms; commit 0 ms)
2026-11-08T06:11:39Z [load_day 2024-05-20] 2024-05-20 hour 18: 246647 events in 0 files, snapshot none (task 9969 ms: download 7356 ms overlapping gunzip 1612 ms, parse 6781 ms, sort 0 ms, write 0 ms, index 731 ms: 20 candidates, 99624 repo-hours, 1219 releases; waiting 561 ms; commit 0 ms)
2026-11-08T06:11:39Z [load_day 2024-05-20] 2024-05-20 hour 19: 246700 events in 0 files, snapshot none (task 9527 ms: download 7168 ms overlapping gunzip 1537 ms, parse 6639 ms, sort 0 ms, write 0 ms, index 574 ms: 18 candidates, 79040 repo-hours, 930 releases; waiting 565 ms; commit 0 ms)
2026-11-08T06:11:49Z [load_day 2024-05-20] 2024-05-20 hour 20: 233235 events in 0 files, snapshot none (task 9404 ms: download 7061 ms overlapping gunzip 1584 ms, parse 6442 ms, sort 0 ms, write 0 ms, index 653 ms: 26 candidates, 79732 repo-hours, 971 releases; waiting 482 ms; commit 0 ms)
2026-11-08T06:11:49Z [load_day 2024-05-20] 2024-05-20 hour 21: 225179 events in 0 files, snapshot none (task 8371 ms: download 5924 ms overlapping gunzip 1436 ms, parse 5523 ms, sort 0 ms, write 0 ms, index 575 ms: 22 candidates, 74933 repo-hours, 1079 releases; waiting 506 ms; commit 0 ms)
2026-11-08T06:11:58Z [load_day 2024-05-20] 2024-05-20 hour 22: 211496 events in 0 files, snapshot none (task 7978 ms: download 5539 ms overlapping gunzip 1338 ms, parse 5300 ms, sort 0 ms, write 0 ms, index 500 ms: 15 candidates, 62558 repo-hours, 801 releases; waiting 539 ms; commit 0 ms)
2026-11-08T06:11:58Z [load_day 2024-05-20] 2024-05-20 hour 23: 205882 events in 0 files, snapshot none (task 7408 ms: download 4648 ms overlapping gunzip 1277 ms, parse 5123 ms, sort 0 ms, write 0 ms, index 430 ms: 18 candidates, 59857 repo-hours, 850 releases; waiting 234 ms; commit 0 ms)
2026-11-08T06:12:08Z [load_day 2024-05-20] 2024-05-20: repo_hour merged from 24 files to 1 (2061205 rows, 10360 ms)
2026-11-08T06:12:11Z [load_day 2024-05-20] 2024-05-20: index committed in 12511 ms (24 + 1 + 24 files)
2026-11-08T06:12:11Z [load_day 2024-05-20] 2024-05-20: 5374438 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:12:11Z [load_day 2024-05-20] attempt 1 succeeded