orcaLog in

Runs · run 2652

load_day 2024-06-28, attempt 1 succeeded

Host
73ccef5e07c2:142807
Started
2026-11-08T06:44:40Z
Ended
2026-11-08T06:46:29Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
702 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
169.2 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2652/load_day/2024-06-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:44:40Z [load_day 2024-06-28] attempt 1 started
2026-11-08T06:44:41Z [load_day 2024-06-28] 2024-06-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:44:49Z [load_day 2024-06-28] 2024-06-28 hour 0: 183156 events in 0 files, snapshot none (task 7081 ms: download 3793 ms overlapping gunzip 1012 ms, parse 4386 ms, sort 0 ms, write 0 ms, index 869 ms: 10 candidates, 99976 repo-hours, 2550 releases; waiting 484 ms; commit 0 ms)
2026-11-08T06:44:49Z [load_day 2024-06-28] 2024-06-28 hour 1: 179936 events in 0 files, snapshot none (task 7717 ms: download 4443 ms overlapping gunzip 1103 ms, parse 4863 ms, sort 0 ms, write 0 ms, index 955 ms: 6 candidates, 100353 repo-hours, 2287 releases; waiting 507 ms; commit 0 ms)
2026-11-08T06:44:55Z [load_day 2024-06-28] 2024-06-28 hour 2: 154442 events in 0 files, snapshot none (task 6152 ms: download 3414 ms overlapping gunzip 891 ms, parse 3603 ms, sort 0 ms, write 0 ms, index 714 ms: 8 candidates, 65148 repo-hours, 2241 releases; waiting 537 ms; commit 0 ms)
2026-11-08T06:44:57Z [load_day 2024-06-28] 2024-06-28 hour 3: 178361 events in 0 files, snapshot none (task 7486 ms: download 4154 ms overlapping gunzip 1061 ms, parse 4837 ms, sort 0 ms, write 0 ms, index 772 ms: 6 candidates, 76628 repo-hours, 6807 releases; waiting 512 ms; commit 0 ms)
2026-11-08T06:45:01Z [load_day 2024-06-28] 2024-06-28 hour 4: 154843 events in 0 files, snapshot none (task 5364 ms: download 2999 ms overlapping gunzip 783 ms, parse 3249 ms, sort 0 ms, write 0 ms, index 475 ms: 4 candidates, 62652 repo-hours, 2131 releases; waiting 552 ms; commit 0 ms)
2026-11-08T06:45:03Z [load_day 2024-06-28] 2024-06-28 hour 5: 167918 events in 0 files, snapshot none (task 5489 ms: download 2757 ms overlapping gunzip 735 ms, parse 3187 ms, sort 0 ms, write 0 ms, index 740 ms: 8 candidates, 68477 repo-hours, 2200 releases; waiting 494 ms; commit 0 ms)
2026-11-08T06:45:11Z [load_day 2024-06-28] 2024-06-28 hour 6: 204873 events in 0 files, snapshot none (task 9010 ms: download 5039 ms overlapping gunzip 1224 ms, parse 5307 ms, sort 0 ms, write 0 ms, index 1601 ms: 8 candidates, 94968 repo-hours, 2393 releases; waiting 526 ms; commit 0 ms)
2026-11-08T06:45:11Z [load_day 2024-06-28] 2024-06-28 hour 7: 210207 events in 0 files, snapshot none (task 7287 ms: download 4822 ms overlapping gunzip 1142 ms, parse 4756 ms, sort 0 ms, write 0 ms, index 593 ms: 13 candidates, 85308 repo-hours, 2333 releases; waiting 502 ms; commit 0 ms)
2026-11-08T06:45:20Z [load_day 2024-06-28] 2024-06-28 hour 8: 217937 events in 0 files, snapshot none (task 9243 ms: download 6517 ms overlapping gunzip 1519 ms, parse 6127 ms, sort 0 ms, write 0 ms, index 678 ms: 6 candidates, 91900 repo-hours, 2467 releases; waiting 570 ms; commit 0 ms)
2026-11-08T06:45:21Z [load_day 2024-06-28] 2024-06-28 hour 9: 220088 events in 0 files, snapshot none (task 9581 ms: download 6615 ms overlapping gunzip 1491 ms, parse 6374 ms, sort 0 ms, write 0 ms, index 811 ms: 6 candidates, 96033 repo-hours, 2406 releases; waiting 575 ms; commit 0 ms)
2026-11-08T06:45:30Z [load_day 2024-06-28] 2024-06-28 hour 10: 206466 events in 0 files, snapshot none (task 8727 ms: download 5917 ms overlapping gunzip 1334 ms, parse 5870 ms, sort 0 ms, write 0 ms, index 697 ms: 7 candidates, 84403 repo-hours, 2472 releases; waiting 513 ms; commit 0 ms)
2026-11-08T06:45:30Z [load_day 2024-06-28] 2024-06-28 hour 11: 203928 events in 0 files, snapshot none (task 8467 ms: download 5423 ms overlapping gunzip 1293 ms, parse 5700 ms, sort 0 ms, write 0 ms, index 610 ms: 13 candidates, 79082 repo-hours, 2469 releases; waiting 602 ms; commit 0 ms)
2026-11-08T06:45:39Z [load_day 2024-06-28] 2024-06-28 hour 12: 260865 events in 0 files, snapshot none (task 9127 ms: download 6229 ms overlapping gunzip 1323 ms, parse 6071 ms, sort 0 ms, write 0 ms, index 900 ms: 11 candidates, 124513 repo-hours, 2416 releases; waiting 537 ms; commit 0 ms)
2026-11-08T06:45:39Z [load_day 2024-06-28] 2024-06-28 hour 13: 233520 events in 0 files, snapshot none (task 8690 ms: download 5762 ms overlapping gunzip 1399 ms, parse 5746 ms, sort 0 ms, write 0 ms, index 775 ms: 6 candidates, 106874 repo-hours, 2479 releases; waiting 520 ms; commit 0 ms)
2026-11-08T06:45:48Z [load_day 2024-06-28] 2024-06-28 hour 14: 229464 events in 0 files, snapshot none (task 8911 ms: download 6378 ms overlapping gunzip 1388 ms, parse 6017 ms, sort 0 ms, write 0 ms, index 691 ms: 6 candidates, 96068 repo-hours, 2463 releases; waiting 538 ms; commit 0 ms)
2026-11-08T06:45:49Z [load_day 2024-06-28] 2024-06-28 hour 15: 235626 events in 0 files, snapshot none (task 9313 ms: download 6649 ms overlapping gunzip 1496 ms, parse 6215 ms, sort 0 ms, write 0 ms, index 749 ms: 12 candidates, 109022 repo-hours, 1287 releases; waiting 518 ms; commit 0 ms)
2026-11-08T06:45:56Z [load_day 2024-06-28] 2024-06-28 hour 16: 207944 events in 0 files, snapshot none (task 6918 ms: download 4506 ms overlapping gunzip 1052 ms, parse 4398 ms, sort 0 ms, write 0 ms, index 668 ms: 7 candidates, 89935 repo-hours, 1319 releases; waiting 546 ms; commit 0 ms)
2026-11-08T06:45:56Z [load_day 2024-06-28] 2024-06-28 hour 17: 192617 events in 0 files, snapshot none (task 6517 ms: download 4038 ms overlapping gunzip 999 ms, parse 4178 ms, sort 0 ms, write 0 ms, index 587 ms: 7 candidates, 80841 repo-hours, 992 releases; waiting 437 ms; commit 0 ms)
2026-11-08T06:46:03Z [load_day 2024-06-28] 2024-06-28 hour 18: 203852 events in 0 files, snapshot none (task 6560 ms: download 3627 ms overlapping gunzip 880 ms, parse 3758 ms, sort 0 ms, write 0 ms, index 702 ms: 8 candidates, 97223 repo-hours, 1021 releases; waiting 527 ms; commit 0 ms)
2026-11-08T06:46:03Z [load_day 2024-06-28] 2024-06-28 hour 19: 180783 events in 0 files, snapshot none (task 6045 ms: download 3644 ms overlapping gunzip 921 ms, parse 3710 ms, sort 0 ms, write 0 ms, index 530 ms: 7 candidates, 73714 repo-hours, 988 releases; waiting 536 ms; commit 0 ms)
2026-11-08T06:46:11Z [load_day 2024-06-28] 2024-06-28 hour 20: 181054 events in 0 files, snapshot none (task 7424 ms: download 3967 ms overlapping gunzip 1173 ms, parse 4888 ms, sort 0 ms, write 0 ms, index 544 ms: 9 candidates, 72642 repo-hours, 976 releases; waiting 513 ms; commit 0 ms)
2026-11-08T06:46:11Z [load_day 2024-06-28] 2024-06-28 hour 21: 169858 events in 0 files, snapshot none (task 6578 ms: download 3799 ms overlapping gunzip 1063 ms, parse 4090 ms, sort 0 ms, write 0 ms, index 567 ms: 6 candidates, 71270 repo-hours, 1071 releases; waiting 549 ms; commit 0 ms)
2026-11-08T06:46:18Z [load_day 2024-06-28] 2024-06-28 hour 22: 149178 events in 0 files, snapshot none (task 6358 ms: download 3851 ms overlapping gunzip 1054 ms, parse 4061 ms, sort 0 ms, write 0 ms, index 389 ms: 6 candidates, 56863 repo-hours, 1889 releases; waiting 507 ms; commit 0 ms)
2026-11-08T06:46:18Z [load_day 2024-06-28] 2024-06-28 hour 23: 135353 events in 0 files, snapshot none (task 6142 ms: download 3499 ms overlapping gunzip 988 ms, parse 3922 ms, sort 0 ms, write 0 ms, index 414 ms: 4 candidates, 48237 repo-hours, 2598 releases; waiting 511 ms; commit 0 ms)
2026-11-08T06:46:27Z [load_day 2024-06-28] 2024-06-28: repo_hour merged from 24 files to 1 (2032130 rows, 9095 ms)
2026-11-08T06:46:29Z [load_day 2024-06-28] 2024-06-28: index committed in 11531 ms (24 + 1 + 24 files)
2026-11-08T06:46:29Z [load_day 2024-06-28] 2024-06-28: 4662269 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:46:29Z [load_day 2024-06-28] attempt 1 succeeded