orcaLog in

Runs · run 5003

load_day 2026-03-05, attempt 1 succeeded

Host
73ccef5e07c2:451563
Started
2026-11-08T15:29:45Z
Ended
2026-11-08T15:30:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
720 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
73.0 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/5003/load_day/2026-03-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:29:45Z [load_day 2026-03-05] attempt 1 started
2026-11-08T15:29:46Z [load_day 2026-03-05] 2026-03-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:29:50Z [load_day 2026-03-05] 2026-03-05 hour 0: 149697 events in 0 files, snapshot none (task 3588 ms: download 2221 ms overlapping gunzip 499 ms, parse 1411 ms, sort 0 ms, write 0 ms, index 644 ms: 1 candidates, 76854 repo-hours, 873 releases; waiting 648 ms; commit 0 ms)
2026-11-08T15:29:50Z [load_day 2026-03-05] 2026-03-05 hour 1: 158662 events in 0 files, snapshot none (task 3299 ms: download 1843 ms overlapping gunzip 375 ms, parse 1208 ms, sort 0 ms, write 0 ms, index 815 ms: 4 candidates, 95887 repo-hours, 594 releases; waiting 618 ms; commit 0 ms)
2026-11-08T15:29:53Z [load_day 2026-03-05] 2026-03-05 hour 2: 159636 events in 0 files, snapshot none (task 2899 ms: download 1839 ms overlapping gunzip 346 ms, parse 1103 ms, sort 0 ms, write 0 ms, index 633 ms: 7 candidates, 89116 repo-hours, 530 releases; waiting 483 ms; commit 0 ms)
2026-11-08T15:29:54Z [load_day 2026-03-05] 2026-03-05 hour 3: 149041 events in 0 files, snapshot none (task 3237 ms: download 2170 ms overlapping gunzip 414 ms, parse 1284 ms, sort 0 ms, write 0 ms, index 634 ms: 4 candidates, 75045 repo-hours, 930 releases; waiting 596 ms; commit 0 ms)
2026-11-08T15:29:57Z [load_day 2026-03-05] 2026-03-05 hour 4: 150804 events in 0 files, snapshot none (task 3173 ms: download 2146 ms overlapping gunzip 403 ms, parse 1212 ms, sort 0 ms, write 0 ms, index 547 ms: 3 candidates, 73757 repo-hours, 973 releases; waiting 717 ms; commit 0 ms)
2026-11-08T15:29:58Z [load_day 2026-03-05] 2026-03-05 hour 5: 150122 events in 0 files, snapshot none (task 3868 ms: download 2725 ms overlapping gunzip 383 ms, parse 1177 ms, sort 0 ms, write 0 ms, index 603 ms: 7 candidates, 79799 repo-hours, 809 releases; waiting 1416 ms; commit 0 ms)
2026-11-08T15:30:01Z [load_day 2026-03-05] 2026-03-05 hour 6: 152734 events in 0 files, snapshot none (task 3532 ms: download 2460 ms overlapping gunzip 411 ms, parse 1189 ms, sort 0 ms, write 0 ms, index 706 ms: 9 candidates, 84268 repo-hours, 676 releases; waiting 945 ms; commit 0 ms)
2026-11-08T15:30:02Z [load_day 2026-03-05] 2026-03-05 hour 7: 152602 events in 0 files, snapshot none (task 3612 ms: download 2296 ms overlapping gunzip 382 ms, parse 1167 ms, sort 0 ms, write 0 ms, index 688 ms: 10 candidates, 84670 repo-hours, 614 releases; waiting 1003 ms; commit 0 ms)
2026-11-08T15:30:05Z [load_day 2026-03-05] 2026-03-05 hour 8: 153213 events in 0 files, snapshot none (task 3271 ms: download 2187 ms overlapping gunzip 352 ms, parse 1040 ms, sort 0 ms, write 0 ms, index 636 ms: 7 candidates, 85822 repo-hours, 518 releases; waiting 893 ms; commit 0 ms)
2026-11-08T15:30:06Z [load_day 2026-03-05] 2026-03-05 hour 9: 155080 events in 0 files, snapshot none (task 3297 ms: download 2044 ms overlapping gunzip 365 ms, parse 1097 ms, sort 0 ms, write 0 ms, index 732 ms: 5 candidates, 88346 repo-hours, 418 releases; waiting 784 ms; commit 0 ms)
2026-11-08T15:30:09Z [load_day 2026-03-05] 2026-03-05 hour 10: 158174 events in 0 files, snapshot none (task 3260 ms: download 1962 ms overlapping gunzip 369 ms, parse 1155 ms, sort 0 ms, write 0 ms, index 679 ms: 6 candidates, 90418 repo-hours, 418 releases; waiting 650 ms; commit 0 ms)
2026-11-08T15:30:10Z [load_day 2026-03-05] 2026-03-05 hour 11: 156555 events in 0 files, snapshot none (task 3048 ms: download 1697 ms overlapping gunzip 368 ms, parse 1055 ms, sort 0 ms, write 0 ms, index 723 ms: 5 candidates, 85965 repo-hours, 428 releases; waiting 542 ms; commit 0 ms)
2026-11-08T15:30:13Z [load_day 2026-03-05] 2026-03-05 hour 12: 161786 events in 0 files, snapshot none (task 3318 ms: download 1652 ms overlapping gunzip 327 ms, parse 1098 ms, sort 0 ms, write 0 ms, index 874 ms: 8 candidates, 98375 repo-hours, 321 releases; waiting 649 ms; commit 0 ms)
2026-11-08T15:30:13Z [load_day 2026-03-05] 2026-03-05 hour 13: 161562 events in 0 files, snapshot none (task 2874 ms: download 1679 ms overlapping gunzip 302 ms, parse 954 ms, sort 0 ms, write 0 ms, index 701 ms: 6 candidates, 98393 repo-hours, 221 releases; waiting 564 ms; commit 0 ms)
2026-11-08T15:30:17Z [load_day 2026-03-05] 2026-03-05 hour 14: 159651 events in 0 files, snapshot none (task 3561 ms: download 1973 ms overlapping gunzip 382 ms, parse 1177 ms, sort 0 ms, write 0 ms, index 941 ms: 4 candidates, 91130 repo-hours, 200 releases; waiting 757 ms; commit 0 ms)
2026-11-08T15:30:17Z [load_day 2026-03-05] 2026-03-05 hour 15: 157678 events in 0 files, snapshot none (task 3278 ms: download 1520 ms overlapping gunzip 376 ms, parse 1339 ms, sort 0 ms, write 0 ms, index 922 ms: 9 candidates, 91198 repo-hours, 237 releases; waiting 335 ms; commit 0 ms)
2026-11-08T15:30:22Z [load_day 2026-03-05] 2026-03-05 hour 16: 152081 events in 0 files, snapshot none (task 4804 ms: download 3166 ms overlapping gunzip 406 ms, parse 1178 ms, sort 0 ms, write 0 ms, index 685 ms: 5 candidates, 85207 repo-hours, 350 releases; waiting 2184 ms; commit 0 ms)
2026-11-08T15:30:22Z [load_day 2026-03-05] 2026-03-05 hour 17: 151716 events in 0 files, snapshot none (task 3719 ms: download 2113 ms overlapping gunzip 423 ms, parse 1320 ms, sort 0 ms, write 0 ms, index 819 ms: 6 candidates, 86609 repo-hours, 348 releases; waiting 817 ms; commit 0 ms)
2026-11-08T15:30:27Z [load_day 2026-03-05] 2026-03-05 hour 18: 155274 events in 0 files, snapshot none (task 4165 ms: download 2188 ms overlapping gunzip 620 ms, parse 1897 ms, sort 0 ms, write 0 ms, index 788 ms: 9 candidates, 85073 repo-hours, 504 releases; waiting 518 ms; commit 0 ms)
2026-11-08T15:30:27Z [load_day 2026-03-05] 2026-03-05 hour 19: 156417 events in 0 files, snapshot none (task 4399 ms: download 2453 ms overlapping gunzip 674 ms, parse 1975 ms, sort 0 ms, write 0 ms, index 910 ms: 7 candidates, 87146 repo-hours, 471 releases; waiting 561 ms; commit 0 ms)
2026-11-08T15:30:32Z [load_day 2026-03-05] 2026-03-05 hour 20: 157054 events in 0 files, snapshot none (task 4503 ms: download 2678 ms overlapping gunzip 672 ms, parse 2034 ms, sort 0 ms, write 0 ms, index 848 ms: 10 candidates, 85405 repo-hours, 512 releases; waiting 626 ms; commit 0 ms)
2026-11-08T15:30:32Z [load_day 2026-03-05] 2026-03-05 hour 21: 148472 events in 0 files, snapshot none (task 4565 ms: download 2365 ms overlapping gunzip 751 ms, parse 2210 ms, sort 0 ms, write 0 ms, index 804 ms: 13 candidates, 79494 repo-hours, 762 releases; waiting 515 ms; commit 0 ms)
2026-11-08T15:30:36Z [load_day 2026-03-05] 2026-03-05 hour 22: 147287 events in 0 files, snapshot none (task 3521 ms: download 2295 ms overlapping gunzip 546 ms, parse 1633 ms, sort 0 ms, write 0 ms, index 661 ms: 11 candidates, 78033 repo-hours, 684 releases; waiting 437 ms; commit 0 ms)
2026-11-08T15:30:37Z [load_day 2026-03-05] 2026-03-05 hour 23: 147986 events in 0 files, snapshot none (task 4535 ms: download 2411 ms overlapping gunzip 611 ms, parse 2005 ms, sort 0 ms, write 0 ms, index 1044 ms: 9 candidates, 76557 repo-hours, 1021 releases; waiting 504 ms; commit 0 ms)
2026-11-08T15:30:49Z [load_day 2026-03-05] 2026-03-05: repo_hour merged from 24 files to 1 (2052567 rows, 11443 ms)
2026-11-08T15:30:52Z [load_day 2026-03-05] 2026-03-05: index committed in 14732 ms (24 + 1 + 24 files)
2026-11-08T15:30:52Z [load_day 2026-03-05] 2026-03-05: 3703284 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:30:52Z [load_day 2026-03-05] attempt 1 succeeded