orcaLog in

Runs · run 5064

load_day 2026-03-22, attempt 1 succeeded

Host
73ccef5e07c2:458818
Started
2026-11-08T15:38:47Z
Ended
2026-11-08T15:39:56Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
737 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
93.0 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/5064/load_day/2026-03-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:38:47Z [load_day 2026-03-22] attempt 1 started
2026-11-08T15:38:48Z [load_day 2026-03-22] 2026-03-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:38:52Z [load_day 2026-03-22] 2026-03-22 hour 0: 150503 events in 0 files, snapshot none (task 3850 ms: download 2538 ms overlapping gunzip 583 ms, parse 1697 ms, sort 0 ms, write 0 ms, index 527 ms: 12 candidates, 63524 repo-hours, 1330 releases; waiting 717 ms; commit 0 ms)
2026-11-08T15:38:52Z [load_day 2026-03-22] 2026-03-22 hour 1: 157608 events in 0 files, snapshot none (task 3455 ms: download 2113 ms overlapping gunzip 460 ms, parse 1486 ms, sort 0 ms, write 0 ms, index 652 ms: 10 candidates, 84725 repo-hours, 921 releases; waiting 557 ms; commit 0 ms)
2026-11-08T15:38:56Z [load_day 2026-03-22] 2026-03-22 hour 2: 159798 events in 0 files, snapshot none (task 3524 ms: download 2223 ms overlapping gunzip 525 ms, parse 1566 ms, sort 0 ms, write 0 ms, index 643 ms: 4 candidates, 85903 repo-hours, 847 releases; waiting 566 ms; commit 0 ms)
2026-11-08T15:38:56Z [load_day 2026-03-22] 2026-03-22 hour 3: 150663 events in 0 files, snapshot none (task 3549 ms: download 2577 ms overlapping gunzip 573 ms, parse 1599 ms, sort 0 ms, write 0 ms, index 460 ms: 13 candidates, 64073 repo-hours, 1049 releases; waiting 642 ms; commit 0 ms)
2026-11-08T15:39:02Z [load_day 2026-03-22] 2026-03-22 hour 4: 157996 events in 0 files, snapshot none (task 5114 ms: download 3430 ms overlapping gunzip 970 ms, parse 2646 ms, sort 0 ms, write 0 ms, index 621 ms: 13 candidates, 66593 repo-hours, 1006 releases; waiting 572 ms; commit 0 ms)
2026-11-08T15:39:03Z [load_day 2026-03-22] 2026-03-22 hour 5: 158323 events in 0 files, snapshot none (task 6319 ms: download 4392 ms overlapping gunzip 1341 ms, parse 3511 ms, sort 0 ms, write 0 ms, index 587 ms: 7 candidates, 62327 repo-hours, 755 releases; waiting 370 ms; commit 0 ms)
2026-11-08T15:39:07Z [load_day 2026-03-22] 2026-03-22 hour 6: 155943 events in 0 files, snapshot none (task 4156 ms: download 2923 ms overlapping gunzip 715 ms, parse 1936 ms, sort 0 ms, write 0 ms, index 631 ms: 14 candidates, 72240 repo-hours, 844 releases; waiting 508 ms; commit 0 ms)
2026-11-08T15:39:09Z [load_day 2026-03-22] 2026-03-22 hour 7: 160906 events in 0 files, snapshot none (task 4944 ms: download 3371 ms overlapping gunzip 801 ms, parse 2105 ms, sort 0 ms, write 0 ms, index 671 ms: 10 candidates, 74481 repo-hours, 971 releases; waiting 1029 ms; commit 0 ms)
2026-11-08T15:39:13Z [load_day 2026-03-22] 2026-03-22 hour 8: 153140 events in 0 files, snapshot none (task 5241 ms: download 3941 ms overlapping gunzip 852 ms, parse 2284 ms, sort 0 ms, write 0 ms, index 600 ms: 10 candidates, 72210 repo-hours, 952 releases; waiting 1159 ms; commit 0 ms)
2026-11-08T15:39:15Z [load_day 2026-03-22] 2026-03-22 hour 9: 159637 events in 0 files, snapshot none (task 5689 ms: download 4094 ms overlapping gunzip 811 ms, parse 2190 ms, sort 0 ms, write 0 ms, index 635 ms: 11 candidates, 75452 repo-hours, 949 releases; waiting 1760 ms; commit 0 ms)
2026-11-08T15:39:19Z [load_day 2026-03-22] 2026-03-22 hour 10: 159786 events in 0 files, snapshot none (task 5684 ms: download 3430 ms overlapping gunzip 760 ms, parse 2026 ms, sort 0 ms, write 0 ms, index 1184 ms: 8 candidates, 74773 repo-hours, 793 releases; waiting 1343 ms; commit 0 ms)
2026-11-08T15:39:20Z [load_day 2026-03-22] 2026-03-22 hour 11: 163439 events in 0 files, snapshot none (task 4444 ms: download 2846 ms overlapping gunzip 605 ms, parse 1724 ms, sort 0 ms, write 0 ms, index 667 ms: 27 candidates, 76575 repo-hours, 915 releases; waiting 1181 ms; commit 0 ms)
2026-11-08T15:39:22Z [load_day 2026-03-22] 2026-03-22 hour 12: 167496 events in 0 files, snapshot none (task 2901 ms: download 1653 ms overlapping gunzip 404 ms, parse 1156 ms, sort 0 ms, write 0 ms, index 798 ms: 8 candidates, 95141 repo-hours, 367 releases; waiting 262 ms; commit 0 ms)
2026-11-08T15:39:24Z [load_day 2026-03-22] 2026-03-22 hour 13: 170543 events in 0 files, snapshot none (task 3148 ms: download 1909 ms overlapping gunzip 377 ms, parse 1118 ms, sort 0 ms, write 0 ms, index 750 ms: 19 candidates, 95653 repo-hours, 314 releases; waiting 619 ms; commit 0 ms)
2026-11-08T15:39:26Z [load_day 2026-03-22] 2026-03-22 hour 14: 164937 events in 0 files, snapshot none (task 3266 ms: download 2264 ms overlapping gunzip 354 ms, parse 1088 ms, sort 0 ms, write 0 ms, index 762 ms: 14 candidates, 85002 repo-hours, 422 releases; waiting 840 ms; commit 0 ms)
2026-11-08T15:39:27Z [load_day 2026-03-22] 2026-03-22 hour 15: 167546 events in 0 files, snapshot none (task 3256 ms: download 1820 ms overlapping gunzip 343 ms, parse 1078 ms, sort 0 ms, write 0 ms, index 690 ms: 10 candidates, 86695 repo-hours, 388 releases; waiting 735 ms; commit 0 ms)
2026-11-08T15:39:30Z [load_day 2026-03-22] 2026-03-22 hour 16: 164745 events in 0 files, snapshot none (task 3552 ms: download 2403 ms overlapping gunzip 398 ms, parse 1147 ms, sort 0 ms, write 0 ms, index 654 ms: 6 candidates, 83703 repo-hours, 461 releases; waiting 1017 ms; commit 0 ms)
2026-11-08T15:39:31Z [load_day 2026-03-22] 2026-03-22 hour 17: 163039 events in 0 files, snapshot none (task 3087 ms: download 1814 ms overlapping gunzip 376 ms, parse 1134 ms, sort 0 ms, write 0 ms, index 665 ms: 12 candidates, 81302 repo-hours, 432 releases; waiting 515 ms; commit 0 ms)
2026-11-08T15:39:34Z [load_day 2026-03-22] 2026-03-22 hour 18: 173566 events in 0 files, snapshot none (task 2897 ms: download 1683 ms overlapping gunzip 387 ms, parse 1147 ms, sort 0 ms, write 0 ms, index 681 ms: 13 candidates, 88797 repo-hours, 367 releases; waiting 370 ms; commit 0 ms)
2026-11-08T15:39:36Z [load_day 2026-03-22] 2026-03-22 hour 19: 166729 events in 0 files, snapshot none (task 3972 ms: download 2647 ms overlapping gunzip 466 ms, parse 1309 ms, sort 0 ms, write 0 ms, index 611 ms: 5 candidates, 78530 repo-hours, 531 releases; waiting 1186 ms; commit 0 ms)
2026-11-08T15:39:37Z [load_day 2026-03-22] 2026-03-22 hour 20: 161241 events in 0 files, snapshot none (task 3103 ms: download 1896 ms overlapping gunzip 477 ms, parse 1392 ms, sort 0 ms, write 0 ms, index 643 ms: 7 candidates, 78990 repo-hours, 771 releases; waiting 352 ms; commit 0 ms)
2026-11-08T15:39:40Z [load_day 2026-03-22] 2026-03-22 hour 21: 156943 events in 0 files, snapshot none (task 3625 ms: download 2379 ms overlapping gunzip 454 ms, parse 1301 ms, sort 0 ms, write 0 ms, index 643 ms: 4 candidates, 76560 repo-hours, 869 releases; waiting 831 ms; commit 0 ms)
2026-11-08T15:39:42Z [load_day 2026-03-22] 2026-03-22 hour 22: 153456 events in 0 files, snapshot none (task 4012 ms: download 2994 ms overlapping gunzip 564 ms, parse 1568 ms, sort 0 ms, write 0 ms, index 516 ms: 7 candidates, 70116 repo-hours, 1087 releases; waiting 1041 ms; commit 0 ms)
2026-11-08T15:39:44Z [load_day 2026-03-22] 2026-03-22 hour 23: 156698 events in 0 files, snapshot none (task 3737 ms: download 2607 ms overlapping gunzip 515 ms, parse 1488 ms, sort 0 ms, write 0 ms, index 598 ms: 11 candidates, 73230 repo-hours, 1190 releases; waiting 861 ms; commit 0 ms)
2026-11-08T15:39:53Z [load_day 2026-03-22] 2026-03-22: repo_hour merged from 24 files to 1 (1866595 rows, 8681 ms)
2026-11-08T15:39:56Z [load_day 2026-03-22] 2026-03-22: index committed in 11758 ms (24 + 1 + 24 files)
2026-11-08T15:39:56Z [load_day 2026-03-22] 2026-03-22: 3854681 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:39:56Z [load_day 2026-03-22] attempt 1 succeeded