orcaLog in

Runs · run 2388

load_day 2024-04-29, attempt 1 succeeded

Host
73ccef5e07c2:115811
Started
2026-11-08T05:50:49Z
Ended
2026-11-08T05:53:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
774 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
230.0 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2388/load_day/2024-04-29/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:50:49Z [load_day 2024-04-29] attempt 1 started
2026-11-08T05:50:50Z [load_day 2024-04-29] 2024-04-29: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:50:58Z [load_day 2024-04-29] 2024-04-29 hour 0: 186480 events in 0 files, snapshot none (task 6855 ms: download 3661 ms overlapping gunzip 969 ms, parse 4247 ms, sort 0 ms, write 0 ms, index 864 ms: 13 candidates, 88493 repo-hours, 1030 releases; waiting 491 ms; commit 0 ms)
2026-11-08T05:50:59Z [load_day 2024-04-29] 2024-04-29 hour 1: 205892 events in 0 files, snapshot none (task 7950 ms: download 5070 ms overlapping gunzip 1244 ms, parse 5283 ms, sort 0 ms, write 0 ms, index 672 ms: 7 candidates, 98558 repo-hours, 828 releases; waiting 487 ms; commit 0 ms)
2026-11-08T05:51:06Z [load_day 2024-04-29] 2024-04-29 hour 2: 182042 events in 0 files, snapshot none (task 7698 ms: download 4503 ms overlapping gunzip 1160 ms, parse 5136 ms, sort 0 ms, write 0 ms, index 536 ms: 7 candidates, 64116 repo-hours, 955 releases; waiting 526 ms; commit 0 ms)
2026-11-08T05:51:07Z [load_day 2024-04-29] 2024-04-29 hour 3: 189546 events in 0 files, snapshot none (task 7749 ms: download 5256 ms overlapping gunzip 1300 ms, parse 5150 ms, sort 0 ms, write 0 ms, index 503 ms: 7 candidates, 69039 repo-hours, 2174 releases; waiting 498 ms; commit 0 ms)
2026-11-08T05:51:14Z [load_day 2024-04-29] 2024-04-29 hour 4: 179887 events in 0 files, snapshot none (task 8236 ms: download 5667 ms overlapping gunzip 1347 ms, parse 5548 ms, sort 0 ms, write 0 ms, index 469 ms: 10 candidates, 62397 repo-hours, 707 releases; waiting 581 ms; commit 0 ms)
2026-11-08T05:51:16Z [load_day 2024-04-29] 2024-04-29 hour 5: 198330 events in 0 files, snapshot none (task 8555 ms: download 5992 ms overlapping gunzip 1363 ms, parse 5697 ms, sort 0 ms, write 0 ms, index 578 ms: 5 candidates, 67821 repo-hours, 770 releases; waiting 490 ms; commit 0 ms)
2026-11-08T05:51:25Z [load_day 2024-04-29] 2024-04-29 hour 6: 228189 events in 0 files, snapshot none (task 10100 ms: download 6493 ms overlapping gunzip 1609 ms, parse 6745 ms, sort 0 ms, write 0 ms, index 803 ms: 9 candidates, 89199 repo-hours, 1085 releases; waiting 513 ms; commit 0 ms)
2026-11-08T05:51:26Z [load_day 2024-04-29] 2024-04-29 hour 7: 234227 events in 0 files, snapshot none (task 9796 ms: download 7167 ms overlapping gunzip 1524 ms, parse 6674 ms, sort 0 ms, write 0 ms, index 686 ms: 7 candidates, 84927 repo-hours, 920 releases; waiting 575 ms; commit 0 ms)
2026-11-08T05:51:36Z [load_day 2024-04-29] 2024-04-29 hour 8: 256002 events in 0 files, snapshot none (task 10500 ms: download 7890 ms overlapping gunzip 1705 ms, parse 7258 ms, sort 0 ms, write 0 ms, index 690 ms: 11 candidates, 92720 repo-hours, 1093 releases; waiting 512 ms; commit 0 ms)
2026-11-08T05:51:37Z [load_day 2024-04-29] 2024-04-29 hour 9: 259242 events in 0 files, snapshot none (task 9782 ms: download 7322 ms overlapping gunzip 1557 ms, parse 6810 ms, sort 0 ms, write 0 ms, index 694 ms: 10 candidates, 94835 repo-hours, 1357 releases; waiting 507 ms; commit 0 ms)
2026-11-08T05:51:45Z [load_day 2024-04-29] 2024-04-29 hour 10: 250094 events in 0 files, snapshot none (task 8792 ms: download 6175 ms overlapping gunzip 1410 ms, parse 5895 ms, sort 0 ms, write 0 ms, index 684 ms: 13 candidates, 88006 repo-hours, 1121 releases; waiting 527 ms; commit 0 ms)
2026-11-08T05:51:46Z [load_day 2024-04-29] 2024-04-29 hour 11: 246075 events in 0 files, snapshot none (task 8798 ms: download 6209 ms overlapping gunzip 1402 ms, parse 5870 ms, sort 0 ms, write 0 ms, index 616 ms: 12 candidates, 87339 repo-hours, 1863 releases; waiting 582 ms; commit 0 ms)
2026-11-08T05:51:58Z [load_day 2024-04-29] 2024-04-29 hour 12: 295963 events in 0 files, snapshot none (task 11926 ms: download 8965 ms overlapping gunzip 1781 ms, parse 8434 ms, sort 0 ms, write 0 ms, index 877 ms: 19 candidates, 125570 repo-hours, 1424 releases; waiting 506 ms; commit 0 ms)
2026-11-08T05:51:58Z [load_day 2024-04-29] 2024-04-29 hour 13: 282700 events in 0 files, snapshot none (task 11299 ms: download 8242 ms overlapping gunzip 1894 ms, parse 7483 ms, sort 0 ms, write 0 ms, index 1049 ms: 14 candidates, 112938 repo-hours, 1790 releases; waiting 505 ms; commit 0 ms)
2026-11-08T05:52:11Z [load_day 2024-04-29] 2024-04-29 hour 14: 273627 events in 0 files, snapshot none (task 12496 ms: download 9926 ms overlapping gunzip 2087 ms, parse 8874 ms, sort 0 ms, write 0 ms, index 749 ms: 14 candidates, 101205 repo-hours, 1436 releases; waiting 467 ms; commit 0 ms)
2026-11-08T05:52:11Z [load_day 2024-04-29] 2024-04-29 hour 15: 273848 events in 0 files, snapshot none (task 12545 ms: download 9720 ms overlapping gunzip 2131 ms, parse 8830 ms, sort 0 ms, write 0 ms, index 848 ms: 16 candidates, 106990 repo-hours, 1504 releases; waiting 502 ms; commit 0 ms)
2026-11-08T05:52:23Z [load_day 2024-04-29] 2024-04-29 hour 16: 260788 events in 0 files, snapshot none (task 11877 ms: download 9206 ms overlapping gunzip 1847 ms, parse 8395 ms, sort 0 ms, write 0 ms, index 815 ms: 17 candidates, 100747 repo-hours, 1241 releases; waiting 507 ms; commit 0 ms)
2026-11-08T05:52:23Z [load_day 2024-04-29] 2024-04-29 hour 17: 249208 events in 0 files, snapshot none (task 11664 ms: download 9138 ms overlapping gunzip 1967 ms, parse 8273 ms, sort 0 ms, write 0 ms, index 655 ms: 9 candidates, 92049 repo-hours, 1089 releases; waiting 506 ms; commit 0 ms)
2026-11-08T05:52:36Z [load_day 2024-04-29] 2024-04-29 hour 18: 258570 events in 0 files, snapshot none (task 12453 ms: download 9256 ms overlapping gunzip 1977 ms, parse 8532 ms, sort 0 ms, write 0 ms, index 1157 ms: 12 candidates, 102844 repo-hours, 1069 releases; waiting 508 ms; commit 0 ms)
2026-11-08T05:52:36Z [load_day 2024-04-29] 2024-04-29 hour 19: 241179 events in 0 files, snapshot none (task 12594 ms: download 9421 ms overlapping gunzip 1942 ms, parse 8822 ms, sort 0 ms, write 0 ms, index 1256 ms: 17 candidates, 85632 repo-hours, 1681 releases; waiting 294 ms; commit 0 ms)
2026-11-08T05:52:47Z [load_day 2024-04-29] 2024-04-29 hour 20: 232761 events in 0 files, snapshot none (task 10672 ms: download 7808 ms overlapping gunzip 1717 ms, parse 7278 ms, sort 0 ms, write 0 ms, index 775 ms: 14 candidates, 85941 repo-hours, 928 releases; waiting 558 ms; commit 0 ms)
2026-11-08T05:52:47Z [load_day 2024-04-29] 2024-04-29 hour 21: 222239 events in 0 files, snapshot none (task 10381 ms: download 7514 ms overlapping gunzip 1616 ms, parse 7124 ms, sort 0 ms, write 0 ms, index 777 ms: 12 candidates, 76355 repo-hours, 1142 releases; waiting 530 ms; commit 0 ms)
2026-11-08T05:52:56Z [load_day 2024-04-29] 2024-04-29 hour 22: 217874 events in 0 files, snapshot none (task 8455 ms: download 6098 ms overlapping gunzip 1405 ms, parse 5786 ms, sort 0 ms, write 0 ms, index 512 ms: 12 candidates, 64364 repo-hours, 1629 releases; waiting 484 ms; commit 0 ms)
2026-11-08T05:52:56Z [load_day 2024-04-29] 2024-04-29 hour 23: 192797 events in 0 files, snapshot none (task 7847 ms: download 5385 ms overlapping gunzip 1312 ms, parse 5332 ms, sort 0 ms, write 0 ms, index 427 ms: 16 candidates, 61371 repo-hours, 733 releases; waiting 450 ms; commit 0 ms)
2026-11-08T05:53:06Z [load_day 2024-04-29] 2024-04-29: repo_hour merged from 24 files to 1 (2103456 rows, 9370 ms)
2026-11-08T05:53:08Z [load_day 2024-04-29] 2024-04-29: index committed in 12011 ms (24 + 1 + 24 files)
2026-11-08T05:53:08Z [load_day 2024-04-29] 2024-04-29: 5617560 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:53:08Z [load_day 2024-04-29] attempt 1 succeeded