orcaLog in

Runs · run 1333

load_day 2023-07-26, attempt 1 succeeded

Host
3c2b29713ce8:163945
Started
2026-11-07T23:18:53Z
Ended
2026-11-07T23:22:53Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1333/load_day/2023-07-26/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:18:53Z [load_day 2023-07-26] attempt 1 started
2026-11-07T23:18:55Z [load_day 2023-07-26] 2023-07-26: 2 hours in flight, about 1200 MB
2026-11-07T23:19:12Z [load_day 2023-07-26] 2023-07-26 hour 0: 147018 events in 3 files, snapshot 3904938800301665741 (task 13730 ms: download 6285 ms overlapping gunzip 784 ms, parse 3459 ms, sort 140 ms, write 7837 ms, index 690 ms: 3 candidates, 73863 repo-hours, 881 releases; waiting 480 ms; commit 2066 ms)
2026-11-07T23:19:15Z [load_day 2023-07-26] 2023-07-26 hour 1: 155103 events in 4 files, snapshot 8807448178069055376 (task 13285 ms: download 5696 ms overlapping gunzip 704 ms, parse 3392 ms, sort 83 ms, write 7692 ms, index 608 ms: 1 candidates, 85761 repo-hours, 873 releases; waiting 480 ms; commit 2638 ms)
2026-11-07T23:19:26Z [load_day 2023-07-26] 2023-07-26 hour 2: 138924 events in 3 files, snapshot 3002851786067668067 (task 12418 ms: download 5458 ms overlapping gunzip 664 ms, parse 2825 ms, sort 109 ms, write 7479 ms, index 446 ms: 8 candidates, 67010 repo-hours, 746 releases; waiting 501 ms; commit 2176 ms)
2026-11-07T23:19:31Z [load_day 2023-07-26] 2023-07-26 hour 3: 133966 events in 3 files, snapshot 6675219267304507660 (task 11446 ms: download 4939 ms overlapping gunzip 759 ms, parse 3120 ms, sort 77 ms, write 6182 ms, index 552 ms: 6 candidates, 58578 repo-hours, 843 releases; waiting 398 ms; commit 5030 ms)
2026-11-07T23:19:39Z [load_day 2023-07-26] 2023-07-26 hour 4: 128243 events in 3 files, snapshot 5950314315511549248 (task 12159 ms: download 5152 ms overlapping gunzip 761 ms, parse 3247 ms, sort 80 ms, write 6805 ms, index 418 ms: 9 candidates, 54376 repo-hours, 631 releases; waiting 509 ms; commit 2301 ms)
2026-11-07T23:19:43Z [load_day 2023-07-26] 2023-07-26 hour 5: 145759 events in 3 files, snapshot 3117022222835912747 (task 13184 ms: download 5942 ms overlapping gunzip 799 ms, parse 3517 ms, sort 80 ms, write 7431 ms, index 568 ms: 3 candidates, 63121 repo-hours, 986 releases; waiting 514 ms; commit 2438 ms)
2026-11-07T23:19:56Z [load_day 2023-07-26] 2023-07-26 hour 6: 168992 events in 4 files, snapshot 2148013032355012898 (task 15810 ms: download 6085 ms overlapping gunzip 870 ms, parse 3950 ms, sort 115 ms, write 9318 ms, index 726 ms: 4 candidates, 77846 repo-hours, 1030 releases; waiting 510 ms; commit 2479 ms)
2026-11-07T23:20:01Z [load_day 2023-07-26] 2023-07-26 hour 7: 172843 events in 4 files, snapshot 2376681985077142191 (task 17052 ms: download 10064 ms overlapping gunzip 861 ms, parse 3946 ms, sort 105 ms, write 10802 ms, index 565 ms: 3 candidates, 76584 repo-hours, 967 releases; waiting 491 ms; commit 3063 ms)
2026-11-07T23:20:15Z [load_day 2023-07-26] 2023-07-26 hour 8: 184678 events in 4 files, snapshot 426834021583687144 (task 16792 ms: download 9910 ms overlapping gunzip 993 ms, parse 4516 ms, sort 110 ms, write 9738 ms, index 520 ms: 4 candidates, 82789 repo-hours, 1086 releases; waiting 504 ms; commit 2838 ms)
2026-11-07T23:20:18Z [load_day 2023-07-26] 2023-07-26 hour 9: 194064 events in 4 files, snapshot 4175551001568674691 (task 16322 ms: download 9344 ms overlapping gunzip 966 ms, parse 4316 ms, sort 113 ms, write 9566 ms, index 622 ms: 6 candidates, 83882 repo-hours, 1122 releases; waiting 518 ms; commit 2180 ms)
2026-11-07T23:20:38Z [load_day 2023-07-26] 2023-07-26 hour 10: 182847 events in 4 files, snapshot 424243599246666752 (task 19472 ms: download 11739 ms overlapping gunzip 1257 ms, parse 5795 ms, sort 112 ms, write 10849 ms, index 629 ms: 2 candidates, 80253 repo-hours, 934 releases; waiting 499 ms; commit 4328 ms)
2026-11-07T23:20:40Z [load_day 2023-07-26] 2023-07-26 hour 11: 182608 events in 4 files, snapshot 2869540258568444600 (task 19129 ms: download 11509 ms overlapping gunzip 1004 ms, parse 4345 ms, sort 124 ms, write 12113 ms, index 738 ms: 3 candidates, 76541 repo-hours, 965 releases; waiting 503 ms; commit 2826 ms)
2026-11-07T23:21:01Z [load_day 2023-07-26] 2023-07-26 hour 12: 234238 events in 5 files, snapshot 2640713120469971389 (task 23845 ms: download 15627 ms overlapping gunzip 1309 ms, parse 5811 ms, sort 187 ms, write 14781 ms, index 968 ms: 9 candidates, 113894 repo-hours, 1097 releases; waiting 474 ms; commit 2705 ms)
2026-11-07T23:21:05Z [load_day 2023-07-26] 2023-07-26 hour 13: 209425 events in 5 files, snapshot 1831426598719512140 (task 23806 ms: download 15603 ms overlapping gunzip 1203 ms, parse 5373 ms, sort 216 ms, write 15123 ms, index 1337 ms: 8 candidates, 103818 repo-hours, 1088 releases; waiting 220 ms; commit 2291 ms)
2026-11-07T23:21:25Z [load_day 2023-07-26] 2023-07-26 hour 14: 188893 events in 4 files, snapshot 1451571563451981155 (task 21355 ms: download 12932 ms overlapping gunzip 1352 ms, parse 6120 ms, sort 173 ms, write 11912 ms, index 717 ms: 7 candidates, 88327 repo-hours, 1072 releases; waiting 781 ms; commit 4380 ms)
2026-11-07T23:21:27Z [load_day 2023-07-26] 2023-07-26 hour 15: 165138 events in 4 files, snapshot 2170516456811061829 (task 19265 ms: download 11774 ms overlapping gunzip 1095 ms, parse 5218 ms, sort 199 ms, write 11010 ms, index 754 ms: 3 candidates, 80181 repo-hours, 1036 releases; waiting 656 ms; commit 2138 ms)
2026-11-07T23:21:45Z [load_day 2023-07-26] 2023-07-26 hour 16: 173885 events in 4 files, snapshot 4940729036925579389 (task 19880 ms: download 11695 ms overlapping gunzip 1263 ms, parse 5378 ms, sort 196 ms, write 11541 ms, index 729 ms: 8 candidates, 81155 repo-hours, 881 releases; waiting 497 ms; commit 3852 ms)
2026-11-07T23:21:50Z [load_day 2023-07-26] 2023-07-26 hour 17: 182928 events in 4 files, snapshot 8743716621842656292 (task 21469 ms: download 11932 ms overlapping gunzip 1063 ms, parse 4710 ms, sort 195 ms, write 13923 ms, index 847 ms: 6 candidates, 79782 repo-hours, 927 releases; waiting 403 ms; commit 2619 ms)
2026-11-07T23:22:08Z [load_day 2023-07-26] 2023-07-26 hour 18: 185666 events in 4 files, snapshot 8721619751133016777 (task 21652 ms: download 12554 ms overlapping gunzip 1191 ms, parse 5477 ms, sort 272 ms, write 13410 ms, index 556 ms: 8 candidates, 82970 repo-hours, 1078 releases; waiting 479 ms; commit 3665 ms)
2026-11-07T23:22:10Z [load_day 2023-07-26] 2023-07-26 hour 19: 170989 events in 4 files, snapshot 1774223264126258836 (task 19533 ms: download 12095 ms overlapping gunzip 1148 ms, parse 5446 ms, sort 156 ms, write 11326 ms, index 625 ms: 4 candidates, 71239 repo-hours, 935 releases; waiting 507 ms; commit 2517 ms)
2026-11-07T23:22:26Z [load_day 2023-07-26] 2023-07-26 hour 20: 169475 events in 4 files, snapshot 4094094450940437367 (task 18456 ms: download 10795 ms overlapping gunzip 1205 ms, parse 5376 ms, sort 143 ms, write 10266 ms, index 639 ms: 5 candidates, 70770 repo-hours, 905 releases; waiting 518 ms; commit 2361 ms)
2026-11-07T23:22:29Z [load_day 2023-07-26] 2023-07-26 hour 21: 153318 events in 4 files, snapshot 771591859891645117 (task 17348 ms: download 7983 ms overlapping gunzip 1064 ms, parse 4815 ms, sort 108 ms, write 10138 ms, index 669 ms: 4 candidates, 62038 repo-hours, 925 releases; waiting 268 ms; commit 2696 ms)
2026-11-07T23:22:41Z [load_day 2023-07-26] 2023-07-26 hour 22: 135841 events in 3 files, snapshot 4127722276705076533 (task 14306 ms: download 6116 ms overlapping gunzip 872 ms, parse 3714 ms, sort 90 ms, write 8438 ms, index 484 ms: 5 candidates, 54653 repo-hours, 864 releases; waiting 457 ms; commit 2170 ms)
2026-11-07T23:22:43Z [load_day 2023-07-26] 2023-07-26 hour 23: 125104 events in 3 files, snapshot 1967321275845473797 (task 12656 ms: download 5850 ms overlapping gunzip 654 ms, parse 2846 ms, sort 121 ms, write 7909 ms, index 335 ms: 1 candidates, 51037 repo-hours, 642 releases; waiting 473 ms; commit 2007 ms)
2026-11-07T23:22:51Z [load_day 2023-07-26] 2023-07-26: repo_hour merged from 24 files to 1 (1820468 rows, 8131 ms)
2026-11-07T23:22:53Z [load_day 2023-07-26] 2023-07-26: index committed in 10086 ms (24 + 1 + 24 files)
2026-11-07T23:22:53Z [load_day 2023-07-26] 2023-07-26: 4029945 events in 24 hours
2026-11-07T23:22:53Z [load_day 2023-07-26] attempt 1 succeeded