orcaLog in

Runs · run 1396

load_day 2023-08-16, attempt 1 succeeded

Host
3c2b29713ce8:230793
Started
2026-11-07T23:56:08Z
Ended
2026-11-08T00:00:07Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1396/load_day/2023-08-16/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:56:08Z [load_day 2023-08-16] attempt 1 started
2026-11-07T23:56:10Z [load_day 2023-08-16] 2023-08-16: 2 hours in flight, about 1200 MB
2026-11-07T23:56:30Z [load_day 2023-08-16] 2023-08-16 hour 0: 166193 events in 4 files, snapshot 5911161142879482051 (task 15995 ms: download 7268 ms overlapping gunzip 1002 ms, parse 4734 ms, sort 156 ms, write 8632 ms, index 676 ms: 7 candidates, 90217 repo-hours, 966 releases; waiting 492 ms; commit 2104 ms)
2026-11-07T23:56:32Z [load_day 2023-08-16] 2023-08-16 hour 1: 160365 events in 4 files, snapshot 4416078927856205012 (task 15599 ms: download 6013 ms overlapping gunzip 809 ms, parse 3723 ms, sort 95 ms, write 9632 ms, index 734 ms: 3 candidates, 88733 repo-hours, 738 releases; waiting 355 ms; commit 2881 ms)
2026-11-07T23:56:45Z [load_day 2023-08-16] 2023-08-16 hour 2: 138828 events in 3 files, snapshot 6201597695365262860 (task 13373 ms: download 5347 ms overlapping gunzip 773 ms, parse 3077 ms, sort 96 ms, write 7665 ms, index 898 ms: 4 candidates, 60628 repo-hours, 696 releases; waiting 560 ms; commit 2776 ms)
2026-11-07T23:56:48Z [load_day 2023-08-16] 2023-08-16 hour 3: 133220 events in 3 files, snapshot 1830853134087256294 (task 13131 ms: download 5824 ms overlapping gunzip 737 ms, parse 3230 ms, sort 109 ms, write 7708 ms, index 502 ms: 7 candidates, 57448 repo-hours, 853 releases; waiting 506 ms; commit 2833 ms)
2026-11-07T23:56:59Z [load_day 2023-08-16] 2023-08-16 hour 4: 130588 events in 3 files, snapshot 4348268112330022752 (task 13418 ms: download 5572 ms overlapping gunzip 907 ms, parse 3811 ms, sort 88 ms, write 7298 ms, index 474 ms: 1 candidates, 54429 repo-hours, 620 releases; waiting 510 ms; commit 2512 ms)
2026-11-07T23:57:04Z [load_day 2023-08-16] 2023-08-16 hour 5: 142893 events in 3 files, snapshot 4852692543991219630 (task 15416 ms: download 6558 ms overlapping gunzip 904 ms, parse 3875 ms, sort 111 ms, write 8907 ms, index 774 ms: 10 candidates, 59937 repo-hours, 766 releases; waiting 506 ms; commit 2932 ms)
2026-11-07T23:57:18Z [load_day 2023-08-16] 2023-08-16 hour 6: 176035 events in 4 files, snapshot 2475249081560369349 (task 17342 ms: download 9914 ms overlapping gunzip 958 ms, parse 4217 ms, sort 119 ms, write 10665 ms, index 913 ms: 7 candidates, 84866 repo-hours, 852 releases; waiting 197 ms; commit 2321 ms)
2026-11-07T23:57:24Z [load_day 2023-08-16] 2023-08-16 hour 7: 167978 events in 4 files, snapshot 1554132946173069256 (task 18525 ms: download 10582 ms overlapping gunzip 992 ms, parse 4461 ms, sort 152 ms, write 11049 ms, index 1055 ms: 4 candidates, 74235 repo-hours, 896 releases; waiting 484 ms; commit 2781 ms)
2026-11-07T23:57:41Z [load_day 2023-08-16] 2023-08-16 hour 8: 176462 events in 4 files, snapshot 4598534316093694950 (task 20075 ms: download 11541 ms overlapping gunzip 967 ms, parse 4293 ms, sort 180 ms, write 13227 ms, index 606 ms: 8 candidates, 80766 repo-hours, 1063 releases; waiting 516 ms; commit 4206 ms)
2026-11-07T23:57:45Z [load_day 2023-08-16] 2023-08-16 hour 9: 180467 events in 4 files, snapshot 4153820300144738395 (task 20448 ms: download 12215 ms overlapping gunzip 1254 ms, parse 5600 ms, sort 128 ms, write 12054 ms, index 635 ms: 8 candidates, 80126 repo-hours, 1158 releases; waiting 519 ms; commit 2511 ms)
2026-11-07T23:58:00Z [load_day 2023-08-16] 2023-08-16 hour 10: 178258 events in 4 files, snapshot 4943529498844495803 (task 19657 ms: download 11542 ms overlapping gunzip 1115 ms, parse 5117 ms, sort 190 ms, write 11427 ms, index 714 ms: 8 candidates, 80988 repo-hours, 960 releases; waiting 752 ms; commit 2799 ms)
2026-11-07T23:58:05Z [load_day 2023-08-16] 2023-08-16 hour 11: 174417 events in 4 files, snapshot 7337907352425666012 (task 18578 ms: download 10639 ms overlapping gunzip 1045 ms, parse 4798 ms, sort 151 ms, write 11018 ms, index 726 ms: 3 candidates, 75640 repo-hours, 940 releases; waiting 520 ms; commit 2629 ms)
2026-11-07T23:58:19Z [load_day 2023-08-16] 2023-08-16 hour 12: 224390 events in 5 files, snapshot 1488139596450425219 (task 18727 ms: download 10081 ms overlapping gunzip 1196 ms, parse 5301 ms, sort 154 ms, write 10599 ms, index 731 ms: 4 candidates, 108898 repo-hours, 1046 releases; waiting 453 ms; commit 2307 ms)
2026-11-07T23:58:22Z [load_day 2023-08-16] 2023-08-16 hour 13: 189461 events in 4 files, snapshot 8855557134366251642 (task 16736 ms: download 9337 ms overlapping gunzip 1013 ms, parse 4485 ms, sort 125 ms, write 9706 ms, index 617 ms: 8 candidates, 96020 repo-hours, 1165 releases; waiting 499 ms; commit 2019 ms)
2026-11-07T23:58:39Z [load_day 2023-08-16] 2023-08-16 hour 14: 191032 events in 4 files, snapshot 8748894133503473244 (task 19581 ms: download 10846 ms overlapping gunzip 1102 ms, parse 4906 ms, sort 131 ms, write 11950 ms, index 693 ms: 7 candidates, 87390 repo-hours, 1063 releases; waiting 515 ms; commit 1829 ms)
2026-11-07T23:58:44Z [load_day 2023-08-16] 2023-08-16 hour 15: 185819 events in 4 files, snapshot 4615543711367772337 (task 18155 ms: download 10348 ms overlapping gunzip 1159 ms, parse 5053 ms, sort 131 ms, write 10452 ms, index 532 ms: 4 candidates, 86741 repo-hours, 1172 releases; waiting 524 ms; commit 4850 ms)
2026-11-07T23:59:01Z [load_day 2023-08-16] 2023-08-16 hour 16: 177698 events in 4 files, snapshot 3831531455848974971 (task 19942 ms: download 11955 ms overlapping gunzip 1076 ms, parse 4817 ms, sort 134 ms, write 12402 ms, index 770 ms: 4 candidates, 78630 repo-hours, 885 releases; waiting 385 ms; commit 2296 ms)
2026-11-07T23:59:03Z [load_day 2023-08-16] 2023-08-16 hour 17: 181353 events in 4 files, snapshot 5033387893585866140 (task 18955 ms: download 11031 ms overlapping gunzip 1209 ms, parse 5504 ms, sort 150 ms, write 10601 ms, index 672 ms: 5 candidates, 77336 repo-hours, 923 releases; waiting 528 ms; commit 2388 ms)
2026-11-07T23:59:21Z [load_day 2023-08-16] 2023-08-16 hour 18: 182732 events in 4 files, snapshot 1112230175369819026 (task 18914 ms: download 9758 ms overlapping gunzip 1131 ms, parse 5004 ms, sort 129 ms, write 11179 ms, index 691 ms: 2 candidates, 81553 repo-hours, 1002 releases; waiting 465 ms; commit 2611 ms)
2026-11-07T23:59:24Z [load_day 2023-08-16] 2023-08-16 hour 19: 169741 events in 4 files, snapshot 7957714741335411698 (task 18472 ms: download 10448 ms overlapping gunzip 981 ms, parse 4550 ms, sort 113 ms, write 11506 ms, index 498 ms: 8 candidates, 68578 repo-hours, 922 releases; waiting 499 ms; commit 2643 ms)
2026-11-07T23:59:39Z [load_day 2023-08-16] 2023-08-16 hour 20: 171302 events in 4 files, snapshot 3865236891692288631 (task 17065 ms: download 9613 ms overlapping gunzip 910 ms, parse 4065 ms, sort 112 ms, write 10447 ms, index 639 ms: 6 candidates, 70443 repo-hours, 927 releases; waiting 513 ms; commit 2225 ms)
2026-11-07T23:59:42Z [load_day 2023-08-16] 2023-08-16 hour 21: 152711 events in 4 files, snapshot 1275438175562564657 (task 17121 ms: download 7409 ms overlapping gunzip 895 ms, parse 3976 ms, sort 123 ms, write 10304 ms, index 521 ms: 6 candidates, 60567 repo-hours, 920 releases; waiting 800 ms; commit 2351 ms)
2026-11-07T23:59:54Z [load_day 2023-08-16] 2023-08-16 hour 22: 139612 events in 3 files, snapshot 2530267235550304697 (task 13343 ms: download 5620 ms overlapping gunzip 693 ms, parse 3036 ms, sort 99 ms, write 8086 ms, index 535 ms: 4 candidates, 54475 repo-hours, 779 releases; waiting 521 ms; commit 2486 ms)
2026-11-07T23:59:56Z [load_day 2023-08-16] 2023-08-16 hour 23: 129848 events in 3 files, snapshot 2288622355595174396 (task 12274 ms: download 5363 ms overlapping gunzip 772 ms, parse 3176 ms, sort 120 ms, write 7063 ms, index 363 ms: 2 candidates, 51088 repo-hours, 780 releases; waiting 504 ms; commit 2190 ms)
2026-11-08T00:00:04Z [load_day 2023-08-16] 2023-08-16: repo_hour merged from 24 files to 1 (1809732 rows, 8386 ms)
2026-11-08T00:00:07Z [load_day 2023-08-16] 2023-08-16: index committed in 10733 ms (24 + 1 + 24 files)
2026-11-08T00:00:07Z [load_day 2023-08-16] 2023-08-16: 4021403 events in 24 hours
2026-11-08T00:00:07Z [load_day 2023-08-16] attempt 1 succeeded