orcaLog in

Runs · run 1639

load_day 2023-10-18, attempt 1 succeeded

Host
3c2b29713ce8:450830
Started
2026-11-08T01:53:48Z
Ended
2026-11-08T01:58:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1639/load_day/2023-10-18/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T01:53:48Z [load_day 2023-10-18] attempt 1 started
2026-11-08T01:53:49Z [load_day 2023-10-18] 2023-10-18: 2 hours in flight, about 1200 MB
2026-11-08T01:54:13Z [load_day 2023-10-18] 2023-10-18 hour 0: 172499 events in 4 files, snapshot 891028802624658985 (task 18290 ms: download 11193 ms overlapping gunzip 1144 ms, parse 5146 ms, sort 167 ms, write 10445 ms, index 687 ms: 9 candidates, 88843 repo-hours, 1024 releases; waiting 487 ms; commit 3522 ms)
2026-11-08T01:54:16Z [load_day 2023-10-18] 2023-10-18 hour 1: 186291 events in 4 files, snapshot 891274497149426972 (task 19204 ms: download 11328 ms overlapping gunzip 1176 ms, parse 5231 ms, sort 180 ms, write 10951 ms, index 805 ms: 5 candidates, 98032 repo-hours, 837 releases; waiting 518 ms; commit 2930 ms)
2026-11-08T01:54:32Z [load_day 2023-10-18] 2023-10-18 hour 2: 157715 events in 4 files, snapshot 572849727141299939 (task 16270 ms: download 7567 ms overlapping gunzip 1147 ms, parse 4691 ms, sort 179 ms, write 8966 ms, index 477 ms: 6 candidates, 66708 repo-hours, 856 releases; waiting 486 ms; commit 4859 ms)
2026-11-08T01:54:37Z [load_day 2023-10-18] 2023-10-18 hour 3: 152253 events in 4 files, snapshot 6495475913798826840 (task 16099 ms: download 6725 ms overlapping gunzip 849 ms, parse 3733 ms, sort 193 ms, write 9823 ms, index 932 ms: 7 candidates, 64404 repo-hours, 848 releases; waiting 216 ms; commit 5406 ms)
2026-11-08T01:54:46Z [load_day 2023-10-18] 2023-10-18 hour 4: 142298 events in 3 files, snapshot 1923096316494961806 (task 15992 ms: download 6381 ms overlapping gunzip 1021 ms, parse 4487 ms, sort 191 ms, write 8879 ms, index 629 ms: 2 candidates, 60367 repo-hours, 731 releases; waiting 516 ms; commit 2355 ms)
2026-11-08T01:54:53Z [load_day 2023-10-18] 2023-10-18 hour 5: 151702 events in 4 files, snapshot 5651381641683760189 (task 16978 ms: download 7438 ms overlapping gunzip 951 ms, parse 4145 ms, sort 191 ms, write 10543 ms, index 466 ms: 2 candidates, 66585 repo-hours, 714 releases; waiting 478 ms; commit 3005 ms)
2026-11-08T01:55:07Z [load_day 2023-10-18] 2023-10-18 hour 6: 180733 events in 4 files, snapshot 5758578709851152441 (task 18908 ms: download 10803 ms overlapping gunzip 1107 ms, parse 4815 ms, sort 130 ms, write 11488 ms, index 584 ms: 7 candidates, 83776 repo-hours, 944 releases; waiting 490 ms; commit 3097 ms)
2026-11-08T01:55:15Z [load_day 2023-10-18] 2023-10-18 hour 7: 185078 events in 4 files, snapshot 2176954148538045365 (task 22079 ms: download 12829 ms overlapping gunzip 1263 ms, parse 5564 ms, sort 211 ms, write 13467 ms, index 718 ms: 5 candidates, 82619 repo-hours, 975 releases; waiting 533 ms; commit 2305 ms)
2026-11-08T01:55:32Z [load_day 2023-10-18] 2023-10-18 hour 8: 199297 events in 4 files, snapshot 1919822119109213272 (task 23476 ms: download 12997 ms overlapping gunzip 1529 ms, parse 6882 ms, sort 183 ms, write 12904 ms, index 1186 ms: 10 candidates, 90648 repo-hours, 1163 releases; waiting 528 ms; commit 3102 ms)
2026-11-08T01:55:50Z [load_day 2023-10-18] 2023-10-18 hour 9: 201128 events in 5 files, snapshot 252930302412297074 (task 23861 ms: download 13888 ms overlapping gunzip 1250 ms, parse 5642 ms, sort 206 ms, write 14858 ms, index 1139 ms: 4 candidates, 90561 repo-hours, 1204 releases; waiting 518 ms; commit 11857 ms)
2026-11-08T01:55:56Z [load_day 2023-10-18] 2023-10-18 hour 10: 198812 events in 4 files, snapshot 7797260189836523697 (task 23838 ms: download 13810 ms overlapping gunzip 1399 ms, parse 6172 ms, sort 180 ms, write 14693 ms, index 668 ms: 6 candidates, 88245 repo-hours, 1155 releases; waiting 468 ms; commit 2339 ms)
2026-11-08T01:56:04Z [load_day 2023-10-18] 2023-10-18 hour 11: 197804 events in 4 files, snapshot 1290510619247136409 (task 22204 ms: download 13706 ms overlapping gunzip 1384 ms, parse 5871 ms, sort 135 ms, write 13305 ms, index 696 ms: 7 candidates, 85665 repo-hours, 1110 releases; waiting 504 ms; commit 3512 ms)
2026-11-08T01:56:17Z [load_day 2023-10-18] 2023-10-18 hour 12: 243500 events in 5 files, snapshot 2673539409477419924 (task 19804 ms: download 12673 ms overlapping gunzip 1081 ms, parse 5112 ms, sort 155 ms, write 11824 ms, index 800 ms: 8 candidates, 117188 repo-hours, 1143 releases; waiting 550 ms; commit 2105 ms)
2026-11-08T01:56:28Z [load_day 2023-10-18] 2023-10-18 hour 13: 221555 events in 5 files, snapshot 1114833797161171042 (task 22863 ms: download 13355 ms overlapping gunzip 1218 ms, parse 5318 ms, sort 144 ms, write 14368 ms, index 989 ms: 13 candidates, 110763 repo-hours, 1291 releases; waiting 502 ms; commit 2972 ms)
2026-11-08T01:56:45Z [load_day 2023-10-18] 2023-10-18 hour 14: 215337 events in 5 files, snapshot 39520458047827453 (task 26507 ms: download 18594 ms overlapping gunzip 1656 ms, parse 7339 ms, sort 249 ms, write 15558 ms, index 896 ms: 12 candidates, 99781 repo-hours, 1154 releases; waiting 528 ms; commit 2706 ms)
2026-11-08T01:56:51Z [load_day 2023-10-18] 2023-10-18 hour 15: 184218 events in 4 files, snapshot 330275360679339240 (task 21928 ms: download 12189 ms overlapping gunzip 1191 ms, parse 5374 ms, sort 208 ms, write 13507 ms, index 874 ms: 5 candidates, 91167 repo-hours, 1170 releases; waiting 502 ms; commit 2730 ms)
2026-11-08T01:57:08Z [load_day 2023-10-18] 2023-10-18 hour 16: 183175 events in 4 files, snapshot 6826995449682165558 (task 21496 ms: download 11506 ms overlapping gunzip 1236 ms, parse 5297 ms, sort 185 ms, write 13424 ms, index 822 ms: 6 candidates, 87649 repo-hours, 970 releases; waiting 218 ms; commit 2911 ms)
2026-11-08T01:57:14Z [load_day 2023-10-18] 2023-10-18 hour 17: 185456 events in 4 files, snapshot 7671105571873662162 (task 22059 ms: download 12866 ms overlapping gunzip 1272 ms, parse 5885 ms, sort 164 ms, write 13101 ms, index 812 ms: 7 candidates, 84688 repo-hours, 1029 releases; waiting 508 ms; commit 2999 ms)
2026-11-08T01:57:41Z [load_day 2023-10-18] 2023-10-18 hour 18: 198924 events in 4 files, snapshot 2164841624881689861 (task 26929 ms: download 18093 ms overlapping gunzip 1235 ms, parse 5694 ms, sort 157 ms, write 18403 ms, index 614 ms: 10 candidates, 92589 repo-hours, 1176 releases; waiting 548 ms; commit 8370 ms)
2026-11-08T01:57:44Z [load_day 2023-10-18] 2023-10-18 hour 19: 188789 events in 4 files, snapshot 4039192685713586740 (task 20155 ms: download 12081 ms overlapping gunzip 1313 ms, parse 5574 ms, sort 142 ms, write 11679 ms, index 553 ms: 6 candidates, 79119 repo-hours, 1014 releases; waiting 538 ms; commit 2955 ms)
2026-11-08T01:57:54Z [load_day 2023-10-18] 2023-10-18 hour 20: 190009 events in 4 files, snapshot 7423364414388505614 (task 17660 ms: download 9917 ms overlapping gunzip 1056 ms, parse 4847 ms, sort 114 ms, write 10258 ms, index 512 ms: 9 candidates, 78997 repo-hours, 1000 releases; waiting 577 ms; commit 2713 ms)
2026-11-08T01:58:03Z [load_day 2023-10-18] 2023-10-18 hour 21: 174909 events in 4 files, snapshot 7841807459008564439 (task 18101 ms: download 10460 ms overlapping gunzip 1082 ms, parse 4683 ms, sort 120 ms, write 10560 ms, index 870 ms: 11 candidates, 74149 repo-hours, 914 releases; waiting 517 ms; commit 2825 ms)
2026-11-08T01:58:12Z [load_day 2023-10-18] 2023-10-18 hour 22: 154085 events in 4 files, snapshot 5080415021829844157 (task 16456 ms: download 6794 ms overlapping gunzip 980 ms, parse 4452 ms, sort 139 ms, write 9616 ms, index 420 ms: 7 candidates, 61466 repo-hours, 831 releases; waiting 578 ms; commit 2859 ms)
2026-11-08T01:58:19Z [load_day 2023-10-18] 2023-10-18 hour 23: 145739 events in 3 files, snapshot 7785257977671722333 (task 15183 ms: download 7471 ms overlapping gunzip 892 ms, parse 3946 ms, sort 97 ms, write 9119 ms, index 366 ms: 7 candidates, 57739 repo-hours, 740 releases; waiting 480 ms; commit 2184 ms)
2026-11-08T01:58:28Z [load_day 2023-10-18] 2023-10-18: repo_hour merged from 24 files to 1 (2001748 rows, 9090 ms)
2026-11-08T01:58:30Z [load_day 2023-10-18] 2023-10-18: index committed in 11049 ms (24 + 1 + 24 files)
2026-11-08T01:58:30Z [load_day 2023-10-18] 2023-10-18: 4411306 events in 24 hours
2026-11-08T01:58:30Z [load_day 2023-10-18] attempt 1 succeeded