orcaLog in

Runs · run 1493

load_day 2023-09-12, attempt 1 succeeded

Host
3c2b29713ce8:320785
Started
2026-11-08T00:44:52Z
Ended
2026-11-08T00:49:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1493/load_day/2023-09-12/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T00:44:52Z [load_day 2023-09-12] attempt 1 started
2026-11-08T00:44:53Z [load_day 2023-09-12] 2023-09-12: 2 hours in flight, about 1200 MB
2026-11-08T00:45:15Z [load_day 2023-09-12] 2023-09-12 hour 0: 175864 events in 4 files, snapshot 7044481786213107990 (task 17568 ms: download 7932 ms overlapping gunzip 1093 ms, parse 5137 ms, sort 136 ms, write 9196 ms, index 729 ms: 14 candidates, 94896 repo-hours, 972 releases; waiting 805 ms; commit 2580 ms)
2026-11-08T00:45:18Z [load_day 2023-09-12] 2023-09-12 hour 1: 174960 events in 4 files, snapshot 4457080809316506351 (task 15650 ms: download 5976 ms overlapping gunzip 838 ms, parse 3958 ms, sort 170 ms, write 9119 ms, index 714 ms: 15 candidates, 94125 repo-hours, 773 releases; waiting 506 ms; commit 3084 ms)
2026-11-08T00:45:35Z [load_day 2023-09-12] 2023-09-12 hour 2: 144011 events in 3 files, snapshot 5170236095168867718 (task 13293 ms: download 6081 ms overlapping gunzip 703 ms, parse 3190 ms, sort 156 ms, write 7861 ms, index 520 ms: 13 candidates, 63123 repo-hours, 995 releases; waiting 534 ms; commit 8085 ms)
2026-11-08T00:45:39Z [load_day 2023-09-12] 2023-09-12 hour 3: 138369 events in 3 files, snapshot 1140962875522347797 (task 12489 ms: download 5192 ms overlapping gunzip 863 ms, parse 3746 ms, sort 119 ms, write 6537 ms, index 458 ms: 17 candidates, 59443 repo-hours, 1041 releases; waiting 476 ms; commit 3976 ms)
2026-11-08T00:45:45Z [load_day 2023-09-12] 2023-09-12 hour 4: 130751 events in 3 files, snapshot 2091580735881273099 (task 14311 ms: download 5652 ms overlapping gunzip 803 ms, parse 3371 ms, sort 90 ms, write 7299 ms, index 435 ms: 12 candidates, 55573 repo-hours, 1036 releases; waiting 1013 ms; commit 2442 ms)
2026-11-08T00:45:55Z [load_day 2023-09-12] 2023-09-12 hour 5: 146106 events in 3 files, snapshot 5653288053906139041 (task 15244 ms: download 6340 ms overlapping gunzip 850 ms, parse 3638 ms, sort 106 ms, write 8427 ms, index 635 ms: 7 candidates, 63001 repo-hours, 992 releases; waiting 679 ms; commit 4214 ms)
2026-11-08T00:46:04Z [load_day 2023-09-12] 2023-09-12 hour 6: 177253 events in 4 files, snapshot 9114532099739207502 (task 18023 ms: download 9643 ms overlapping gunzip 976 ms, parse 4339 ms, sort 139 ms, write 10838 ms, index 669 ms: 15 candidates, 81247 repo-hours, 1104 releases; waiting 517 ms; commit 2450 ms)
2026-11-08T00:46:15Z [load_day 2023-09-12] 2023-09-12 hour 7: 184004 events in 4 files, snapshot 2921656917479052501 (task 20386 ms: download 10924 ms overlapping gunzip 1207 ms, parse 5436 ms, sort 202 ms, write 12123 ms, index 693 ms: 13 candidates, 81785 repo-hours, 1062 releases; waiting 516 ms; commit 2511 ms)
2026-11-08T00:46:28Z [load_day 2023-09-12] 2023-09-12 hour 8: 191450 events in 4 files, snapshot 7903954997278063993 (task 22532 ms: download 12323 ms overlapping gunzip 1420 ms, parse 6084 ms, sort 198 ms, write 13136 ms, index 928 ms: 14 candidates, 85833 repo-hours, 1035 releases; waiting 465 ms; commit 3145 ms)
2026-11-08T00:46:40Z [load_day 2023-09-12] 2023-09-12 hour 9: 201393 events in 5 files, snapshot 2480244641781786175 (task 21750 ms: download 12124 ms overlapping gunzip 1226 ms, parse 5584 ms, sort 148 ms, write 13346 ms, index 681 ms: 10 candidates, 88316 repo-hours, 1153 releases; waiting 503 ms; commit 4182 ms)
2026-11-08T00:46:51Z [load_day 2023-09-12] 2023-09-12 hour 10: 192594 events in 4 files, snapshot 3164132121632956481 (task 21626 ms: download 12205 ms overlapping gunzip 1409 ms, parse 6317 ms, sort 205 ms, write 12352 ms, index 616 ms: 14 candidates, 83480 repo-hours, 1060 releases; waiting 483 ms; commit 2763 ms)
2026-11-08T00:47:01Z [load_day 2023-09-12] 2023-09-12 hour 11: 198228 events in 4 files, snapshot 1921798552342076773 (task 20084 ms: download 11820 ms overlapping gunzip 1193 ms, parse 5281 ms, sort 187 ms, write 12080 ms, index 573 ms: 11 candidates, 84391 repo-hours, 1201 releases; waiting 509 ms; commit 4173 ms)
2026-11-08T00:47:11Z [load_day 2023-09-12] 2023-09-12 hour 12: 247666 events in 5 files, snapshot 4652151192262116686 (task 20040 ms: download 12800 ms overlapping gunzip 1172 ms, parse 5335 ms, sort 157 ms, write 11858 ms, index 737 ms: 16 candidates, 116099 repo-hours, 1272 releases; waiting 500 ms; commit 2295 ms)
2026-11-08T00:47:21Z [load_day 2023-09-12] 2023-09-12 hour 13: 225961 events in 5 files, snapshot 8706509366970367093 (task 20888 ms: download 12221 ms overlapping gunzip 1233 ms, parse 5495 ms, sort 149 ms, write 12467 ms, index 771 ms: 15 candidates, 111588 repo-hours, 1290 releases; waiting 488 ms; commit 2803 ms)
2026-11-08T00:47:36Z [load_day 2023-09-12] 2023-09-12 hour 14: 219448 events in 5 files, snapshot 7511037775694085262 (task 23286 ms: download 16357 ms overlapping gunzip 1406 ms, parse 5987 ms, sort 137 ms, write 14137 ms, index 797 ms: 12 candidates, 96590 repo-hours, 1384 releases; waiting 507 ms; commit 2833 ms)
2026-11-08T00:47:43Z [load_day 2023-09-12] 2023-09-12 hour 15: 199035 events in 4 files, snapshot 6340650252923159631 (task 20543 ms: download 10708 ms overlapping gunzip 1100 ms, parse 4822 ms, sort 195 ms, write 12949 ms, index 673 ms: 14 candidates, 89395 repo-hours, 1174 releases; waiting 497 ms; commit 2391 ms)
2026-11-08T00:47:58Z [load_day 2023-09-12] 2023-09-12 hour 16: 192473 events in 4 files, snapshot 1650597833159638641 (task 20887 ms: download 11274 ms overlapping gunzip 1172 ms, parse 5031 ms, sort 142 ms, write 13002 ms, index 699 ms: 6 candidates, 86448 repo-hours, 1006 releases; waiting 500 ms; commit 2783 ms)
2026-11-08T00:48:04Z [load_day 2023-09-12] 2023-09-12 hour 17: 187799 events in 4 files, snapshot 6636117158435260382 (task 19544 ms: download 11262 ms overlapping gunzip 1248 ms, parse 5508 ms, sort 183 ms, write 11069 ms, index 743 ms: 10 candidates, 79839 repo-hours, 927 releases; waiting 510 ms; commit 3115 ms)
2026-11-08T00:48:21Z [load_day 2023-09-12] 2023-09-12 hour 18: 192106 events in 4 files, snapshot 3309813956303720211 (task 21194 ms: download 12180 ms overlapping gunzip 1056 ms, parse 4810 ms, sort 172 ms, write 13582 ms, index 679 ms: 6 candidates, 85827 repo-hours, 1189 releases; waiting 519 ms; commit 3493 ms)
2026-11-08T00:48:28Z [load_day 2023-09-12] 2023-09-12 hour 19: 183055 events in 4 files, snapshot 1456672951229883521 (task 20608 ms: download 12146 ms overlapping gunzip 1206 ms, parse 5560 ms, sort 132 ms, write 12244 ms, index 642 ms: 12 candidates, 74932 repo-hours, 1004 releases; waiting 536 ms; commit 4975 ms)
2026-11-08T00:48:42Z [load_day 2023-09-12] 2023-09-12 hour 20: 177996 events in 4 files, snapshot 8653008862979332997 (task 20290 ms: download 12472 ms overlapping gunzip 1414 ms, parse 6096 ms, sort 159 ms, write 11161 ms, index 573 ms: 3 candidates, 72922 repo-hours, 922 releases; waiting 539 ms; commit 2395 ms)
2026-11-08T00:48:46Z [load_day 2023-09-12] 2023-09-12 hour 21: 164415 events in 4 files, snapshot 1429733909061042019 (task 18125 ms: download 11138 ms overlapping gunzip 1120 ms, parse 4941 ms, sort 135 ms, write 10626 ms, index 534 ms: 10 candidates, 63280 repo-hours, 914 releases; waiting 201 ms; commit 3932 ms)
2026-11-08T00:48:58Z [load_day 2023-09-12] 2023-09-12 hour 22: 146809 events in 3 files, snapshot 2620956444593127960 (task 15894 ms: download 7109 ms overlapping gunzip 783 ms, parse 3663 ms, sort 178 ms, write 9993 ms, index 433 ms: 9 candidates, 56305 repo-hours, 803 releases; waiting 544 ms; commit 1928 ms)
2026-11-08T00:49:00Z [load_day 2023-09-12] 2023-09-12 hour 23: 138165 events in 3 files, snapshot 7279135964673461478 (task 12882 ms: download 5858 ms overlapping gunzip 780 ms, parse 3448 ms, sort 110 ms, write 7309 ms, index 401 ms: 6 candidates, 54165 repo-hours, 612 releases; waiting 560 ms; commit 1964 ms)
2026-11-08T00:49:08Z [load_day 2023-09-12] 2023-09-12: repo_hour merged from 24 files to 1 (1922603 rows, 8146 ms)
2026-11-08T00:49:10Z [load_day 2023-09-12] 2023-09-12: index committed in 10371 ms (24 + 1 + 24 files)
2026-11-08T00:49:10Z [load_day 2023-09-12] 2023-09-12: 4329911 events in 24 hours
2026-11-08T00:49:10Z [load_day 2023-09-12] attempt 1 succeeded