orcaLog in

Runs · run 494

load_day 2026-06-06, attempt 1 succeeded

Host
4e84322b8c45:106973
Started
2026-11-07T06:00:50Z
Ended
2026-11-07T06:02:06Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/494/load_day/2026-06-06/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:00:51Z [load_day 2026-06-06] attempt 1 started
2026-11-07T06:00:59Z [load_day 2026-06-06] 2026-06-06 hour 0: 149135 events in 3 files, snapshot 5514254347784501699 (task 5197 ms: download 1600 ms overlapping gunzip 351 ms, parse 1225 ms, sort 196 ms, write 2196 ms, index 437 ms: 8 candidates, 66119 repo-hours, 700 releases; waiting 508 ms; commit 886 ms)
2026-11-07T06:01:02Z [load_day 2026-06-06] 2026-06-06 hour 1: 157985 events in 4 files, snapshot 3072713353336099828 (task 4953 ms: download 1971 ms overlapping gunzip 311 ms, parse 1073 ms, sort 140 ms, write 2234 ms, index 421 ms: 9 candidates, 67861 repo-hours, 410 releases; waiting 517 ms; commit 2745 ms)
2026-11-07T06:01:05Z [load_day 2026-06-06] 2026-06-06 hour 2: 159505 events in 4 files, snapshot 3378753331092157742 (task 4862 ms: download 1425 ms overlapping gunzip 267 ms, parse 893 ms, sort 123 ms, write 2193 ms, index 555 ms: 10 candidates, 81889 repo-hours, 311 releases; waiting 536 ms; commit 1075 ms)
2026-11-07T06:01:06Z [load_day 2026-06-06] 2026-06-06 hour 3: 158400 events in 4 files, snapshot 6645637963238681916 (task 4923 ms: download 2046 ms overlapping gunzip 310 ms, parse 1061 ms, sort 112 ms, write 2216 ms, index 507 ms: 3 candidates, 77766 repo-hours, 405 releases; waiting 487 ms; commit 1001 ms)
2026-11-07T06:01:10Z [load_day 2026-06-06] 2026-06-06 hour 4: 157207 events in 4 files, snapshot 5738640541427899325 (task 4956 ms: download 2041 ms overlapping gunzip 290 ms, parse 995 ms, sort 135 ms, write 2023 ms, index 481 ms: 6 candidates, 72924 repo-hours, 504 releases; waiting 523 ms; commit 1170 ms)
2026-11-07T06:01:11Z [load_day 2026-06-06] 2026-06-06 hour 5: 155410 events in 4 files, snapshot 8907393868374824798 (task 4818 ms: download 1913 ms overlapping gunzip 313 ms, parse 1110 ms, sort 125 ms, write 1973 ms, index 398 ms: 6 candidates, 63879 repo-hours, 480 releases; waiting 560 ms; commit 1139 ms)
2026-11-07T06:01:16Z [load_day 2026-06-06] 2026-06-06 hour 6: 157976 events in 4 files, snapshot 7028381135865026580 (task 4667 ms: download 1466 ms overlapping gunzip 308 ms, parse 1054 ms, sort 123 ms, write 1899 ms, index 461 ms: 6 candidates, 69304 repo-hours, 521 releases; waiting 524 ms; commit 1114 ms)
2026-11-07T06:01:17Z [load_day 2026-06-06] 2026-06-06 hour 7: 156948 events in 4 files, snapshot 2890791990840807909 (task 4158 ms: download 999 ms overlapping gunzip 257 ms, parse 880 ms, sort 112 ms, write 1953 ms, index 458 ms: 6 candidates, 72193 repo-hours, 367 releases; waiting 159 ms; commit 1175 ms)
2026-11-07T06:01:21Z [load_day 2026-06-06] 2026-06-06 hour 8: 168690 events in 4 files, snapshot 14289751697539037 (task 4387 ms: download 1529 ms overlapping gunzip 272 ms, parse 928 ms, sort 126 ms, write 1760 ms, index 507 ms: 11 candidates, 77432 repo-hours, 273 releases; waiting 527 ms; commit 1109 ms)
2026-11-07T06:01:22Z [load_day 2026-06-06] 2026-06-06 hour 9: 163476 events in 4 files, snapshot 5996186142462932683 (task 4371 ms: download 1652 ms overlapping gunzip 286 ms, parse 945 ms, sort 103 ms, write 1712 ms, index 479 ms: 7 candidates, 73280 repo-hours, 258 releases; waiting 540 ms; commit 1123 ms)
2026-11-07T06:01:26Z [load_day 2026-06-06] 2026-06-06 hour 10: 162336 events in 4 files, snapshot 670964590565529862 (task 4790 ms: download 1641 ms overlapping gunzip 246 ms, parse 868 ms, sort 108 ms, write 1941 ms, index 566 ms: 6 candidates, 75047 repo-hours, 220 releases; waiting 724 ms; commit 1014 ms)
2026-11-07T06:01:27Z [load_day 2026-06-06] 2026-06-06 hour 11: 158512 events in 4 files, snapshot 8925687089675911704 (task 4275 ms: download 1512 ms overlapping gunzip 228 ms, parse 816 ms, sort 108 ms, write 1771 ms, index 500 ms: 7 candidates, 76245 repo-hours, 153 releases; waiting 541 ms; commit 1125 ms)
2026-11-07T06:01:31Z [load_day 2026-06-06] 2026-06-06 hour 12: 164742 events in 4 files, snapshot 4941294743276764063 (task 4317 ms: download 1630 ms overlapping gunzip 226 ms, parse 811 ms, sort 119 ms, write 1729 ms, index 474 ms: 8 candidates, 73081 repo-hours, 121 releases; waiting 543 ms; commit 1229 ms)
2026-11-07T06:01:32Z [load_day 2026-06-06] 2026-06-06 hour 13: 165414 events in 4 files, snapshot 1907819824110759603 (task 4078 ms: download 1438 ms overlapping gunzip 206 ms, parse 844 ms, sort 106 ms, write 1534 ms, index 536 ms: 12 candidates, 83489 repo-hours, 65 releases; waiting 542 ms; commit 877 ms)
2026-11-07T06:01:36Z [load_day 2026-06-06] 2026-06-06 hour 14: 164893 events in 4 files, snapshot 173211315263640115 (task 4498 ms: download 2176 ms overlapping gunzip 232 ms, parse 884 ms, sort 114 ms, write 1799 ms, index 468 ms: 10 candidates, 73784 repo-hours, 73 releases; waiting 511 ms; commit 1014 ms)
2026-11-07T06:01:37Z [load_day 2026-06-06] 2026-06-06 hour 15: 159952 events in 4 files, snapshot 6332523291048501144 (task 4045 ms: download 1298 ms overlapping gunzip 217 ms, parse 806 ms, sort 124 ms, write 1604 ms, index 510 ms: 8 candidates, 77540 repo-hours, 112 releases; waiting 531 ms; commit 1032 ms)
2026-11-07T06:01:41Z [load_day 2026-06-06] 2026-06-06 hour 16: 161911 events in 4 files, snapshot 8055158809374425224 (task 4130 ms: download 1401 ms overlapping gunzip 207 ms, parse 783 ms, sort 100 ms, write 1661 ms, index 494 ms: 6 candidates, 71451 repo-hours, 66 releases; waiting 567 ms; commit 1031 ms)
2026-11-07T06:01:42Z [load_day 2026-06-06] 2026-06-06 hour 17: 161774 events in 4 files, snapshot 4209970656254982383 (task 3769 ms: download 1035 ms overlapping gunzip 207 ms, parse 758 ms, sort 114 ms, write 1661 ms, index 477 ms: 8 candidates, 71632 repo-hours, 87 releases; waiting 242 ms; commit 949 ms)
2026-11-07T06:01:46Z [load_day 2026-06-06] 2026-06-06 hour 18: 165336 events in 4 files, snapshot 6186633037558792243 (task 4186 ms: download 1289 ms overlapping gunzip 246 ms, parse 869 ms, sort 109 ms, write 1641 ms, index 518 ms: 18 candidates, 72421 repo-hours, 122 releases; waiting 517 ms; commit 1114 ms)
2026-11-07T06:01:47Z [load_day 2026-06-06] 2026-06-06 hour 19: 163039 events in 4 files, snapshot 292869423606730854 (task 4087 ms: download 1326 ms overlapping gunzip 243 ms, parse 885 ms, sort 119 ms, write 1522 ms, index 484 ms: 11 candidates, 74671 repo-hours, 139 releases; waiting 535 ms; commit 990 ms)
2026-11-07T06:01:50Z [load_day 2026-06-06] 2026-06-06 hour 20: 153558 events in 4 files, snapshot 2872482650188111299 (task 4257 ms: download 1471 ms overlapping gunzip 253 ms, parse 888 ms, sort 120 ms, write 1730 ms, index 452 ms: 11 candidates, 67591 repo-hours, 235 releases; waiting 519 ms; commit 911 ms)
2026-11-07T06:01:52Z [load_day 2026-06-06] 2026-06-06 hour 21: 163090 events in 4 files, snapshot 5926203017217528614 (task 4333 ms: download 1553 ms overlapping gunzip 277 ms, parse 975 ms, sort 115 ms, write 1649 ms, index 458 ms: 13 candidates, 67098 repo-hours, 311 releases; waiting 527 ms; commit 1006 ms)
2026-11-07T06:01:56Z [load_day 2026-06-06] 2026-06-06 hour 22: 159368 events in 4 files, snapshot 5888548725843409540 (task 4884 ms: download 1990 ms overlapping gunzip 278 ms, parse 997 ms, sort 126 ms, write 2233 ms, index 396 ms: 9 candidates, 64459 repo-hours, 464 releases; waiting 526 ms; commit 1097 ms)
2026-11-07T06:01:57Z [load_day 2026-06-06] 2026-06-06 hour 23: 152443 events in 4 files, snapshot 6123095484920793468 (task 4947 ms: download 1662 ms overlapping gunzip 309 ms, parse 1074 ms, sort 150 ms, write 2216 ms, index 377 ms: 8 candidates, 59367 repo-hours, 701 releases; waiting 539 ms; commit 1014 ms)
2026-11-07T06:02:04Z [load_day 2026-06-06] 2026-06-06: repo_hour merged from 24 files to 1 (1730523 rows, 7011 ms)
2026-11-07T06:02:06Z [load_day 2026-06-06] 2026-06-06: index committed in 8873 ms (24 + 1 + 24 files)
2026-11-07T06:02:06Z [load_day 2026-06-06] 2026-06-06: 3841100 events in 24 hours
2026-11-07T06:02:06Z [load_day 2026-06-06] attempt 1 succeeded