orcaLog in

Runs · run 1444

load_day 2023-08-30, attempt 1 succeeded

Host
3c2b29713ce8:277352
Started
2026-11-08T00:21:20Z
Ended
2026-11-08T00:25:26Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1444/load_day/2023-08-30/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T00:21:20Z [load_day 2023-08-30] attempt 1 started
2026-11-08T00:21:22Z [load_day 2023-08-30] 2023-08-30: 2 hours in flight, about 1200 MB
2026-11-08T00:21:43Z [load_day 2023-08-30] 2023-08-30 hour 0: 169300 events in 4 files, snapshot 426041056710945388 (task 16619 ms: download 7447 ms overlapping gunzip 981 ms, parse 4611 ms, sort 140 ms, write 9528 ms, index 590 ms: 6 candidates, 89725 repo-hours, 914 releases; waiting 506 ms; commit 2232 ms)
2026-11-08T00:21:45Z [load_day 2023-08-30] 2023-08-30 hour 1: 159557 events in 4 files, snapshot 2361517596601991241 (task 15752 ms: download 6574 ms overlapping gunzip 847 ms, parse 3927 ms, sort 146 ms, write 9270 ms, index 786 ms: 4 candidates, 88534 repo-hours, 702 releases; waiting 499 ms; commit 2291 ms)
2026-11-08T00:21:57Z [load_day 2023-08-30] 2023-08-30 hour 2: 140832 events in 3 files, snapshot 1801974192594274790 (task 13406 ms: download 5170 ms overlapping gunzip 761 ms, parse 3363 ms, sort 131 ms, write 8250 ms, index 454 ms: 4 candidates, 61711 repo-hours, 704 releases; waiting 209 ms; commit 2463 ms)
2026-11-08T00:22:02Z [load_day 2023-08-30] 2023-08-30 hour 3: 138744 events in 3 files, snapshot 2306614105853845580 (task 13898 ms: download 6081 ms overlapping gunzip 744 ms, parse 3323 ms, sort 132 ms, write 8136 ms, index 773 ms: 4 candidates, 59171 repo-hours, 833 releases; waiting 494 ms; commit 3955 ms)
2026-11-08T00:22:12Z [load_day 2023-08-30] 2023-08-30 hour 4: 133613 events in 3 files, snapshot 2910540214997425606 (task 13335 ms: download 5551 ms overlapping gunzip 801 ms, parse 3446 ms, sort 89 ms, write 7818 ms, index 377 ms: 5 candidates, 54712 repo-hours, 644 releases; waiting 522 ms; commit 2746 ms)
2026-11-08T00:22:17Z [load_day 2023-08-30] 2023-08-30 hour 5: 143434 events in 3 files, snapshot 5108771805660988620 (task 15359 ms: download 5718 ms overlapping gunzip 856 ms, parse 3572 ms, sort 143 ms, write 9618 ms, index 755 ms: 7 candidates, 60809 repo-hours, 735 releases; waiting 190 ms; commit 2233 ms)
2026-11-08T00:22:31Z [load_day 2023-08-30] 2023-08-30 hour 6: 172969 events in 4 files, snapshot 5823809343946432659 (task 18456 ms: download 10634 ms overlapping gunzip 1164 ms, parse 5120 ms, sort 178 ms, write 10232 ms, index 954 ms: 4 candidates, 78377 repo-hours, 1005 releases; waiting 496 ms; commit 2775 ms)
2026-11-08T00:22:37Z [load_day 2023-08-30] 2023-08-30 hour 7: 173214 events in 4 files, snapshot 3032685700208781352 (task 19335 ms: download 10521 ms overlapping gunzip 1234 ms, parse 5366 ms, sort 179 ms, write 11257 ms, index 558 ms: 7 candidates, 76263 repo-hours, 940 releases; waiting 515 ms; commit 2404 ms)
2026-11-08T00:22:51Z [load_day 2023-08-30] 2023-08-30 hour 8: 171262 events in 4 files, snapshot 3919261149161992149 (task 18449 ms: download 10649 ms overlapping gunzip 1015 ms, parse 4481 ms, sort 155 ms, write 11679 ms, index 652 ms: 6 candidates, 78684 repo-hours, 1090 releases; waiting 196 ms; commit 2350 ms)
2026-11-08T00:22:58Z [load_day 2023-08-30] 2023-08-30 hour 9: 181051 events in 4 files, snapshot 4614388601995476013 (task 19488 ms: download 11105 ms overlapping gunzip 1210 ms, parse 5732 ms, sort 145 ms, write 11030 ms, index 635 ms: 4 candidates, 81480 repo-hours, 1180 releases; waiting 410 ms; commit 2967 ms)
2026-11-08T00:23:18Z [load_day 2023-08-30] 2023-08-30 hour 10: 177038 events in 4 files, snapshot 1244563290506337226 (task 19243 ms: download 10770 ms overlapping gunzip 1000 ms, parse 4471 ms, sort 142 ms, write 12055 ms, index 592 ms: 1 candidates, 79070 repo-hours, 1038 releases; waiting 263 ms; commit 9169 ms)
2026-11-08T00:23:21Z [load_day 2023-08-30] 2023-08-30 hour 11: 172729 events in 4 files, snapshot 5394515742154943816 (task 19087 ms: download 11327 ms overlapping gunzip 1085 ms, parse 4828 ms, sort 149 ms, write 11867 ms, index 741 ms: 2 candidates, 75199 repo-hours, 1021 releases; waiting 203 ms; commit 3392 ms)
2026-11-08T00:23:30Z [load_day 2023-08-30] 2023-08-30 hour 12: 212584 events in 5 files, snapshot 738111052090073363 (task 17179 ms: download 8908 ms overlapping gunzip 969 ms, parse 4311 ms, sort 159 ms, write 10280 ms, index 708 ms: 6 candidates, 104891 repo-hours, 1064 releases; waiting 468 ms; commit 2270 ms)
2026-11-08T00:23:40Z [load_day 2023-08-30] 2023-08-30 hour 13: 202536 events in 5 files, snapshot 7959843141801064274 (task 18464 ms: download 9088 ms overlapping gunzip 1000 ms, parse 4607 ms, sort 126 ms, write 10728 ms, index 1283 ms: 4 candidates, 101073 repo-hours, 1093 releases; waiting 514 ms; commit 3015 ms)
2026-11-08T00:23:55Z [load_day 2023-08-30] 2023-08-30 hour 14: 194313 events in 4 files, snapshot 4704640217915035593 (task 22129 ms: download 12492 ms overlapping gunzip 1348 ms, parse 6264 ms, sort 168 ms, write 12845 ms, index 619 ms: 3 candidates, 89925 repo-hours, 1077 releases; waiting 614 ms; commit 3932 ms)
2026-11-08T00:24:03Z [load_day 2023-08-30] 2023-08-30 hour 15: 175399 events in 4 files, snapshot 5325448542456786230 (task 20799 ms: download 11787 ms overlapping gunzip 1183 ms, parse 5464 ms, sort 176 ms, write 12361 ms, index 798 ms: 4 candidates, 82215 repo-hours, 1061 releases; waiting 492 ms; commit 2907 ms)
2026-11-08T00:24:15Z [load_day 2023-08-30] 2023-08-30 hour 16: 177054 events in 4 files, snapshot 4967067731305304700 (task 19980 ms: download 12341 ms overlapping gunzip 1252 ms, parse 5717 ms, sort 109 ms, write 11423 ms, index 705 ms: 5 candidates, 81086 repo-hours, 904 releases; waiting 540 ms; commit 2686 ms)
2026-11-08T00:24:24Z [load_day 2023-08-30] 2023-08-30 hour 17: 177907 events in 4 files, snapshot 888665923103214690 (task 17881 ms: download 10178 ms overlapping gunzip 980 ms, parse 4286 ms, sort 130 ms, write 11177 ms, index 513 ms: 4 candidates, 78835 repo-hours, 930 releases; waiting 474 ms; commit 5123 ms)
2026-11-08T00:24:34Z [load_day 2023-08-30] 2023-08-30 hour 18: 176858 events in 4 files, snapshot 1752145053388414018 (task 18320 ms: download 10737 ms overlapping gunzip 948 ms, parse 4328 ms, sort 124 ms, write 11564 ms, index 581 ms: 3 candidates, 81820 repo-hours, 948 releases; waiting 504 ms; commit 2681 ms)
2026-11-08T00:24:43Z [load_day 2023-08-30] 2023-08-30 hour 19: 173710 events in 4 files, snapshot 6230487161501590311 (task 18392 ms: download 11172 ms overlapping gunzip 1081 ms, parse 4779 ms, sort 139 ms, write 11297 ms, index 575 ms: 2 candidates, 73695 repo-hours, 972 releases; waiting 318 ms; commit 4815 ms)
2026-11-08T00:24:53Z [load_day 2023-08-30] 2023-08-30 hour 20: 164127 events in 4 files, snapshot 7911434731622260408 (task 17794 ms: download 10648 ms overlapping gunzip 988 ms, parse 4301 ms, sort 120 ms, write 11023 ms, index 577 ms: 5 candidates, 70659 repo-hours, 985 releases; waiting 526 ms; commit 2550 ms)
2026-11-08T00:25:00Z [load_day 2023-08-30] 2023-08-30 hour 21: 156946 events in 4 files, snapshot 1638313522116158304 (task 18068 ms: download 11135 ms overlapping gunzip 1353 ms, parse 5616 ms, sort 134 ms, write 9841 ms, index 450 ms: 7 candidates, 64232 repo-hours, 839 releases; waiting 337 ms; commit 2503 ms)
2026-11-08T00:25:10Z [load_day 2023-08-30] 2023-08-30 hour 22: 148745 events in 3 files, snapshot 8768992872985797168 (task 16330 ms: download 7065 ms overlapping gunzip 1172 ms, parse 4519 ms, sort 103 ms, write 8889 ms, index 853 ms: 4 candidates, 59938 repo-hours, 913 releases; waiting 518 ms; commit 2646 ms)
2026-11-08T00:25:16Z [load_day 2023-08-30] 2023-08-30 hour 23: 139210 events in 3 files, snapshot 2615240503346232362 (task 14347 ms: download 6290 ms overlapping gunzip 802 ms, parse 3440 ms, sort 85 ms, write 8746 ms, index 426 ms: 8 candidates, 56363 repo-hours, 770 releases; waiting 247 ms; commit 2241 ms)
2026-11-08T00:25:24Z [load_day 2023-08-30] 2023-08-30: repo_hour merged from 24 files to 1 (1828467 rows, 8456 ms)
2026-11-08T00:25:26Z [load_day 2023-08-30] 2023-08-30: index committed in 10881 ms (24 + 1 + 24 files)
2026-11-08T00:25:26Z [load_day 2023-08-30] 2023-08-30: 4033132 events in 24 hours
2026-11-08T00:25:26Z [load_day 2023-08-30] attempt 1 succeeded