orcaLog in

Runs · run 119

load_day 2026-10-09, attempt 1 succeeded

Host
4e84322b8c45:21533
Started
2026-11-07T03:38:38Z
Ended
2026-11-07T03:39:15Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/119/load_day/2026-10-09/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:38:38Z [load_day 2026-10-09] attempt 1 started
2026-11-07T03:38:45Z [load_day 2026-10-09] 2026-10-09 hour 0: 39998 events in 1 files, snapshot 3107650099428872122 (task 2688 ms: download 1002 ms overlapping gunzip 128 ms, parse 434 ms, sort 80 ms, write 924 ms, index 244 ms: 6 candidates, 26615 repo-hours, 381 releases; waiting 536 ms; commit 1808 ms)
2026-11-07T03:38:45Z [load_day 2026-10-09] 2026-10-09 hour 1: 39023 events in 1 files, snapshot 1871568682265872469 (task 2540 ms: download 914 ms overlapping gunzip 111 ms, parse 375 ms, sort 43 ms, write 928 ms, index 202 ms: 8 candidates, 26963 repo-hours, 411 releases; waiting 527 ms; commit 533 ms)
2026-11-07T03:38:47Z [load_day 2026-10-09] 2026-10-09 hour 2: 39849 events in 1 files, snapshot 6894536025182785805 (task 1697 ms: download 180 ms overlapping gunzip 93 ms, parse 303 ms, sort 44 ms, write 762 ms, index 279 ms: 2 candidates, 27192 repo-hours, 227 releases; waiting 15 ms; commit 540 ms)
2026-11-07T03:38:47Z [load_day 2026-10-09] 2026-10-09 hour 3: 41463 events in 1 files, snapshot 2640087358798851179 (task 1591 ms: download 233 ms overlapping gunzip 121 ms, parse 360 ms, sort 42 ms, write 669 ms, index 198 ms: 7 candidates, 29591 repo-hours, 435 releases; waiting 22 ms; commit 430 ms)
2026-11-07T03:38:49Z [load_day 2026-10-09] 2026-10-09 hour 4: 43935 events in 1 files, snapshot 587894048890482394 (task 1786 ms: download 222 ms overlapping gunzip 109 ms, parse 337 ms, sort 32 ms, write 832 ms, index 268 ms: 6 candidates, 31225 repo-hours, 418 releases; waiting 20 ms; commit 513 ms)
2026-11-07T03:38:50Z [load_day 2026-10-09] 2026-10-09 hour 5: 45337 events in 1 files, snapshot 4089825742899613714 (task 1770 ms: download 200 ms overlapping gunzip 151 ms, parse 461 ms, sort 33 ms, write 703 ms, index 225 ms: 4 candidates, 31879 repo-hours, 560 releases; waiting 17 ms; commit 551 ms)
2026-11-07T03:38:52Z [load_day 2026-10-09] 2026-10-09 hour 6: 46115 events in 1 files, snapshot 7663002559872513957 (task 1956 ms: download 225 ms overlapping gunzip 121 ms, parse 368 ms, sort 36 ms, write 945 ms, index 272 ms: 7 candidates, 32254 repo-hours, 556 releases; waiting 17 ms; commit 743 ms)
2026-11-07T03:38:52Z [load_day 2026-10-09] 2026-10-09 hour 7: 47331 events in 1 files, snapshot 4300752105366580409 (task 1764 ms: download 246 ms overlapping gunzip 130 ms, parse 389 ms, sort 41 ms, write 700 ms, index 268 ms: 5 candidates, 32946 repo-hours, 550 releases; waiting 30 ms; commit 578 ms)
2026-11-07T03:38:54Z [load_day 2026-10-09] 2026-10-09 hour 8: 46414 events in 1 files, snapshot 4193550423582735229 (task 1614 ms: download 205 ms overlapping gunzip 109 ms, parse 336 ms, sort 33 ms, write 700 ms, index 238 ms: 6 candidates, 33389 repo-hours, 404 releases; waiting 19 ms; commit 659 ms)
2026-11-07T03:38:55Z [load_day 2026-10-09] 2026-10-09 hour 9: 46573 events in 1 files, snapshot 6141609439702639690 (task 2377 ms: download 894 ms overlapping gunzip 105 ms, parse 346 ms, sort 37 ms, write 726 ms, index 293 ms: 1 candidates, 33370 repo-hours, 207 releases; waiting 529 ms; commit 492 ms)
2026-11-07T03:38:56Z [load_day 2026-10-09] 2026-10-09 hour 10: 42795 events in 1 files, snapshot 1231478551507410189 (task 1643 ms: download 291 ms overlapping gunzip 124 ms, parse 336 ms, sort 40 ms, write 689 ms, index 246 ms: 2 candidates, 30949 repo-hours, 259 releases; waiting 20 ms; commit 529 ms)
2026-11-07T03:38:57Z [load_day 2026-10-09] 2026-10-09 hour 11: 41626 events in 1 files, snapshot 541266807118728176 (task 1457 ms: download 196 ms overlapping gunzip 87 ms, parse 286 ms, sort 28 ms, write 615 ms, index 235 ms: 5 candidates, 30334 repo-hours, 242 releases; waiting 19 ms; commit 525 ms)
2026-11-07T03:38:59Z [load_day 2026-10-09] 2026-10-09 hour 12: 45663 events in 1 files, snapshot 5534542815454121259 (task 2275 ms: download 890 ms overlapping gunzip 113 ms, parse 349 ms, sort 33 ms, write 664 ms, index 222 ms: 2 candidates, 32146 repo-hours, 217 releases; waiting 550 ms; commit 645 ms)
2026-11-07T03:39:00Z [load_day 2026-10-09] 2026-10-09 hour 13: 44436 events in 1 files, snapshot 6404379214048074569 (task 2077 ms: download 871 ms overlapping gunzip 96 ms, parse 308 ms, sort 33 ms, write 565 ms, index 220 ms: 3 candidates, 32391 repo-hours, 209 releases; waiting 539 ms; commit 519 ms)
2026-11-07T03:39:01Z [load_day 2026-10-09] 2026-10-09 hour 14: 36755 events in 1 files, snapshot 5139154090142585177 (task 1768 ms: download 799 ms overlapping gunzip 69 ms, parse 230 ms, sort 21 ms, write 429 ms, index 182 ms: 5 candidates, 27286 repo-hours, 148 releases; waiting 552 ms; commit 741 ms)
2026-11-07T03:39:03Z [load_day 2026-10-09] 2026-10-09 hour 15: 12743 events in 1 files, snapshot 1060102625038413511 (task 1617 ms: download 744 ms overlapping gunzip 45 ms, parse 141 ms, sort 8 ms, write 309 ms, index 76 ms: 0 candidates, 10407 repo-hours, 184 releases; waiting 569 ms; commit 1263 ms)
2026-11-07T03:39:03Z [load_day 2026-10-09] 2026-10-09 hour 16: 4389 events in 1 files, snapshot 5970917052125011943 (task 1415 ms: download 760 ms overlapping gunzip 56 ms, parse 173 ms, sort 4 ms, write 359 ms, index 40 ms: 0 candidates, 3771 repo-hours, 391 releases; waiting 551 ms; commit 663 ms)
2026-11-07T03:39:04Z [load_day 2026-10-09] 2026-10-09 hour 17: 5470 events in 1 files, snapshot 7055914026484703725 (task 1710 ms: download 808 ms overlapping gunzip 65 ms, parse 183 ms, sort 6 ms, write 464 ms, index 78 ms: 1 candidates, 4684 repo-hours, 371 releases; waiting 581 ms; commit 537 ms)
2026-11-07T03:39:06Z [load_day 2026-10-09] 2026-10-09 hour 18: 5862 events in 1 files, snapshot 1305949526364346601 (task 1719 ms: download 803 ms overlapping gunzip 74 ms, parse 203 ms, sort 7 ms, write 475 ms, index 47 ms: 0 candidates, 4977 repo-hours, 346 releases; waiting 553 ms; commit 642 ms)
2026-11-07T03:39:06Z [load_day 2026-10-09] 2026-10-09 hour 19: 6602 events in 1 files, snapshot 3006041779659179197 (task 1757 ms: download 807 ms overlapping gunzip 79 ms, parse 234 ms, sort 8 ms, write 530 ms, index 62 ms: 1 candidates, 5493 repo-hours, 454 releases; waiting 552 ms; commit 691 ms)
2026-11-07T03:39:08Z [load_day 2026-10-09] 2026-10-09 hour 20: 5217 events in 1 files, snapshot 1095199191437662297 (task 1590 ms: download 630 ms overlapping gunzip 60 ms, parse 180 ms, sort 6 ms, write 484 ms, index 170 ms: 1 candidates, 4395 repo-hours, 312 releases; waiting 415 ms; commit 742 ms)
2026-11-07T03:39:09Z [load_day 2026-10-09] 2026-10-09 hour 21: 4605 events in 1 files, snapshot 8238843628752021652 (task 1558 ms: download 777 ms overlapping gunzip 60 ms, parse 171 ms, sort 5 ms, write 444 ms, index 41 ms: 0 candidates, 3964 repo-hours, 236 releases; waiting 560 ms; commit 504 ms)
2026-11-07T03:39:10Z [load_day 2026-10-09] 2026-10-09 hour 22: 4898 events in 1 files, snapshot 7432140310804449155 (task 1573 ms: download 784 ms overlapping gunzip 61 ms, parse 176 ms, sort 5 ms, write 476 ms, index 49 ms: 0 candidates, 4149 repo-hours, 194 releases; waiting 570 ms; commit 603 ms)
2026-11-07T03:39:11Z [load_day 2026-10-09] 2026-10-09 hour 23: 4474 events in 1 files, snapshot 8357847067152976876 (task 1584 ms: download 773 ms overlapping gunzip 60 ms, parse 169 ms, sort 5 ms, write 437 ms, index 40 ms: 0 candidates, 3709 repo-hours, 213 releases; waiting 569 ms; commit 592 ms)
2026-11-07T03:39:13Z [load_day 2026-10-09] 2026-10-09: repo_hour merged from 24 files to 1 (504079 rows, 2897 ms)
2026-11-07T03:39:15Z [load_day 2026-10-09] 2026-10-09: index committed in 4321 ms (18 + 1 + 24 files)
2026-11-07T03:39:15Z [load_day 2026-10-09] 2026-10-09: 701573 events in 24 hours
2026-11-07T03:39:15Z [load_day 2026-10-09] attempt 1 succeeded