orcaLog in

Runs · run 122

load_day 2026-10-08, attempt 1 succeeded

Host
4e84322b8c45:21809
Started
2026-11-07T03:39:16Z
Ended
2026-11-07T03:39:53Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/122/load_day/2026-10-08/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:39:16Z [load_day 2026-10-08] attempt 1 started
2026-11-07T03:39:20Z [load_day 2026-10-08] 2026-10-08 hour 0: 4787 events in 1 files, snapshot 3908642143130050297 (task 977 ms: download 116 ms overlapping gunzip 52 ms, parse 163 ms, sort 15 ms, write 489 ms, index 56 ms: 1 candidates, 3919 repo-hours, 393 releases; waiting 13 ms; commit 895 ms)
2026-11-07T03:39:20Z [load_day 2026-10-08] 2026-10-08 hour 1: 5131 events in 1 files, snapshot 6471979223907579729 (task 1025 ms: download 128 ms overlapping gunzip 53 ms, parse 165 ms, sort 15 ms, write 540 ms, index 43 ms: 0 candidates, 4180 repo-hours, 394 releases; waiting 16 ms; commit 695 ms)
2026-11-07T03:39:21Z [load_day 2026-10-08] 2026-10-08 hour 2: 5720 events in 1 files, snapshot 6574917344170387885 (task 1060 ms: download 142 ms overlapping gunzip 70 ms, parse 194 ms, sort 6 ms, write 509 ms, index 93 ms: 2 candidates, 4637 repo-hours, 380 releases; waiting 15 ms; commit 642 ms)
2026-11-07T03:39:23Z [load_day 2026-10-08] 2026-10-08 hour 3: 18204 events in 1 files, snapshot 7287509788474898161 (task 2051 ms: download 872 ms overlapping gunzip 95 ms, parse 291 ms, sort 15 ms, write 683 ms, index 123 ms: 1 candidates, 14244 repo-hours, 497 releases; waiting 560 ms; commit 585 ms)
2026-11-07T03:39:24Z [load_day 2026-10-08] 2026-10-08 hour 4: 29017 events in 1 files, snapshot 8818220354879870389 (task 2027 ms: download 871 ms overlapping gunzip 97 ms, parse 289 ms, sort 19 ms, write 599 ms, index 146 ms: 2 candidates, 21675 repo-hours, 327 releases; waiting 560 ms; commit 622 ms)
2026-11-07T03:39:25Z [load_day 2026-10-08] 2026-10-08 hour 5: 29407 events in 1 files, snapshot 6827625928989688259 (task 1650 ms: download 418 ms overlapping gunzip 91 ms, parse 269 ms, sort 19 ms, write 643 ms, index 154 ms: 2 candidates, 22137 repo-hours, 491 releases; waiting 191 ms; commit 706 ms)
2026-11-07T03:39:26Z [load_day 2026-10-08] 2026-10-08 hour 6: 33764 events in 1 files, snapshot 6536661625258395721 (task 2146 ms: download 910 ms overlapping gunzip 108 ms, parse 324 ms, sort 25 ms, write 626 ms, index 202 ms: 1 candidates, 24718 repo-hours, 481 releases; waiting 553 ms; commit 598 ms)
2026-11-07T03:39:28Z [load_day 2026-10-08] 2026-10-08 hour 7: 37753 events in 1 files, snapshot 7781325018442233038 (task 2068 ms: download 883 ms overlapping gunzip 103 ms, parse 333 ms, sort 28 ms, write 618 ms, index 181 ms: 4 candidates, 27610 repo-hours, 383 releases; waiting 556 ms; commit 1311 ms)
2026-11-07T03:39:29Z [load_day 2026-10-08] 2026-10-08 hour 8: 42890 events in 1 files, snapshot 4254333169397083714 (task 2130 ms: download 902 ms overlapping gunzip 106 ms, parse 332 ms, sort 30 ms, write 609 ms, index 209 ms: 4 candidates, 30468 repo-hours, 464 releases; waiting 548 ms; commit 555 ms)
2026-11-07T03:39:30Z [load_day 2026-10-08] 2026-10-08 hour 9: 46426 events in 1 files, snapshot 3660986086509500730 (task 2129 ms: download 848 ms overlapping gunzip 91 ms, parse 305 ms, sort 30 ms, write 633 ms, index 235 ms: 3 candidates, 33279 repo-hours, 254 releases; waiting 542 ms; commit 556 ms)
2026-11-07T03:39:31Z [load_day 2026-10-08] 2026-10-08 hour 10: 45308 events in 1 files, snapshot 1865780874683356438 (task 1864 ms: download 815 ms overlapping gunzip 79 ms, parse 271 ms, sort 36 ms, write 497 ms, index 215 ms: 3 candidates, 32038 repo-hours, 158 releases; waiting 537 ms; commit 550 ms)
2026-11-07T03:39:33Z [load_day 2026-10-08] 2026-10-08 hour 11: 47107 events in 1 files, snapshot 5766828494753614043 (task 1964 ms: download 824 ms overlapping gunzip 85 ms, parse 288 ms, sort 31 ms, write 479 ms, index 242 ms: 5 candidates, 33927 repo-hours, 220 releases; waiting 536 ms; commit 622 ms)
2026-11-07T03:39:34Z [load_day 2026-10-08] 2026-10-08 hour 12: 47278 events in 1 files, snapshot 8647490199394747574 (task 2021 ms: download 843 ms overlapping gunzip 92 ms, parse 305 ms, sort 30 ms, write 499 ms, index 244 ms: 2 candidates, 35077 repo-hours, 222 releases; waiting 530 ms; commit 620 ms)
2026-11-07T03:39:35Z [load_day 2026-10-08] 2026-10-08 hour 13: 46626 events in 1 files, snapshot 8059842325647620639 (task 2065 ms: download 846 ms overlapping gunzip 86 ms, parse 297 ms, sort 31 ms, write 535 ms, index 237 ms: 6 candidates, 35060 repo-hours, 210 releases; waiting 531 ms; commit 959 ms)
2026-11-07T03:39:37Z [load_day 2026-10-08] 2026-10-08 hour 14: 46545 events in 1 files, snapshot 964497594385037523 (task 2150 ms: download 885 ms overlapping gunzip 87 ms, parse 301 ms, sort 29 ms, write 552 ms, index 274 ms: 6 candidates, 34717 repo-hours, 225 releases; waiting 585 ms; commit 678 ms)
2026-11-07T03:39:38Z [load_day 2026-10-08] 2026-10-08 hour 15: 47229 events in 1 files, snapshot 7721031598848358443 (task 1960 ms: download 859 ms overlapping gunzip 88 ms, parse 292 ms, sort 30 ms, write 552 ms, index 239 ms: 5 candidates, 34503 repo-hours, 188 releases; waiting 545 ms; commit 610 ms)
2026-11-07T03:39:40Z [load_day 2026-10-08] 2026-10-08 hour 16: 47234 events in 1 files, snapshot 3243564792343702167 (task 2327 ms: download 838 ms overlapping gunzip 152 ms, parse 377 ms, sort 31 ms, write 556 ms, index 266 ms: 5 candidates, 34158 repo-hours, 160 releases; waiting 529 ms; commit 662 ms)
2026-11-07T03:39:40Z [load_day 2026-10-08] 2026-10-08 hour 17: 46671 events in 1 files, snapshot 319910951380185237 (task 1943 ms: download 824 ms overlapping gunzip 79 ms, parse 273 ms, sort 28 ms, write 479 ms, index 232 ms: 5 candidates, 33640 repo-hours, 109 releases; waiting 537 ms; commit 554 ms)
2026-11-07T03:39:42Z [load_day 2026-10-08] 2026-10-08 hour 18: 50750 events in 2 files, snapshot 6592659312536797219 (task 2219 ms: download 846 ms overlapping gunzip 87 ms, parse 299 ms, sort 31 ms, write 635 ms, index 328 ms: 9 candidates, 37654 repo-hours, 130 releases; waiting 541 ms; commit 599 ms)
2026-11-07T03:39:43Z [load_day 2026-10-08] 2026-10-08 hour 19: 46681 events in 1 files, snapshot 7200359237344125705 (task 2005 ms: download 854 ms overlapping gunzip 84 ms, parse 276 ms, sort 30 ms, write 554 ms, index 220 ms: 9 candidates, 32925 repo-hours, 167 releases; waiting 561 ms; commit 559 ms)
2026-11-07T03:39:45Z [load_day 2026-10-08] 2026-10-08 hour 20: 45359 events in 1 files, snapshot 7699485399850649272 (task 1821 ms: download 700 ms overlapping gunzip 84 ms, parse 298 ms, sort 30 ms, write 549 ms, index 229 ms: 6 candidates, 32313 repo-hours, 142 releases; waiting 412 ms; commit 643 ms)
2026-11-07T03:39:46Z [load_day 2026-10-08] 2026-10-08 hour 21: 41187 events in 1 files, snapshot 3944837544245149719 (task 2237 ms: download 816 ms overlapping gunzip 80 ms, parse 271 ms, sort 27 ms, write 500 ms, index 193 ms: 9 candidates, 29079 repo-hours, 129 releases; waiting 531 ms; commit 814 ms)
2026-11-07T03:39:47Z [load_day 2026-10-08] 2026-10-08 hour 22: 41287 events in 1 files, snapshot 1466683799777172618 (task 2034 ms: download 879 ms overlapping gunzip 94 ms, parse 297 ms, sort 29 ms, write 589 ms, index 192 ms: 3 candidates, 29094 repo-hours, 149 releases; waiting 550 ms; commit 553 ms)
2026-11-07T03:39:49Z [load_day 2026-10-08] 2026-10-08 hour 23: 38854 events in 1 files, snapshot 4900192893548485642 (task 2199 ms: download 911 ms overlapping gunzip 111 ms, parse 356 ms, sort 39 ms, write 682 ms, index 160 ms: 0 candidates, 26354 repo-hours, 296 releases; waiting 545 ms; commit 544 ms)
2026-11-07T03:39:52Z [load_day 2026-10-08] 2026-10-08: repo_hour merged from 24 files to 1 (647406 rows, 3383 ms)
2026-11-07T03:39:53Z [load_day 2026-10-08] 2026-10-08: index committed in 4452 ms (22 + 1 + 24 files)
2026-11-07T03:39:53Z [load_day 2026-10-08] 2026-10-08: 891215 events in 24 hours
2026-11-07T03:39:53Z [load_day 2026-10-08] attempt 1 succeeded