orcaLog in

Runs · run 104

load_day 2026-10-14, attempt 1 succeeded

Host
4e84322b8c45:19547
Started
2026-11-07T03:34:40Z
Ended
2026-11-07T03:35:26Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/104/load_day/2026-10-14/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:34:40Z [load_day 2026-10-14] attempt 1 started
2026-11-07T03:34:45Z [load_day 2026-10-14] 2026-10-14 hour 0: 90334 events in 2 files, snapshot 4602195228397165884 (task 2484 ms: download 262 ms overlapping gunzip 146 ms, parse 516 ms, sort 71 ms, write 1179 ms, index 351 ms: 11 candidates, 51299 repo-hours, 90 releases; waiting 11 ms; commit 449 ms)
2026-11-07T03:34:45Z [load_day 2026-10-14] 2026-10-14 hour 1: 86628 events in 2 files, snapshot 8896770363953073172 (task 2644 ms: download 282 ms overlapping gunzip 147 ms, parse 519 ms, sort 73 ms, write 1361 ms, index 320 ms: 9 candidates, 49171 repo-hours, 207 releases; waiting 14 ms; commit 463 ms)
2026-11-07T03:34:49Z [load_day 2026-10-14] 2026-10-14 hour 2: 84066 events in 2 files, snapshot 4756776004906609358 (task 2588 ms: download 318 ms overlapping gunzip 153 ms, parse 497 ms, sort 73 ms, write 1266 ms, index 391 ms: 9 candidates, 53081 repo-hours, 231 releases; waiting 16 ms; commit 690 ms)
2026-11-07T03:34:50Z [load_day 2026-10-14] 2026-10-14 hour 3: 86867 events in 2 files, snapshot 7143406878670362795 (task 3180 ms: download 1141 ms overlapping gunzip 156 ms, parse 547 ms, sort 62 ms, write 1216 ms, index 362 ms: 13 candidates, 55280 repo-hours, 170 releases; waiting 537 ms; commit 773 ms)
2026-11-07T03:34:52Z [load_day 2026-10-14] 2026-10-14 hour 4: 86415 events in 2 files, snapshot 3963542997005809675 (task 3369 ms: download 1263 ms overlapping gunzip 180 ms, parse 582 ms, sort 58 ms, write 1339 ms, index 349 ms: 5 candidates, 53314 repo-hours, 203 releases; waiting 536 ms; commit 617 ms)
2026-11-07T03:34:53Z [load_day 2026-10-14] 2026-10-14 hour 5: 86616 events in 2 files, snapshot 1408503891645252861 (task 3111 ms: download 1249 ms overlapping gunzip 155 ms, parse 492 ms, sort 65 ms, write 1255 ms, index 340 ms: 11 candidates, 52216 repo-hours, 245 releases; waiting 489 ms; commit 633 ms)
2026-11-07T03:34:56Z [load_day 2026-10-14] 2026-10-14 hour 6: 86590 events in 2 files, snapshot 1908474206524401223 (task 3034 ms: download 1232 ms overlapping gunzip 149 ms, parse 486 ms, sort 71 ms, write 1143 ms, index 376 ms: 8 candidates, 53206 repo-hours, 162 releases; waiting 538 ms; commit 604 ms)
2026-11-07T03:34:57Z [load_day 2026-10-14] 2026-10-14 hour 7: 87836 events in 2 files, snapshot 7867921243599516352 (task 3010 ms: download 1280 ms overlapping gunzip 142 ms, parse 464 ms, sort 66 ms, write 1157 ms, index 360 ms: 6 candidates, 54110 repo-hours, 101 releases; waiting 539 ms; commit 501 ms)
2026-11-07T03:34:59Z [load_day 2026-10-14] 2026-10-14 hour 8: 87461 events in 2 files, snapshot 5306461235341749034 (task 2885 ms: download 1228 ms overlapping gunzip 151 ms, parse 488 ms, sort 65 ms, write 996 ms, index 397 ms: 9 candidates, 54701 repo-hours, 87 releases; waiting 527 ms; commit 621 ms)
2026-11-07T03:35:00Z [load_day 2026-10-14] 2026-10-14 hour 9: 88758 events in 2 files, snapshot 7917725818658456844 (task 2979 ms: download 1301 ms overlapping gunzip 148 ms, parse 505 ms, sort 68 ms, write 932 ms, index 422 ms: 5 candidates, 54906 repo-hours, 90 releases; waiting 588 ms; commit 484 ms)
2026-11-07T03:35:03Z [load_day 2026-10-14] 2026-10-14 hour 10: 89727 events in 2 files, snapshot 1814280870410857357 (task 2374 ms: download 246 ms overlapping gunzip 136 ms, parse 466 ms, sort 65 ms, write 1120 ms, index 390 ms: 9 candidates, 55113 repo-hours, 98 releases; waiting 15 ms; commit 712 ms)
2026-11-07T03:35:03Z [load_day 2026-10-14] 2026-10-14 hour 11: 91389 events in 2 files, snapshot 8923540384025971658 (task 2377 ms: download 267 ms overlapping gunzip 141 ms, parse 470 ms, sort 67 ms, write 1123 ms, index 367 ms: 12 candidates, 58068 repo-hours, 101 releases; waiting 16 ms; commit 679 ms)
2026-11-07T03:35:05Z [load_day 2026-10-14] 2026-10-14 hour 12: 94517 events in 2 files, snapshot 3172233797100929755 (task 2256 ms: download 251 ms overlapping gunzip 133 ms, parse 452 ms, sort 66 ms, write 1012 ms, index 385 ms: 10 candidates, 58876 repo-hours, 65 releases; waiting 16 ms; commit 804 ms)
2026-11-07T03:35:06Z [load_day 2026-10-14] 2026-10-14 hour 13: 91223 events in 2 files, snapshot 975556460513960725 (task 2337 ms: download 272 ms overlapping gunzip 143 ms, parse 469 ms, sort 66 ms, write 990 ms, index 462 ms: 6 candidates, 58949 repo-hours, 102 releases; waiting 19 ms; commit 784 ms)
2026-11-07T03:35:09Z [load_day 2026-10-14] 2026-10-14 hour 14: 80838 events in 2 files, snapshot 5328694498289605725 (task 3234 ms: download 387 ms overlapping gunzip 215 ms, parse 689 ms, sort 91 ms, write 1691 ms, index 342 ms: 12 candidates, 53112 repo-hours, 584 releases; waiting 16 ms; commit 777 ms)
2026-11-07T03:35:10Z [load_day 2026-10-14] 2026-10-14 hour 15: 55989 events in 2 files, snapshot 2218379330520051110 (task 1922 ms: download 345 ms overlapping gunzip 132 ms, parse 380 ms, sort 38 ms, write 839 ms, index 290 ms: 8 candidates, 39132 repo-hours, 177 releases; waiting 30 ms; commit 607 ms)
2026-11-07T03:35:12Z [load_day 2026-10-14] 2026-10-14 hour 16: 37362 events in 1 files, snapshot 4835943500290678097 (task 2123 ms: download 940 ms overlapping gunzip 116 ms, parse 347 ms, sort 28 ms, write 746 ms, index 210 ms: 8 candidates, 29164 repo-hours, 166 releases; waiting 488 ms; commit 587 ms)
2026-11-07T03:35:12Z [load_day 2026-10-14] 2026-10-14 hour 17: 38496 events in 1 files, snapshot 6443851143106160603 (task 1525 ms: download 177 ms overlapping gunzip 86 ms, parse 259 ms, sort 29 ms, write 728 ms, index 205 ms: 2 candidates, 28123 repo-hours, 158 releases; waiting 17 ms; commit 705 ms)
2026-11-07T03:35:14Z [load_day 2026-10-14] 2026-10-14 hour 18: 25758 events in 1 files, snapshot 977062695445562964 (task 1459 ms: download 168 ms overlapping gunzip 86 ms, parse 248 ms, sort 20 ms, write 726 ms, index 161 ms: 6 candidates, 20191 repo-hours, 223 releases; waiting 15 ms; commit 761 ms)
2026-11-07T03:35:15Z [load_day 2026-10-14] 2026-10-14 hour 19: 7915 events in 1 files, snapshot 8733039956275000124 (task 1038 ms: download 137 ms overlapping gunzip 62 ms, parse 165 ms, sort 8 ms, write 515 ms, index 68 ms: 1 candidates, 7058 repo-hours, 173 releases; waiting 20 ms; commit 616 ms)
2026-11-07T03:35:15Z [load_day 2026-10-14] 2026-10-14 hour 20: 4866 events in 1 files, snapshot 873654331555447628 (task 915 ms: download 107 ms overlapping gunzip 46 ms, parse 126 ms, sort 7 ms, write 479 ms, index 42 ms: 0 candidates, 4251 repo-hours, 115 releases; waiting 22 ms; commit 706 ms)
2026-11-07T03:35:17Z [load_day 2026-10-14] 2026-10-14 hour 21: 5329 events in 1 files, snapshot 7123030516494725487 (task 919 ms: download 117 ms overlapping gunzip 50 ms, parse 132 ms, sort 7 ms, write 482 ms, index 46 ms: 0 candidates, 4651 repo-hours, 160 releases; waiting 20 ms; commit 1020 ms)
2026-11-07T03:35:17Z [load_day 2026-10-14] 2026-10-14 hour 22: 5350 events in 1 files, snapshot 4337120254040891329 (task 932 ms: download 110 ms overlapping gunzip 57 ms, parse 142 ms, sort 7 ms, write 493 ms, index 45 ms: 0 candidates, 4573 repo-hours, 202 releases; waiting 16 ms; commit 549 ms)
2026-11-07T03:35:18Z [load_day 2026-10-14] 2026-10-14 hour 23: 5346 events in 1 files, snapshot 4108887107537228972 (task 1077 ms: download 145 ms overlapping gunzip 59 ms, parse 172 ms, sort 6 ms, write 572 ms, index 45 ms: 0 candidates, 4384 repo-hours, 158 releases; waiting 19 ms; commit 530 ms)
2026-11-07T03:35:22Z [load_day 2026-10-14] 2026-10-14: repo_hour merged from 24 files to 1 (956929 rows, 4647 ms)
2026-11-07T03:35:26Z [load_day 2026-10-14] 2026-10-14: index committed in 7843 ms (20 + 1 + 24 files)
2026-11-07T03:35:26Z [load_day 2026-10-14] 2026-10-14: 1505676 events in 24 hours
2026-11-07T03:35:26Z [load_day 2026-10-14] attempt 1 succeeded