orcaLog in

Runs · run 80

load_day 2026-10-22, attempt 1 succeeded

Host
4e84322b8c45:17015
Started
2026-11-07T03:29:48Z
Ended
2026-11-07T03:30:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/80/load_day/2026-10-22/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:29:48Z [load_day 2026-10-22] attempt 1 started
2026-11-07T03:29:53Z [load_day 2026-10-22] 2026-10-22 hour 0: 47326 events in 1 files, snapshot 3968234430798460509 (task 2421 ms: download 881 ms overlapping gunzip 98 ms, parse 353 ms, sort 44 ms, write 857 ms, index 225 ms: 4 candidates, 31333 repo-hours, 91 releases; waiting 531 ms; commit 449 ms)
2026-11-07T03:29:53Z [load_day 2026-10-22] 2026-10-22 hour 1: 48575 events in 1 files, snapshot 6850414197570066030 (task 2609 ms: download 924 ms overlapping gunzip 105 ms, parse 362 ms, sort 45 ms, write 954 ms, index 266 ms: 5 candidates, 32741 repo-hours, 139 releases; waiting 550 ms; commit 514 ms)
2026-11-07T03:29:56Z [load_day 2026-10-22] 2026-10-22 hour 2: 51836 events in 2 files, snapshot 5472514282657630631 (task 2532 ms: download 932 ms overlapping gunzip 119 ms, parse 398 ms, sort 47 ms, write 879 ms, index 234 ms: 6 candidates, 35704 repo-hours, 137 releases; waiting 532 ms; commit 722 ms)
2026-11-07T03:29:57Z [load_day 2026-10-22] 2026-10-22 hour 3: 48643 events in 1 files, snapshot 7269861723603034746 (task 2421 ms: download 992 ms overlapping gunzip 108 ms, parse 364 ms, sort 47 ms, write 797 ms, index 257 ms: 12 candidates, 34692 repo-hours, 174 releases; waiting 540 ms; commit 575 ms)
2026-11-07T03:29:59Z [load_day 2026-10-22] 2026-10-22 hour 4: 50515 events in 2 files, snapshot 6462621036785182936 (task 2512 ms: download 905 ms overlapping gunzip 122 ms, parse 389 ms, sort 38 ms, write 874 ms, index 271 ms: 8 candidates, 34079 repo-hours, 191 releases; waiting 536 ms; commit 561 ms)
2026-11-07T03:29:59Z [load_day 2026-10-22] 2026-10-22 hour 5: 50167 events in 2 files, snapshot 848324205791350725 (task 2391 ms: download 933 ms overlapping gunzip 128 ms, parse 401 ms, sort 37 ms, write 762 ms, index 240 ms: 9 candidates, 33640 repo-hours, 210 releases; waiting 522 ms; commit 526 ms)
2026-11-07T03:30:02Z [load_day 2026-10-22] 2026-10-22 hour 6: 50402 events in 2 files, snapshot 1287688311868912994 (task 2395 ms: download 945 ms overlapping gunzip 113 ms, parse 369 ms, sort 40 ms, write 781 ms, index 274 ms: 5 candidates, 34452 repo-hours, 151 releases; waiting 560 ms; commit 837 ms)
2026-11-07T03:30:03Z [load_day 2026-10-22] 2026-10-22 hour 7: 52447 events in 2 files, snapshot 6031293968060259087 (task 2316 ms: download 893 ms overlapping gunzip 104 ms, parse 360 ms, sort 37 ms, write 768 ms, index 307 ms: 7 candidates, 35954 repo-hours, 157 releases; waiting 531 ms; commit 707 ms)
2026-11-07T03:30:05Z [load_day 2026-10-22] 2026-10-22 hour 8: 54453 events in 2 files, snapshot 8450062535209984189 (task 2430 ms: download 1036 ms overlapping gunzip 101 ms, parse 329 ms, sort 37 ms, write 727 ms, index 286 ms: 7 candidates, 36992 repo-hours, 116 releases; waiting 652 ms; commit 737 ms)
2026-11-07T03:30:06Z [load_day 2026-10-22] 2026-10-22 hour 9: 56318 events in 2 files, snapshot 244285331497494323 (task 2289 ms: download 920 ms overlapping gunzip 99 ms, parse 334 ms, sort 36 ms, write 755 ms, index 254 ms: 5 candidates, 38414 repo-hours, 121 releases; waiting 576 ms; commit 490 ms)
2026-11-07T03:30:08Z [load_day 2026-10-22] 2026-10-22 hour 10: 56672 events in 2 files, snapshot 4196642330076433046 (task 1757 ms: download 269 ms overlapping gunzip 99 ms, parse 322 ms, sort 35 ms, write 809 ms, index 266 ms: 8 candidates, 38650 repo-hours, 133 releases; waiting 21 ms; commit 896 ms)
2026-11-07T03:30:08Z [load_day 2026-10-22] 2026-10-22 hour 11: 53597 events in 2 files, snapshot 7028909478078495478 (task 1753 ms: download 195 ms overlapping gunzip 105 ms, parse 333 ms, sort 33 ms, write 768 ms, index 287 ms: 7 candidates, 37862 repo-hours, 178 releases; waiting 25 ms; commit 589 ms)
2026-11-07T03:30:10Z [load_day 2026-10-22] 2026-10-22 hour 12: 55755 events in 2 files, snapshot 5291146431731652685 (task 1699 ms: download 191 ms overlapping gunzip 101 ms, parse 320 ms, sort 38 ms, write 759 ms, index 275 ms: 9 candidates, 38663 repo-hours, 151 releases; waiting 19 ms; commit 646 ms)
2026-11-07T03:30:11Z [load_day 2026-10-22] 2026-10-22 hour 13: 55309 events in 2 files, snapshot 4210655984019887377 (task 1490 ms: download 165 ms overlapping gunzip 89 ms, parse 291 ms, sort 35 ms, write 622 ms, index 249 ms: 3 candidates, 38553 repo-hours, 155 releases; waiting 15 ms; commit 752 ms)
2026-11-07T03:30:12Z [load_day 2026-10-22] 2026-10-22 hour 14: 47044 events in 1 files, snapshot 6893594178151443659 (task 1305 ms: download 141 ms overlapping gunzip 77 ms, parse 253 ms, sort 29 ms, write 497 ms, index 244 ms: 12 candidates, 33597 repo-hours, 131 releases; waiting 18 ms; commit 675 ms)
2026-11-07T03:30:12Z [load_day 2026-10-22] 2026-10-22 hour 15: 39534 events in 1 files, snapshot 1838572934274972962 (task 1392 ms: download 165 ms overlapping gunzip 82 ms, parse 270 ms, sort 26 ms, write 599 ms, index 203 ms: 9 candidates, 29016 repo-hours, 235 releases; waiting 21 ms; commit 467 ms)
2026-11-07T03:30:13Z [load_day 2026-10-22] 2026-10-22 hour 16: 11371 events in 1 files, snapshot 1666808765355996413 (task 789 ms: download 79 ms overlapping gunzip 37 ms, parse 101 ms, sort 6 ms, write 372 ms, index 79 ms: 1 candidates, 9769 repo-hours, 94 releases; waiting 16 ms; commit 446 ms)
2026-11-07T03:30:14Z [load_day 2026-10-22] 2026-10-22 hour 17: 3059 events in 1 files, snapshot 289630733521249428 (task 635 ms: download 67 ms overlapping gunzip 31 ms, parse 79 ms, sort 3 ms, write 280 ms, index 43 ms: 1 candidates, 2745 repo-hours, 127 releases; waiting 18 ms; commit 604 ms)
2026-11-07T03:30:15Z [load_day 2026-10-22] 2026-10-22 hour 18: 2961 events in 1 files, snapshot 992349485533863482 (task 1358 ms: download 816 ms overlapping gunzip 41 ms, parse 105 ms, sort 3 ms, write 268 ms, index 48 ms: 1 candidates, 2709 repo-hours, 137 releases; waiting 677 ms; commit 695 ms)
2026-11-07T03:30:16Z [load_day 2026-10-22] 2026-10-22 hour 19: 2738 events in 1 files, snapshot 8382628655845097741 (task 1313 ms: download 690 ms overlapping gunzip 36 ms, parse 99 ms, sort 2 ms, write 254 ms, index 42 ms: 1 candidates, 2532 repo-hours, 125 releases; waiting 563 ms; commit 578 ms)
2026-11-07T03:30:16Z [load_day 2026-10-22] 2026-10-22 hour 20: 2833 events in 1 files, snapshot 7778829234587568920 (task 895 ms: download 230 ms overlapping gunzip 29 ms, parse 70 ms, sort 2 ms, write 278 ms, index 34 ms: 0 candidates, 2621 repo-hours, 96 releases; waiting 183 ms; commit 563 ms)
2026-11-07T03:30:17Z [load_day 2026-10-22] 2026-10-22 hour 21: 2845 events in 1 files, snapshot 4825121005741705396 (task 1324 ms: download 692 ms overlapping gunzip 34 ms, parse 92 ms, sort 3 ms, write 261 ms, index 34 ms: 0 candidates, 2626 repo-hours, 129 releases; waiting 575 ms; commit 522 ms)
2026-11-07T03:30:18Z [load_day 2026-10-22] 2026-10-22 hour 22: 3111 events in 1 files, snapshot 9081575585264287105 (task 1328 ms: download 697 ms overlapping gunzip 40 ms, parse 112 ms, sort 3 ms, write 273 ms, index 47 ms: 1 candidates, 2751 repo-hours, 110 releases; waiting 555 ms; commit 483 ms)
2026-11-07T03:30:19Z [load_day 2026-10-22] 2026-10-22 hour 23: 3015 events in 1 files, snapshot 1822922361302237796 (task 1321 ms: download 703 ms overlapping gunzip 38 ms, parse 120 ms, sort 3 ms, write 277 ms, index 34 ms: 0 candidates, 2691 repo-hours, 109 releases; waiting 556 ms; commit 621 ms)
2026-11-07T03:30:22Z [load_day 2026-10-22] 2026-10-22: repo_hour merged from 24 files to 1 (592786 rows, 3164 ms)
2026-11-07T03:30:24Z [load_day 2026-10-22] 2026-10-22: index committed in 4370 ms (21 + 1 + 24 files)
2026-11-07T03:30:24Z [load_day 2026-10-22] 2026-10-22: 850526 events in 24 hours
2026-11-07T03:30:24Z [load_day 2026-10-22] attempt 1 succeeded