orcaLog in

Runs · run 341

load_day 2026-07-27, attempt 1 succeeded

Host
4e84322b8c45:63027
Started
2026-11-07T04:54:03Z
Ended
2026-11-07T04:55:06Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/341/load_day/2026-07-27/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:54:03Z [load_day 2026-07-27] attempt 1 started
2026-11-07T04:54:10Z [load_day 2026-07-27] 2026-07-27 hour 0: 174872 events in 4 files, snapshot 72422360628727145 (task 3925 ms: download 1454 ms overlapping gunzip 220 ms, parse 851 ms, sort 124 ms, write 1571 ms, index 303 ms: 4 candidates, 48153 repo-hours, 15 releases; waiting 510 ms; commit 972 ms)
2026-11-07T04:54:11Z [load_day 2026-07-27] 2026-07-27 hour 1: 169469 events in 4 files, snapshot 6159861440773522471 (task 3970 ms: download 1611 ms overlapping gunzip 205 ms, parse 817 ms, sort 114 ms, write 1671 ms, index 344 ms: 5 candidates, 55697 repo-hours, 8 releases; waiting 503 ms; commit 881 ms)
2026-11-07T04:54:15Z [load_day 2026-07-27] 2026-07-27 hour 2: 171767 events in 4 files, snapshot 675529197172228695 (task 4008 ms: download 1342 ms overlapping gunzip 206 ms, parse 807 ms, sort 119 ms, write 1625 ms, index 378 ms: 5 candidates, 53521 repo-hours, 21 releases; waiting 566 ms; commit 779 ms)
2026-11-07T04:54:15Z [load_day 2026-07-27] 2026-07-27 hour 3: 171185 events in 4 files, snapshot 8916061846632467243 (task 3746 ms: download 1393 ms overlapping gunzip 199 ms, parse 786 ms, sort 109 ms, write 1521 ms, index 293 ms: 2 candidates, 37822 repo-hours, 10 releases; waiting 526 ms; commit 872 ms)
2026-11-07T04:54:19Z [load_day 2026-07-27] 2026-07-27 hour 4: 167845 events in 4 files, snapshot 6947883537323861211 (task 3736 ms: download 1350 ms overlapping gunzip 211 ms, parse 821 ms, sort 113 ms, write 1505 ms, index 252 ms: 2 candidates, 30420 repo-hours, 27 releases; waiting 521 ms; commit 1028 ms)
2026-11-07T04:54:20Z [load_day 2026-07-27] 2026-07-27 hour 5: 172477 events in 4 files, snapshot 7426042942297165312 (task 3633 ms: download 1253 ms overlapping gunzip 194 ms, parse 756 ms, sort 102 ms, write 1566 ms, index 205 ms: 3 candidates, 30365 repo-hours, 11 releases; waiting 511 ms; commit 826 ms)
2026-11-07T04:54:23Z [load_day 2026-07-27] 2026-07-27 hour 6: 166058 events in 4 files, snapshot 7842390681180798426 (task 3679 ms: download 1341 ms overlapping gunzip 210 ms, parse 810 ms, sort 105 ms, write 1506 ms, index 201 ms: 1 candidates, 31719 repo-hours, 17 releases; waiting 521 ms; commit 933 ms)
2026-11-07T04:54:24Z [load_day 2026-07-27] 2026-07-27 hour 7: 166086 events in 4 files, snapshot 2509106470106027210 (task 3540 ms: download 1292 ms overlapping gunzip 197 ms, parse 749 ms, sort 98 ms, write 1405 ms, index 223 ms: 1 candidates, 29889 repo-hours, 18 releases; waiting 520 ms; commit 909 ms)
2026-11-07T04:54:28Z [load_day 2026-07-27] 2026-07-27 hour 8: 168565 events in 4 files, snapshot 7280638290848559516 (task 3531 ms: download 1158 ms overlapping gunzip 200 ms, parse 807 ms, sort 106 ms, write 1500 ms, index 198 ms: 2 candidates, 31158 repo-hours, 8 releases; waiting 516 ms; commit 968 ms)
2026-11-07T04:54:29Z [load_day 2026-07-27] 2026-07-27 hour 9: 165410 events in 4 files, snapshot 7727240356470823024 (task 3442 ms: download 1237 ms overlapping gunzip 198 ms, parse 777 ms, sort 97 ms, write 1385 ms, index 234 ms: 3 candidates, 31269 repo-hours, 14 releases; waiting 538 ms; commit 849 ms)
2026-11-07T04:54:32Z [load_day 2026-07-27] 2026-07-27 hour 10: 165073 events in 4 files, snapshot 996130757234543357 (task 3601 ms: download 1278 ms overlapping gunzip 202 ms, parse 768 ms, sort 101 ms, write 1487 ms, index 223 ms: 2 candidates, 31653 repo-hours, 13 releases; waiting 528 ms; commit 942 ms)
2026-11-07T04:54:33Z [load_day 2026-07-27] 2026-07-27 hour 11: 163792 events in 4 files, snapshot 3993237525484914027 (task 3245 ms: download 887 ms overlapping gunzip 183 ms, parse 730 ms, sort 99 ms, write 1522 ms, index 239 ms: 1 candidates, 33114 repo-hours, 11 releases; waiting 183 ms; commit 1390 ms)
2026-11-07T04:54:36Z [load_day 2026-07-27] 2026-07-27 hour 12: 162731 events in 4 files, snapshot 8064722032913836087 (task 3442 ms: download 1262 ms overlapping gunzip 195 ms, parse 741 ms, sort 97 ms, write 1400 ms, index 237 ms: 2 candidates, 35158 repo-hours, 16 releases; waiting 540 ms; commit 863 ms)
2026-11-07T04:54:37Z [load_day 2026-07-27] 2026-07-27 hour 13: 166079 events in 4 files, snapshot 3387424537774711877 (task 3579 ms: download 1368 ms overlapping gunzip 206 ms, parse 753 ms, sort 101 ms, write 1468 ms, index 242 ms: 1 candidates, 33461 repo-hours, 16 releases; waiting 527 ms; commit 826 ms)
2026-11-07T04:54:41Z [load_day 2026-07-27] 2026-07-27 hour 14: 161074 events in 4 files, snapshot 2530032911708447253 (task 3796 ms: download 1407 ms overlapping gunzip 189 ms, parse 722 ms, sort 102 ms, write 1605 ms, index 269 ms: 3 candidates, 39610 repo-hours, 7 releases; waiting 514 ms; commit 963 ms)
2026-11-07T04:54:41Z [load_day 2026-07-27] 2026-07-27 hour 15: 157849 events in 4 files, snapshot 4190766320099339199 (task 3703 ms: download 1402 ms overlapping gunzip 200 ms, parse 748 ms, sort 100 ms, write 1500 ms, index 269 ms: 2 candidates, 41050 repo-hours, 35 releases; waiting 565 ms; commit 786 ms)
2026-11-07T04:54:45Z [load_day 2026-07-27] 2026-07-27 hour 16: 170014 events in 4 files, snapshot 538398650125930063 (task 3388 ms: download 933 ms overlapping gunzip 186 ms, parse 723 ms, sort 103 ms, write 1583 ms, index 299 ms: 5 candidates, 42535 repo-hours, 15 releases; waiting 178 ms; commit 987 ms)
2026-11-07T04:54:46Z [load_day 2026-07-27] 2026-07-27 hour 17: 165464 events in 4 files, snapshot 5774864964838557749 (task 4028 ms: download 1283 ms overlapping gunzip 205 ms, parse 774 ms, sort 116 ms, write 1618 ms, index 314 ms: 3 candidates, 47918 repo-hours, 18 releases; waiting 540 ms; commit 919 ms)
2026-11-07T04:54:49Z [load_day 2026-07-27] 2026-07-27 hour 18: 163067 events in 4 files, snapshot 6722781558422676076 (task 3831 ms: download 2138 ms overlapping gunzip 210 ms, parse 797 ms, sort 98 ms, write 1551 ms, index 309 ms: 4 candidates, 47691 repo-hours, 8 releases; waiting 524 ms; commit 812 ms)
2026-11-07T04:54:50Z [load_day 2026-07-27] 2026-07-27 hour 19: 162876 events in 4 files, snapshot 2906758266124326937 (task 3793 ms: download 1199 ms overlapping gunzip 205 ms, parse 788 ms, sort 113 ms, write 1593 ms, index 355 ms: 2 candidates, 53898 repo-hours, 12 releases; waiting 520 ms; commit 917 ms)
2026-11-07T04:54:54Z [load_day 2026-07-27] 2026-07-27 hour 20: 168265 events in 4 files, snapshot 706403549421357921 (task 3859 ms: download 1362 ms overlapping gunzip 214 ms, parse 791 ms, sort 113 ms, write 1555 ms, index 399 ms: 3 candidates, 53584 repo-hours, 12 releases; waiting 532 ms; commit 1008 ms)
2026-11-07T04:54:55Z [load_day 2026-07-27] 2026-07-27 hour 21: 167163 events in 4 files, snapshot 6297266763119547503 (task 3774 ms: download 1434 ms overlapping gunzip 209 ms, parse 772 ms, sort 101 ms, write 1503 ms, index 334 ms: 4 candidates, 52388 repo-hours, 16 releases; waiting 515 ms; commit 871 ms)
2026-11-07T04:54:58Z [load_day 2026-07-27] 2026-07-27 hour 22: 166669 events in 4 files, snapshot 2056196220898517281 (task 3701 ms: download 1458 ms overlapping gunzip 208 ms, parse 797 ms, sort 106 ms, write 1443 ms, index 336 ms: 3 candidates, 52967 repo-hours, 18 releases; waiting 515 ms; commit 948 ms)
2026-11-07T04:54:59Z [load_day 2026-07-27] 2026-07-27 hour 23: 166467 events in 4 files, snapshot 7805854683692384168 (task 3802 ms: download 1519 ms overlapping gunzip 206 ms, parse 789 ms, sort 110 ms, write 1485 ms, index 343 ms: 3 candidates, 53095 repo-hours, 19 releases; waiting 533 ms; commit 1021 ms)
2026-11-07T04:55:04Z [load_day 2026-07-27] 2026-07-27: repo_hour merged from 24 files to 1 (998135 rows, 4677 ms)
2026-11-07T04:55:06Z [load_day 2026-07-27] 2026-07-27: index committed in 6465 ms (24 + 1 + 24 files)
2026-11-07T04:55:06Z [load_day 2026-07-27] 2026-07-27: 4000317 events in 24 hours
2026-11-07T04:55:06Z [load_day 2026-07-27] attempt 1 succeeded