orcaLog in

Runs · run 563

load_day 2026-05-14, attempt 1 succeeded

Host
4e84322b8c45:125357
Started
2026-11-07T06:29:37Z
Ended
2026-11-07T06:30:55Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/563/load_day/2026-05-14/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:29:37Z [load_day 2026-05-14] attempt 1 started
2026-11-07T06:29:45Z [load_day 2026-05-14] 2026-05-14 hour 0: 149306 events in 3 files, snapshot 4323254713733369473 (task 5006 ms: download 1486 ms overlapping gunzip 308 ms, parse 1092 ms, sort 128 ms, write 2299 ms, index 458 ms: 6 candidates, 69254 repo-hours, 497 releases; waiting 361 ms; commit 1211 ms)
2026-11-07T06:29:47Z [load_day 2026-05-14] 2026-05-14 hour 1: 152134 events in 4 files, snapshot 8846620116728958326 (task 5155 ms: download 2264 ms overlapping gunzip 295 ms, parse 1014 ms, sort 196 ms, write 2043 ms, index 489 ms: 4 candidates, 76185 repo-hours, 412 releases; waiting 763 ms; commit 1245 ms)
2026-11-07T06:29:50Z [load_day 2026-05-14] 2026-05-14 hour 2: 154518 events in 4 files, snapshot 6361095996842932635 (task 4444 ms: download 1802 ms overlapping gunzip 245 ms, parse 842 ms, sort 154 ms, write 1801 ms, index 520 ms: 5 candidates, 86608 repo-hours, 242 releases; waiting 531 ms; commit 1109 ms)
2026-11-07T06:29:52Z [load_day 2026-05-14] 2026-05-14 hour 3: 151995 events in 4 files, snapshot 2606743002808881897 (task 4812 ms: download 1515 ms overlapping gunzip 284 ms, parse 942 ms, sort 105 ms, write 1966 ms, index 510 ms: 9 candidates, 82069 repo-hours, 339 releases; waiting 380 ms; commit 1345 ms)
2026-11-07T06:29:57Z [load_day 2026-05-14] 2026-05-14 hour 4: 150494 events in 4 files, snapshot 175407416570830914 (task 4654 ms: download 1101 ms overlapping gunzip 292 ms, parse 969 ms, sort 174 ms, write 2136 ms, index 569 ms: 7 candidates, 75483 repo-hours, 554 releases; waiting 207 ms; commit 2290 ms)
2026-11-07T06:29:58Z [load_day 2026-05-14] 2026-05-14 hour 5: 148458 events in 3 files, snapshot 399814708800276910 (task 4836 ms: download 1582 ms overlapping gunzip 288 ms, parse 974 ms, sort 118 ms, write 2111 ms, index 491 ms: 7 candidates, 75222 repo-hours, 464 releases; waiting 536 ms; commit 1202 ms)
2026-11-07T06:30:03Z [load_day 2026-05-14] 2026-05-14 hour 6: 152644 events in 4 files, snapshot 2730790537940630240 (task 4856 ms: download 1312 ms overlapping gunzip 275 ms, parse 938 ms, sort 124 ms, write 2237 ms, index 561 ms: 4 candidates, 80871 repo-hours, 383 releases; waiting 418 ms; commit 1304 ms)
2026-11-07T06:30:04Z [load_day 2026-05-14] 2026-05-14 hour 7: 151994 events in 4 files, snapshot 98476806827303901 (task 4681 ms: download 1563 ms overlapping gunzip 244 ms, parse 835 ms, sort 108 ms, write 2111 ms, index 539 ms: 10 candidates, 81529 repo-hours, 253 releases; waiting 541 ms; commit 1152 ms)
2026-11-07T06:30:08Z [load_day 2026-05-14] 2026-05-14 hour 8: 151549 events in 4 files, snapshot 4281146388083894181 (task 4185 ms: download 1229 ms overlapping gunzip 221 ms, parse 774 ms, sort 103 ms, write 1614 ms, index 672 ms: 6 candidates, 83523 repo-hours, 126 releases; waiting 537 ms; commit 1200 ms)
2026-11-07T06:30:09Z [load_day 2026-05-14] 2026-05-14 hour 9: 154134 events in 4 files, snapshot 4396966780389886059 (task 4259 ms: download 1028 ms overlapping gunzip 243 ms, parse 856 ms, sort 111 ms, write 1710 ms, index 527 ms: 7 candidates, 79904 repo-hours, 159 releases; waiting 204 ms; commit 1223 ms)
2026-11-07T06:30:13Z [load_day 2026-05-14] 2026-05-14 hour 10: 154194 events in 4 files, snapshot 8925756129373176532 (task 4041 ms: download 1482 ms overlapping gunzip 236 ms, parse 818 ms, sort 152 ms, write 1546 ms, index 545 ms: 5 candidates, 83471 repo-hours, 139 releases; waiting 536 ms; commit 1362 ms)
2026-11-07T06:30:14Z [load_day 2026-05-14] 2026-05-14 hour 11: 159025 events in 4 files, snapshot 2006489193319011983 (task 4509 ms: download 1517 ms overlapping gunzip 224 ms, parse 793 ms, sort 103 ms, write 1713 ms, index 538 ms: 7 candidates, 85508 repo-hours, 138 releases; waiting 548 ms; commit 1154 ms)
2026-11-07T06:30:17Z [load_day 2026-05-14] 2026-05-14 hour 12: 156924 events in 4 files, snapshot 4674915406582597287 (task 4061 ms: download 1531 ms overlapping gunzip 216 ms, parse 778 ms, sort 98 ms, write 1524 ms, index 605 ms: 6 candidates, 85444 repo-hours, 106 releases; waiting 533 ms; commit 1027 ms)
2026-11-07T06:30:19Z [load_day 2026-05-14] 2026-05-14 hour 13: 163100 events in 4 files, snapshot 2073267688752514481 (task 4096 ms: download 1252 ms overlapping gunzip 210 ms, parse 759 ms, sort 100 ms, write 1668 ms, index 602 ms: 7 candidates, 92923 repo-hours, 73 releases; waiting 544 ms; commit 1160 ms)
2026-11-07T06:30:22Z [load_day 2026-05-14] 2026-05-14 hour 14: 153921 events in 4 files, snapshot 1151338157732170784 (task 3974 ms: download 1474 ms overlapping gunzip 235 ms, parse 784 ms, sort 105 ms, write 1414 ms, index 634 ms: 2 candidates, 90548 repo-hours, 56 releases; waiting 509 ms; commit 1207 ms)
2026-11-07T06:30:23Z [load_day 2026-05-14] 2026-05-14 hour 15: 156737 events in 4 files, snapshot 5421601323416189198 (task 3974 ms: download 1219 ms overlapping gunzip 224 ms, parse 842 ms, sort 119 ms, write 1499 ms, index 567 ms: 8 candidates, 83080 repo-hours, 91 releases; waiting 515 ms; commit 1185 ms)
2026-11-07T06:30:27Z [load_day 2026-05-14] 2026-05-14 hour 16: 156819 events in 4 files, snapshot 8657848817601608809 (task 4093 ms: download 1541 ms overlapping gunzip 211 ms, parse 786 ms, sort 105 ms, write 1570 ms, index 565 ms: 5 candidates, 81557 repo-hours, 63 releases; waiting 537 ms; commit 1059 ms)
2026-11-07T06:30:28Z [load_day 2026-05-14] 2026-05-14 hour 17: 150497 events in 4 files, snapshot 1031700316488518798 (task 3948 ms: download 1568 ms overlapping gunzip 228 ms, parse 801 ms, sort 98 ms, write 1445 ms, index 547 ms: 4 candidates, 82657 repo-hours, 100 releases; waiting 520 ms; commit 1049 ms)
2026-11-07T06:30:32Z [load_day 2026-05-14] 2026-05-14 hour 18: 155047 events in 4 files, snapshot 582325971772572374 (task 4350 ms: download 2135 ms overlapping gunzip 237 ms, parse 839 ms, sort 112 ms, write 1642 ms, index 545 ms: 4 candidates, 82144 repo-hours, 89 releases; waiting 522 ms; commit 1081 ms)
2026-11-07T06:30:33Z [load_day 2026-05-14] 2026-05-14 hour 19: 157112 events in 4 files, snapshot 4556466770330985306 (task 4145 ms: download 1501 ms overlapping gunzip 231 ms, parse 798 ms, sort 109 ms, write 1628 ms, index 541 ms: 6 candidates, 83271 repo-hours, 105 releases; waiting 535 ms; commit 1242 ms)
2026-11-07T06:30:37Z [load_day 2026-05-14] 2026-05-14 hour 20: 155954 events in 4 files, snapshot 2012254088201515419 (task 4649 ms: download 1366 ms overlapping gunzip 236 ms, parse 822 ms, sort 111 ms, write 2051 ms, index 547 ms: 8 candidates, 78781 repo-hours, 166 releases; waiting 544 ms; commit 1039 ms)
2026-11-07T06:30:38Z [load_day 2026-05-14] 2026-05-14 hour 21: 152773 events in 4 files, snapshot 2176762180142620567 (task 4476 ms: download 1388 ms overlapping gunzip 252 ms, parse 875 ms, sort 116 ms, write 1946 ms, index 520 ms: 8 candidates, 79565 repo-hours, 185 releases; waiting 499 ms; commit 1049 ms)
2026-11-07T06:30:44Z [load_day 2026-05-14] 2026-05-14 hour 22: 147737 events in 3 files, snapshot 8881453617107793432 (task 5363 ms: download 1816 ms overlapping gunzip 328 ms, parse 1185 ms, sort 133 ms, write 2130 ms, index 473 ms: 6 candidates, 72171 repo-hours, 461 releases; waiting 591 ms; commit 1943 ms)
2026-11-07T06:30:45Z [load_day 2026-05-14] 2026-05-14 hour 23: 146869 events in 3 files, snapshot 6094872058545889933 (task 5322 ms: download 1694 ms overlapping gunzip 349 ms, parse 1156 ms, sort 130 ms, write 2408 ms, index 451 ms: 14 candidates, 70395 repo-hours, 578 releases; waiting 525 ms; commit 1156 ms)
2026-11-07T06:30:53Z [load_day 2026-05-14] 2026-05-14: repo_hour merged from 24 files to 1 (1942163 rows, 7814 ms)
2026-11-07T06:30:55Z [load_day 2026-05-14] 2026-05-14: index committed in 9794 ms (24 + 1 + 24 files)
2026-11-07T06:30:55Z [load_day 2026-05-14] 2026-05-14: 3683935 events in 24 hours
2026-11-07T06:30:55Z [load_day 2026-05-14] attempt 1 succeeded