orcaLog in

Runs · run 581

load_day 2026-05-08, attempt 1 succeeded

Host
4e84322b8c45:130009
Started
2026-11-07T06:37:37Z
Ended
2026-11-07T06:38:55Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/581/load_day/2026-05-08/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:37:37Z [load_day 2026-05-08] attempt 1 started
2026-11-07T06:37:46Z [load_day 2026-05-08] 2026-05-08 hour 0: 144645 events in 3 files, snapshot 4595324035842505809 (task 6042 ms: download 2483 ms overlapping gunzip 361 ms, parse 1225 ms, sort 158 ms, write 2930 ms, index 454 ms: 8 candidates, 68162 repo-hours, 613 releases; waiting 597 ms; commit 1173 ms)
2026-11-07T06:37:47Z [load_day 2026-05-08] 2026-05-08 hour 1: 150401 events in 4 files, snapshot 4416771541468980022 (task 5972 ms: download 2074 ms overlapping gunzip 351 ms, parse 1237 ms, sort 141 ms, write 2962 ms, index 501 ms: 5 candidates, 76277 repo-hours, 434 releases; waiting 502 ms; commit 999 ms)
2026-11-07T06:37:51Z [load_day 2026-05-08] 2026-05-08 hour 2: 153632 events in 4 files, snapshot 1107000146280912490 (task 4851 ms: download 1576 ms overlapping gunzip 248 ms, parse 894 ms, sort 111 ms, write 2059 ms, index 554 ms: 6 candidates, 88255 repo-hours, 208 releases; waiting 541 ms; commit 1131 ms)
2026-11-07T06:37:53Z [load_day 2026-05-08] 2026-05-08 hour 3: 155310 events in 4 files, snapshot 5525370512066716245 (task 4891 ms: download 1668 ms overlapping gunzip 294 ms, parse 992 ms, sort 124 ms, write 2168 ms, index 509 ms: 5 candidates, 83016 repo-hours, 363 releases; waiting 532 ms; commit 1294 ms)
2026-11-07T06:37:58Z [load_day 2026-05-08] 2026-05-08 hour 4: 147995 events in 3 files, snapshot 5749998891451355276 (task 5493 ms: download 1763 ms overlapping gunzip 324 ms, parse 1088 ms, sort 145 ms, write 2561 ms, index 473 ms: 5 candidates, 71226 repo-hours, 624 releases; waiting 599 ms; commit 1178 ms)
2026-11-07T06:37:59Z [load_day 2026-05-08] 2026-05-08 hour 5: 151629 events in 4 files, snapshot 7928648310859123358 (task 5307 ms: download 1779 ms overlapping gunzip 297 ms, parse 1003 ms, sort 115 ms, write 2344 ms, index 490 ms: 5 candidates, 77631 repo-hours, 507 releases; waiting 548 ms; commit 1185 ms)
2026-11-07T06:38:03Z [load_day 2026-05-08] 2026-05-08 hour 6: 157498 events in 4 files, snapshot 8099755933325586549 (task 4544 ms: download 1494 ms overlapping gunzip 238 ms, parse 831 ms, sort 105 ms, write 1861 ms, index 546 ms: 6 candidates, 80097 repo-hours, 170 releases; waiting 532 ms; commit 1138 ms)
2026-11-07T06:38:04Z [load_day 2026-05-08] 2026-05-08 hour 7: 151259 events in 4 files, snapshot 2803919507871289947 (task 4252 ms: download 2005 ms overlapping gunzip 214 ms, parse 784 ms, sort 119 ms, write 1730 ms, index 521 ms: 7 candidates, 81737 repo-hours, 140 releases; waiting 523 ms; commit 1052 ms)
2026-11-07T06:38:08Z [load_day 2026-05-08] 2026-05-08 hour 8: 154278 events in 4 files, snapshot 557020527287834201 (task 4543 ms: download 1583 ms overlapping gunzip 246 ms, parse 847 ms, sort 101 ms, write 1872 ms, index 645 ms: 5 candidates, 82277 repo-hours, 138 releases; waiting 557 ms; commit 1046 ms)
2026-11-07T06:38:09Z [load_day 2026-05-08] 2026-05-08 hour 9: 153081 events in 4 files, snapshot 2208266582305416248 (task 4213 ms: download 1479 ms overlapping gunzip 225 ms, parse 800 ms, sort 100 ms, write 1821 ms, index 529 ms: 7 candidates, 81890 repo-hours, 159 releases; waiting 535 ms; commit 1199 ms)
2026-11-07T06:38:13Z [load_day 2026-05-08] 2026-05-08 hour 10: 150016 events in 4 files, snapshot 7525148323199536629 (task 4155 ms: download 1132 ms overlapping gunzip 235 ms, parse 820 ms, sort 103 ms, write 1719 ms, index 524 ms: 5 candidates, 78193 repo-hours, 227 releases; waiting 290 ms; commit 1060 ms)
2026-11-07T06:38:14Z [load_day 2026-05-08] 2026-05-08 hour 11: 156766 events in 4 files, snapshot 7825623497786724714 (task 4241 ms: download 1569 ms overlapping gunzip 230 ms, parse 848 ms, sort 104 ms, write 1597 ms, index 572 ms: 7 candidates, 83060 repo-hours, 108 releases; waiting 526 ms; commit 927 ms)
2026-11-07T06:38:18Z [load_day 2026-05-08] 2026-05-08 hour 12: 152186 events in 4 files, snapshot 984972048838959538 (task 3968 ms: download 1455 ms overlapping gunzip 233 ms, parse 818 ms, sort 98 ms, write 1406 ms, index 611 ms: 7 candidates, 82328 repo-hours, 108 releases; waiting 514 ms; commit 1192 ms)
2026-11-07T06:38:19Z [load_day 2026-05-08] 2026-05-08 hour 13: 154909 events in 4 files, snapshot 3169048949899040932 (task 3978 ms: download 1924 ms overlapping gunzip 220 ms, parse 817 ms, sort 95 ms, write 1405 ms, index 571 ms: 8 candidates, 89489 repo-hours, 40 releases; waiting 483 ms; commit 1005 ms)
2026-11-07T06:38:23Z [load_day 2026-05-08] 2026-05-08 hour 14: 152565 events in 4 files, snapshot 599751297150019659 (task 4543 ms: download 1666 ms overlapping gunzip 225 ms, parse 803 ms, sort 112 ms, write 1650 ms, index 546 ms: 9 candidates, 82809 repo-hours, 71 releases; waiting 967 ms; commit 1097 ms)
2026-11-07T06:38:24Z [load_day 2026-05-08] 2026-05-08 hour 15: 147744 events in 3 files, snapshot 1652931832897104293 (task 4004 ms: download 1484 ms overlapping gunzip 209 ms, parse 744 ms, sort 102 ms, write 1546 ms, index 526 ms: 10 candidates, 78987 repo-hours, 91 releases; waiting 631 ms; commit 1080 ms)
2026-11-07T06:38:27Z [load_day 2026-05-08] 2026-05-08 hour 16: 153839 events in 4 files, snapshot 1006461564705225909 (task 4213 ms: download 1513 ms overlapping gunzip 227 ms, parse 825 ms, sort 107 ms, write 1590 ms, index 576 ms: 7 candidates, 82573 repo-hours, 76 releases; waiting 515 ms; commit 1084 ms)
2026-11-07T06:38:28Z [load_day 2026-05-08] 2026-05-08 hour 17: 157496 events in 4 files, snapshot 8248588189618290544 (task 4202 ms: download 1808 ms overlapping gunzip 241 ms, parse 854 ms, sort 109 ms, write 1560 ms, index 557 ms: 5 candidates, 84137 repo-hours, 95 releases; waiting 543 ms; commit 1020 ms)
2026-11-07T06:38:33Z [load_day 2026-05-08] 2026-05-08 hour 18: 152908 events in 4 files, snapshot 3767648360292527936 (task 4390 ms: download 1763 ms overlapping gunzip 238 ms, parse 863 ms, sort 110 ms, write 1787 ms, index 575 ms: 12 candidates, 78798 repo-hours, 185 releases; waiting 482 ms; commit 1176 ms)
2026-11-07T06:38:34Z [load_day 2026-05-08] 2026-05-08 hour 19: 151980 events in 4 files, snapshot 4089893485261786435 (task 4185 ms: download 1363 ms overlapping gunzip 215 ms, parse 801 ms, sort 131 ms, write 1617 ms, index 541 ms: 7 candidates, 78869 repo-hours, 110 releases; waiting 539 ms; commit 1224 ms)
2026-11-07T06:38:38Z [load_day 2026-05-08] 2026-05-08 hour 20: 156070 events in 4 files, snapshot 4677564504018699222 (task 4607 ms: download 1335 ms overlapping gunzip 287 ms, parse 915 ms, sort 131 ms, write 1816 ms, index 602 ms: 1 candidates, 78298 repo-hours, 187 releases; waiting 539 ms; commit 1283 ms)
2026-11-07T06:38:39Z [load_day 2026-05-08] 2026-05-08 hour 21: 151085 events in 4 files, snapshot 210345256982353298 (task 4677 ms: download 1881 ms overlapping gunzip 327 ms, parse 1040 ms, sort 112 ms, write 1911 ms, index 465 ms: 4 candidates, 71170 repo-hours, 371 releases; waiting 525 ms; commit 1076 ms)
2026-11-07T06:38:44Z [load_day 2026-05-08] 2026-05-08 hour 22: 145850 events in 3 files, snapshot 6865728957357691201 (task 5548 ms: download 2526 ms overlapping gunzip 306 ms, parse 1048 ms, sort 119 ms, write 2296 ms, index 625 ms: 5 candidates, 69655 repo-hours, 483 releases; waiting 820 ms; commit 1215 ms)
2026-11-07T06:38:45Z [load_day 2026-05-08] 2026-05-08 hour 23: 146809 events in 3 files, snapshot 6654861688347481017 (task 5598 ms: download 1849 ms overlapping gunzip 336 ms, parse 1120 ms, sort 156 ms, write 2522 ms, index 598 ms: 5 candidates, 68726 repo-hours, 633 releases; waiting 535 ms; commit 1066 ms)
2026-11-07T06:38:53Z [load_day 2026-05-08] 2026-05-08: repo_hour merged from 24 files to 1 (1897660 rows, 7794 ms)
2026-11-07T06:38:55Z [load_day 2026-05-08] 2026-05-08: index committed in 9416 ms (24 + 1 + 24 files)
2026-11-07T06:38:55Z [load_day 2026-05-08] 2026-05-08: 3649951 events in 24 hours
2026-11-07T06:38:55Z [load_day 2026-05-08] attempt 1 succeeded