orcaLog in

Runs · run 608

load_day 2026-04-29, attempt 1 succeeded

Host
4e84322b8c45:137071
Started
2026-11-07T06:53:46Z
Ended
2026-11-07T06:55:05Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/608/load_day/2026-04-29/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:53:46Z [load_day 2026-04-29] attempt 1 started
2026-11-07T06:53:56Z [load_day 2026-04-29] 2026-04-29 hour 0: 149202 events in 3 files, snapshot 6754876037775588100 (task 6289 ms: download 2074 ms overlapping gunzip 366 ms, parse 1243 ms, sort 146 ms, write 3050 ms, index 457 ms: 41 candidates, 72258 repo-hours, 709 releases; waiting 516 ms; commit 1159 ms)
2026-11-07T06:53:57Z [load_day 2026-04-29] 2026-04-29 hour 1: 149874 events in 3 files, snapshot 9059020280318499336 (task 5939 ms: download 1913 ms overlapping gunzip 342 ms, parse 1177 ms, sort 158 ms, write 2971 ms, index 478 ms: 10 candidates, 76230 repo-hours, 601 releases; waiting 514 ms; commit 1200 ms)
2026-11-07T06:54:01Z [load_day 2026-04-29] 2026-04-29 hour 2: 158224 events in 4 files, snapshot 9155189201180941180 (task 4557 ms: download 1525 ms overlapping gunzip 276 ms, parse 927 ms, sort 116 ms, write 1845 ms, index 546 ms: 6 candidates, 91376 repo-hours, 318 releases; waiting 528 ms; commit 1243 ms)
2026-11-07T06:54:02Z [load_day 2026-04-29] 2026-04-29 hour 3: 159944 events in 4 files, snapshot 2233947087322734357 (task 3678 ms: download 942 ms overlapping gunzip 207 ms, parse 801 ms, sort 119 ms, write 1533 ms, index 488 ms: 8 candidates, 73827 repo-hours, 156 releases; waiting 224 ms; commit 1199 ms)
2026-11-07T06:54:06Z [load_day 2026-04-29] 2026-04-29 hour 4: 157621 events in 4 files, snapshot 4935898127596407164 (task 4645 ms: download 1538 ms overlapping gunzip 311 ms, parse 1041 ms, sort 128 ms, write 1901 ms, index 483 ms: 6 candidates, 65993 repo-hours, 363 releases; waiting 508 ms; commit 1160 ms)
2026-11-07T06:54:08Z [load_day 2026-04-29] 2026-04-29 hour 5: 149611 events in 3 files, snapshot 7910977830449950782 (task 5289 ms: download 1772 ms overlapping gunzip 379 ms, parse 1200 ms, sort 132 ms, write 2200 ms, index 504 ms: 7 candidates, 75597 repo-hours, 525 releases; waiting 512 ms; commit 1391 ms)
2026-11-07T06:54:12Z [load_day 2026-04-29] 2026-04-29 hour 6: 155685 events in 4 files, snapshot 1851291211630793975 (task 5101 ms: download 2288 ms overlapping gunzip 299 ms, parse 1007 ms, sort 118 ms, write 2272 ms, index 591 ms: 13 candidates, 81344 repo-hours, 405 releases; waiting 551 ms; commit 1211 ms)
2026-11-07T06:54:14Z [load_day 2026-04-29] 2026-04-29 hour 7: 155578 events in 4 files, snapshot 7578802876668960554 (task 4768 ms: download 1946 ms overlapping gunzip 262 ms, parse 882 ms, sort 122 ms, write 2024 ms, index 626 ms: 6 candidates, 83368 repo-hours, 247 releases; waiting 537 ms; commit 1062 ms)
2026-11-07T06:54:17Z [load_day 2026-04-29] 2026-04-29 hour 8: 155742 events in 4 files, snapshot 4002470267167372874 (task 4241 ms: download 1546 ms overlapping gunzip 241 ms, parse 813 ms, sort 112 ms, write 1793 ms, index 542 ms: 7 candidates, 83598 repo-hours, 168 releases; waiting 529 ms; commit 1175 ms)
2026-11-07T06:54:18Z [load_day 2026-04-29] 2026-04-29 hour 9: 155031 events in 4 files, snapshot 3925921206966143307 (task 3780 ms: download 1297 ms overlapping gunzip 199 ms, parse 798 ms, sort 167 ms, write 1423 ms, index 504 ms: 11 candidates, 71525 repo-hours, 93 releases; waiting 402 ms; commit 1066 ms)
2026-11-07T06:54:22Z [load_day 2026-04-29] 2026-04-29 hour 10: 154976 events in 4 files, snapshot 5688563792714493699 (task 4461 ms: download 1454 ms overlapping gunzip 216 ms, parse 850 ms, sort 113 ms, write 1563 ms, index 689 ms: 8 candidates, 79136 repo-hours, 87 releases; waiting 599 ms; commit 1210 ms)
2026-11-07T06:54:23Z [load_day 2026-04-29] 2026-04-29 hour 11: 157308 events in 4 files, snapshot 5792421640349697061 (task 4154 ms: download 1371 ms overlapping gunzip 220 ms, parse 803 ms, sort 109 ms, write 1668 ms, index 536 ms: 12 candidates, 83053 repo-hours, 126 releases; waiting 543 ms; commit 1141 ms)
2026-11-07T06:54:27Z [load_day 2026-04-29] 2026-04-29 hour 12: 156651 events in 4 files, snapshot 3512229244599113765 (task 4133 ms: download 1382 ms overlapping gunzip 234 ms, parse 813 ms, sort 111 ms, write 1538 ms, index 582 ms: 4 candidates, 85067 repo-hours, 95 releases; waiting 548 ms; commit 1252 ms)
2026-11-07T06:54:28Z [load_day 2026-04-29] 2026-04-29 hour 13: 155660 events in 4 files, snapshot 5787260209605521129 (task 3986 ms: download 1515 ms overlapping gunzip 206 ms, parse 769 ms, sort 103 ms, write 1508 ms, index 565 ms: 5 candidates, 90183 repo-hours, 73 releases; waiting 546 ms; commit 1043 ms)
2026-11-07T06:54:31Z [load_day 2026-04-29] 2026-04-29 hour 14: 151130 events in 4 files, snapshot 8344544759575211525 (task 3921 ms: download 1267 ms overlapping gunzip 202 ms, parse 731 ms, sort 97 ms, write 1503 ms, index 593 ms: 5 candidates, 88104 repo-hours, 76 releases; waiting 512 ms; commit 1224 ms)
2026-11-07T06:54:33Z [load_day 2026-04-29] 2026-04-29 hour 15: 154587 events in 4 files, snapshot 8110197445440262468 (task 4029 ms: download 1753 ms overlapping gunzip 199 ms, parse 751 ms, sort 110 ms, write 1488 ms, index 528 ms: 7 candidates, 77431 repo-hours, 45 releases; waiting 622 ms; commit 1124 ms)
2026-11-07T06:54:37Z [load_day 2026-04-29] 2026-04-29 hour 16: 157567 events in 4 files, snapshot 5915818378164074743 (task 4084 ms: download 1899 ms overlapping gunzip 210 ms, parse 783 ms, sort 112 ms, write 1587 ms, index 582 ms: 13 candidates, 83696 repo-hours, 86 releases; waiting 538 ms; commit 1714 ms)
2026-11-07T06:54:38Z [load_day 2026-04-29] 2026-04-29 hour 17: 154015 events in 4 files, snapshot 6407810424770744626 (task 4241 ms: download 1332 ms overlapping gunzip 208 ms, parse 765 ms, sort 111 ms, write 1780 ms, index 555 ms: 8 candidates, 81397 repo-hours, 85 releases; waiting 550 ms; commit 1287 ms)
2026-11-07T06:54:42Z [load_day 2026-04-29] 2026-04-29 hour 18: 156999 events in 4 files, snapshot 6213435248605232897 (task 4435 ms: download 1662 ms overlapping gunzip 242 ms, parse 828 ms, sort 124 ms, write 1858 ms, index 567 ms: 12 candidates, 82523 repo-hours, 153 releases; waiting 531 ms; commit 1036 ms)
2026-11-07T06:54:43Z [load_day 2026-04-29] 2026-04-29 hour 19: 156056 events in 4 files, snapshot 1927187600536064576 (task 3935 ms: download 1038 ms overlapping gunzip 251 ms, parse 849 ms, sort 109 ms, write 1685 ms, index 559 ms: 9 candidates, 85913 repo-hours, 125 releases; waiting 185 ms; commit 1191 ms)
2026-11-07T06:54:47Z [load_day 2026-04-29] 2026-04-29 hour 20: 156386 events in 4 files, snapshot 9036233995352735949 (task 4345 ms: download 1160 ms overlapping gunzip 282 ms, parse 953 ms, sort 126 ms, write 1846 ms, index 627 ms: 3 candidates, 81899 repo-hours, 235 releases; waiting 207 ms; commit 1106 ms)
2026-11-07T06:54:49Z [load_day 2026-04-29] 2026-04-29 hour 21: 150207 events in 4 files, snapshot 484308210634887651 (task 5104 ms: download 1598 ms overlapping gunzip 337 ms, parse 1120 ms, sort 127 ms, write 2209 ms, index 513 ms: 10 candidates, 75644 repo-hours, 536 releases; waiting 528 ms; commit 1314 ms)
2026-11-07T06:54:54Z [load_day 2026-04-29] 2026-04-29 hour 22: 147178 events in 3 files, snapshot 4011440620522161667 (task 6079 ms: download 2250 ms overlapping gunzip 421 ms, parse 1299 ms, sort 145 ms, write 2602 ms, index 646 ms: 7 candidates, 75279 repo-hours, 683 releases; waiting 641 ms; commit 1588 ms)
2026-11-07T06:54:56Z [load_day 2026-04-29] 2026-04-29 hour 23: 147586 events in 3 files, snapshot 3461143237449704646 (task 6159 ms: download 2151 ms overlapping gunzip 457 ms, parse 1480 ms, sort 131 ms, write 2728 ms, index 469 ms: 9 candidates, 73880 repo-hours, 882 releases; waiting 551 ms; commit 1120 ms)
2026-11-07T06:55:04Z [load_day 2026-04-29] 2026-04-29: repo_hour merged from 24 files to 1 (1918321 rows, 7900 ms)
2026-11-07T06:55:05Z [load_day 2026-04-29] 2026-04-29: index committed in 9548 ms (24 + 1 + 24 files)
2026-11-07T06:55:05Z [load_day 2026-04-29] 2026-04-29: 3702818 events in 24 hours
2026-11-07T06:55:05Z [load_day 2026-04-29] attempt 1 succeeded