orcaLog in

Runs · run 587

load_day 2026-05-06, attempt 1 succeeded

Host
4e84322b8c45:131609
Started
2026-11-07T06:40:10Z
Ended
2026-11-07T06:41:27Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/587/load_day/2026-05-06/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:40:10Z [load_day 2026-05-06] attempt 1 started
2026-11-07T06:40:19Z [load_day 2026-05-06] 2026-05-06 hour 0: 149878 events in 3 files, snapshot 8723572959636830670 (task 5368 ms: download 2361 ms overlapping gunzip 348 ms, parse 1216 ms, sort 218 ms, write 2172 ms, index 444 ms: 4 candidates, 69313 repo-hours, 593 releases; waiting 531 ms; commit 1020 ms)
2026-11-07T06:40:20Z [load_day 2026-05-06] 2026-05-06 hour 1: 153239 events in 4 files, snapshot 555305217543677225 (task 4807 ms: download 1420 ms overlapping gunzip 309 ms, parse 1057 ms, sort 142 ms, write 2213 ms, index 523 ms: 9 candidates, 79782 repo-hours, 376 releases; waiting 264 ms; commit 1044 ms)
2026-11-07T06:40:24Z [load_day 2026-05-06] 2026-05-06 hour 2: 155963 events in 4 files, snapshot 3037697149522607120 (task 4437 ms: download 1641 ms overlapping gunzip 270 ms, parse 892 ms, sort 118 ms, write 1733 ms, index 555 ms: 5 candidates, 85556 repo-hours, 220 releases; waiting 526 ms; commit 982 ms)
2026-11-07T06:40:25Z [load_day 2026-05-06] 2026-05-06 hour 3: 153281 events in 4 files, snapshot 7131471864130568772 (task 3964 ms: download 1009 ms overlapping gunzip 231 ms, parse 856 ms, sort 106 ms, write 1781 ms, index 495 ms: 5 candidates, 73823 repo-hours, 235 releases; waiting 205 ms; commit 1061 ms)
2026-11-07T06:40:30Z [load_day 2026-05-06] 2026-05-06 hour 4: 144502 events in 3 files, snapshot 5247713097935401535 (task 5550 ms: download 1971 ms overlapping gunzip 399 ms, parse 1242 ms, sort 181 ms, write 2318 ms, index 509 ms: 7 candidates, 71877 repo-hours, 629 releases; waiting 581 ms; commit 1225 ms)
2026-11-07T06:40:32Z [load_day 2026-05-06] 2026-05-06 hour 5: 148087 events in 3 files, snapshot 2375178902678396611 (task 5384 ms: download 2094 ms overlapping gunzip 350 ms, parse 1116 ms, sort 134 ms, write 2400 ms, index 499 ms: 7 candidates, 76072 repo-hours, 602 releases; waiting 601 ms; commit 1192 ms)
2026-11-07T06:40:36Z [load_day 2026-05-06] 2026-05-06 hour 6: 149360 events in 3 files, snapshot 5112625275209654286 (task 4759 ms: download 2346 ms overlapping gunzip 281 ms, parse 922 ms, sort 101 ms, write 2010 ms, index 522 ms: 6 candidates, 80414 repo-hours, 346 releases; waiting 597 ms; commit 1147 ms)
2026-11-07T06:40:37Z [load_day 2026-05-06] 2026-05-06 hour 7: 149781 events in 3 files, snapshot 1117652511398849596 (task 4427 ms: download 1675 ms overlapping gunzip 263 ms, parse 860 ms, sort 155 ms, write 1791 ms, index 515 ms: 8 candidates, 82519 repo-hours, 229 releases; waiting 522 ms; commit 1293 ms)
2026-11-07T06:40:40Z [load_day 2026-05-06] 2026-05-06 hour 8: 153770 events in 4 files, snapshot 4082941391462101517 (task 4189 ms: download 1508 ms overlapping gunzip 252 ms, parse 874 ms, sort 106 ms, write 1584 ms, index 553 ms: 7 candidates, 84799 repo-hours, 199 releases; waiting 529 ms; commit 1086 ms)
2026-11-07T06:40:42Z [load_day 2026-05-06] 2026-05-06 hour 9: 149944 events in 3 files, snapshot 898392495441628802 (task 4127 ms: download 1443 ms overlapping gunzip 237 ms, parse 819 ms, sort 107 ms, write 1412 ms, index 539 ms: 3 candidates, 77045 repo-hours, 115 releases; waiting 518 ms; commit 1108 ms)
2026-11-07T06:40:46Z [load_day 2026-05-06] 2026-05-06 hour 10: 153649 events in 4 files, snapshot 1190819420168657626 (task 4379 ms: download 1874 ms overlapping gunzip 241 ms, parse 848 ms, sort 105 ms, write 1776 ms, index 573 ms: 6 candidates, 82178 repo-hours, 219 releases; waiting 526 ms; commit 1228 ms)
2026-11-07T06:40:47Z [load_day 2026-05-06] 2026-05-06 hour 11: 151878 events in 4 files, snapshot 8857362431880454326 (task 4194 ms: download 1533 ms overlapping gunzip 253 ms, parse 854 ms, sort 108 ms, write 1601 ms, index 548 ms: 8 candidates, 83868 repo-hours, 155 releases; waiting 526 ms; commit 1288 ms)
2026-11-07T06:40:50Z [load_day 2026-05-06] 2026-05-06 hour 12: 149583 events in 3 files, snapshot 4632676215878479096 (task 3298 ms: download 410 ms overlapping gunzip 208 ms, parse 728 ms, sort 102 ms, write 1472 ms, index 577 ms: 6 candidates, 85341 repo-hours, 105 releases; waiting 18 ms; commit 1143 ms)
2026-11-07T06:40:52Z [load_day 2026-05-06] 2026-05-06 hour 13: 147978 events in 3 files, snapshot 2832984644046459360 (task 3966 ms: download 1410 ms overlapping gunzip 222 ms, parse 810 ms, sort 120 ms, write 1295 ms, index 692 ms: 6 candidates, 89524 repo-hours, 84 releases; waiting 524 ms; commit 1121 ms)
2026-11-07T06:40:54Z [load_day 2026-05-06] 2026-05-06 hour 14: 147986 events in 3 files, snapshot 6659156419698209630 (task 3749 ms: download 1400 ms overlapping gunzip 199 ms, parse 717 ms, sort 97 ms, write 1348 ms, index 586 ms: 8 candidates, 88349 repo-hours, 74 releases; waiting 522 ms; commit 1205 ms)
2026-11-07T06:40:56Z [load_day 2026-05-06] 2026-05-06 hour 15: 152894 events in 4 files, snapshot 4176468104744601245 (task 3919 ms: download 1485 ms overlapping gunzip 208 ms, parse 772 ms, sort 97 ms, write 1380 ms, index 623 ms: 8 candidates, 81541 repo-hours, 67 releases; waiting 531 ms; commit 1160 ms)
2026-11-07T06:40:59Z [load_day 2026-05-06] 2026-05-06 hour 16: 155975 events in 4 files, snapshot 1461726415885529635 (task 4052 ms: download 1340 ms overlapping gunzip 215 ms, parse 766 ms, sort 99 ms, write 1432 ms, index 699 ms: 10 candidates, 85123 repo-hours, 98 releases; waiting 522 ms; commit 1278 ms)
2026-11-07T06:41:01Z [load_day 2026-05-06] 2026-05-06 hour 17: 155918 events in 4 files, snapshot 2475449506915158567 (task 4124 ms: download 1458 ms overlapping gunzip 207 ms, parse 777 ms, sort 106 ms, write 1442 ms, index 587 ms: 7 candidates, 84413 repo-hours, 83 releases; waiting 553 ms; commit 1305 ms)
2026-11-07T06:41:04Z [load_day 2026-05-06] 2026-05-06 hour 18: 152875 events in 4 files, snapshot 9109903968469396431 (task 4234 ms: download 1930 ms overlapping gunzip 228 ms, parse 791 ms, sort 117 ms, write 1639 ms, index 535 ms: 6 candidates, 79327 repo-hours, 125 releases; waiting 610 ms; commit 1325 ms)
2026-11-07T06:41:06Z [load_day 2026-05-06] 2026-05-06 hour 19: 156248 events in 4 files, snapshot 8727395142473384106 (task 4161 ms: download 1701 ms overlapping gunzip 239 ms, parse 852 ms, sort 103 ms, write 1610 ms, index 537 ms: 12 candidates, 83176 repo-hours, 143 releases; waiting 515 ms; commit 1208 ms)
2026-11-07T06:41:09Z [load_day 2026-05-06] 2026-05-06 hour 20: 153419 events in 4 files, snapshot 1813743429143719847 (task 3930 ms: download 1063 ms overlapping gunzip 230 ms, parse 800 ms, sort 98 ms, write 1576 ms, index 629 ms: 3 candidates, 77749 repo-hours, 170 releases; waiting 265 ms; commit 1546 ms)
2026-11-07T06:41:11Z [load_day 2026-05-06] 2026-05-06 hour 21: 152473 events in 4 files, snapshot 8725955040149723948 (task 4486 ms: download 1603 ms overlapping gunzip 251 ms, parse 876 ms, sort 104 ms, write 1785 ms, index 578 ms: 4 candidates, 78510 repo-hours, 246 releases; waiting 543 ms; commit 1025 ms)
2026-11-07T06:41:15Z [load_day 2026-05-06] 2026-05-06 hour 22: 148745 events in 3 files, snapshot 8893849316512597260 (task 4976 ms: download 1801 ms overlapping gunzip 301 ms, parse 1011 ms, sort 121 ms, write 2012 ms, index 471 ms: 10 candidates, 73303 repo-hours, 474 releases; waiting 615 ms; commit 1413 ms)
2026-11-07T06:41:17Z [load_day 2026-05-06] 2026-05-06 hour 23: 147007 events in 3 files, snapshot 1192804091085872664 (task 5303 ms: download 2583 ms overlapping gunzip 374 ms, parse 1188 ms, sort 142 ms, write 2094 ms, index 460 ms: 4 candidates, 73339 repo-hours, 576 releases; waiting 682 ms; commit 1193 ms)
2026-11-07T06:41:25Z [load_day 2026-05-06] 2026-05-06: repo_hour merged from 24 files to 1 (1926941 rows, 7903 ms)
2026-11-07T06:41:27Z [load_day 2026-05-06] 2026-05-06: index committed in 9859 ms (24 + 1 + 24 files)
2026-11-07T06:41:27Z [load_day 2026-05-06] 2026-05-06: 3634433 events in 24 hours
2026-11-07T06:41:27Z [load_day 2026-05-06] attempt 1 succeeded