orcaLog in

Runs · run 479

load_day 2026-06-11, attempt 1 succeeded

Host
4e84322b8c45:102670
Started
2026-11-07T05:53:50Z
Ended
2026-11-07T05:55:26Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/479/load_day/2026-06-11/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:53:50Z [load_day 2026-06-11] attempt 1 started
2026-11-07T05:53:57Z [load_day 2026-06-11] 2026-06-11 hour 0: 150173 events in 4 files, snapshot 6067818347779878623 (task 4643 ms: download 1626 ms overlapping gunzip 247 ms, parse 910 ms, sort 122 ms, write 2099 ms, index 467 ms: 7 candidates, 72011 repo-hours, 367 releases; waiting 526 ms; commit 1093 ms)
2026-11-07T05:53:58Z [load_day 2026-06-11] 2026-06-11 hour 1: 153024 events in 4 files, snapshot 3982196428833847179 (task 4840 ms: download 1560 ms overlapping gunzip 277 ms, parse 977 ms, sort 138 ms, write 2239 ms, index 463 ms: 4 candidates, 69652 repo-hours, 322 releases; waiting 521 ms; commit 1118 ms)
2026-11-07T05:54:02Z [load_day 2026-06-11] 2026-06-11 hour 2: 161249 events in 4 files, snapshot 5030133468974091888 (task 4139 ms: download 1502 ms overlapping gunzip 219 ms, parse 817 ms, sort 101 ms, write 1633 ms, index 520 ms: 8 candidates, 78413 repo-hours, 92 releases; waiting 529 ms; commit 987 ms)
2026-11-07T05:54:03Z [load_day 2026-06-11] 2026-06-11 hour 3: 162987 events in 4 files, snapshot 2728446071833777129 (task 4087 ms: download 1402 ms overlapping gunzip 227 ms, parse 839 ms, sort 108 ms, write 1657 ms, index 484 ms: 1 candidates, 74917 repo-hours, 100 releases; waiting 523 ms; commit 1041 ms)
2026-11-07T05:54:07Z [load_day 2026-06-11] 2026-06-11 hour 4: 163351 events in 4 files, snapshot 4498252663238615994 (task 4237 ms: download 1447 ms overlapping gunzip 211 ms, parse 778 ms, sort 102 ms, write 1797 ms, index 514 ms: 10 candidates, 79418 repo-hours, 91 releases; waiting 534 ms; commit 1175 ms)
2026-11-07T05:54:10Z [load_day 2026-06-11] 2026-06-11 hour 5: 159381 events in 4 files, snapshot 6251994430604587666 (task 4084 ms: download 1432 ms overlapping gunzip 207 ms, parse 760 ms, sort 111 ms, write 1686 ms, index 475 ms: 5 candidates, 71728 repo-hours, 76 releases; waiting 533 ms; commit 2814 ms)
2026-11-07T05:54:12Z [load_day 2026-06-11] 2026-06-11 hour 6: 166450 events in 4 files, snapshot 8989140563786882385 (task 4141 ms: download 1392 ms overlapping gunzip 227 ms, parse 803 ms, sort 105 ms, write 1591 ms, index 577 ms: 6 candidates, 78058 repo-hours, 72 releases; waiting 529 ms; commit 1122 ms)
2026-11-07T05:54:15Z [load_day 2026-06-11] 2026-06-11 hour 7: 159943 events in 4 files, snapshot 82247975130216086 (task 4166 ms: download 1548 ms overlapping gunzip 211 ms, parse 776 ms, sort 102 ms, write 1664 ms, index 535 ms: 3 candidates, 78509 repo-hours, 68 releases; waiting 616 ms; commit 1120 ms)
2026-11-07T05:54:16Z [load_day 2026-06-11] 2026-06-11 hour 8: 163703 events in 4 files, snapshot 158392576690378814 (task 4184 ms: download 1489 ms overlapping gunzip 240 ms, parse 831 ms, sort 109 ms, write 1587 ms, index 555 ms: 2 candidates, 78880 repo-hours, 95 releases; waiting 528 ms; commit 1104 ms)
2026-11-07T05:54:19Z [load_day 2026-06-11] 2026-06-11 hour 9: 160272 events in 4 files, snapshot 6762169349548365563 (task 4053 ms: download 1313 ms overlapping gunzip 204 ms, parse 742 ms, sort 102 ms, write 1549 ms, index 542 ms: 3 candidates, 77407 repo-hours, 52 releases; waiting 540 ms; commit 1093 ms)
2026-11-07T05:54:28Z [load_day 2026-06-11] 2026-06-11 hour 10: 159757 events in 4 files, snapshot 4559101125753184385 (task 3933 ms: download 1708 ms overlapping gunzip 203 ms, parse 760 ms, sort 102 ms, write 1429 ms, index 576 ms: 2 candidates, 77435 repo-hours, 55 releases; waiting 544 ms; commit 7669 ms)
2026-11-07T05:54:29Z [load_day 2026-06-11] 2026-06-11 hour 11: 158849 events in 4 files, snapshot 205491038554789395 (task 8149 ms: download 1456 ms overlapping gunzip 209 ms, parse 764 ms, sort 106 ms, write 5664 ms, index 559 ms: 6 candidates, 80182 repo-hours, 63 releases; waiting 530 ms; commit 1019 ms)
2026-11-07T05:54:45Z [load_day 2026-06-11] 2026-06-11 hour 12: 159191 events in 4 files, snapshot 902859359469247978 (task 4207 ms: download 2042 ms overlapping gunzip 215 ms, parse 772 ms, sort 113 ms, write 1725 ms, index 571 ms: 4 candidates, 80259 repo-hours, 38 releases; waiting 525 ms; commit 13283 ms)
2026-11-07T05:54:46Z [load_day 2026-06-11] 2026-06-11 hour 13: 156364 events in 4 files, snapshot 2046607662932072603 (task 4173 ms: download 1476 ms overlapping gunzip 206 ms, parse 760 ms, sort 106 ms, write 1706 ms, index 567 ms: 3 candidates, 84866 repo-hours, 62 releases; waiting 520 ms; commit 968 ms)
2026-11-07T05:54:56Z [load_day 2026-06-11] 2026-06-11 hour 14: 155181 events in 4 files, snapshot 2675178724250334879 (task 6554 ms: download 1525 ms overlapping gunzip 209 ms, parse 778 ms, sort 106 ms, write 4053 ms, index 592 ms: 4 candidates, 84998 repo-hours, 57 releases; waiting 510 ms; commit 9866 ms)
2026-11-07T05:54:56Z [load_day 2026-06-11] 2026-06-11 hour 15: 159568 events in 4 files, snapshot 8894133898374085199 (task 4300 ms: download 1391 ms overlapping gunzip 210 ms, parse 808 ms, sort 114 ms, write 1732 ms, index 611 ms: 7 candidates, 90532 repo-hours, 47 releases; waiting 545 ms; commit 818 ms)
2026-11-07T05:54:57Z [load_day 2026-06-11] 2026-06-11 hour 16: 157377 events in 4 files, snapshot 6341343383560513067 (task 4280 ms: download 1298 ms overlapping gunzip 217 ms, parse 802 ms, sort 120 ms, write 1849 ms, index 565 ms: 13 candidates, 85567 repo-hours, 48 releases; waiting 503 ms; commit 961 ms)
2026-11-07T05:55:01Z [load_day 2026-06-11] 2026-06-11 hour 17: 158967 events in 4 files, snapshot 3788332386958967230 (task 4266 ms: download 1530 ms overlapping gunzip 208 ms, parse 785 ms, sort 106 ms, write 1738 ms, index 557 ms: 8 candidates, 76201 repo-hours, 43 releases; waiting 539 ms; commit 1090 ms)
2026-11-07T05:55:03Z [load_day 2026-06-11] 2026-06-11 hour 18: 156303 events in 4 files, snapshot 478502743299519035 (task 4163 ms: download 1239 ms overlapping gunzip 207 ms, parse 775 ms, sort 106 ms, write 1690 ms, index 553 ms: 9 candidates, 77928 repo-hours, 49 releases; waiting 542 ms; commit 1056 ms)
2026-11-07T05:55:07Z [load_day 2026-06-11] 2026-06-11 hour 19: 161362 events in 4 files, snapshot 6436672153486100602 (task 4587 ms: download 1650 ms overlapping gunzip 252 ms, parse 934 ms, sort 122 ms, write 1556 ms, index 525 ms: 8 candidates, 75500 repo-hours, 62 releases; waiting 909 ms; commit 987 ms)
2026-11-07T05:55:07Z [load_day 2026-06-11] 2026-06-11 hour 20: 161066 events in 4 files, snapshot 3122469982283281929 (task 4042 ms: download 1323 ms overlapping gunzip 211 ms, parse 775 ms, sort 111 ms, write 1620 ms, index 593 ms: 7 candidates, 77420 repo-hours, 60 releases; waiting 517 ms; commit 879 ms)
2026-11-07T05:55:12Z [load_day 2026-06-11] 2026-06-11 hour 21: 160716 events in 4 files, snapshot 7622778983728894896 (task 4353 ms: download 1450 ms overlapping gunzip 226 ms, parse 827 ms, sort 112 ms, write 1821 ms, index 522 ms: 7 candidates, 72250 repo-hours, 119 releases; waiting 520 ms; commit 1091 ms)
2026-11-07T05:55:15Z [load_day 2026-06-11] 2026-06-11 hour 22: 157585 events in 4 files, snapshot 9197628213347441879 (task 4445 ms: download 1628 ms overlapping gunzip 253 ms, parse 914 ms, sort 123 ms, write 1792 ms, index 473 ms: 11 candidates, 68347 repo-hours, 222 releases; waiting 529 ms; commit 2731 ms)
2026-11-07T05:55:17Z [load_day 2026-06-11] 2026-06-11 hour 23: 154356 events in 4 files, snapshot 1901419384018446065 (task 4412 ms: download 1717 ms overlapping gunzip 251 ms, parse 900 ms, sort 113 ms, write 1776 ms, index 497 ms: 3 candidates, 71535 repo-hours, 306 releases; waiting 532 ms; commit 1110 ms)
2026-11-07T05:55:25Z [load_day 2026-06-11] 2026-06-11: repo_hour merged from 24 files to 1 (1862013 rows, 7915 ms)
2026-11-07T05:55:26Z [load_day 2026-06-11] 2026-06-11: index committed in 9541 ms (24 + 1 + 24 files)
2026-11-07T05:55:26Z [load_day 2026-06-11] 2026-06-11: 3817175 events in 24 hours
2026-11-07T05:55:26Z [load_day 2026-06-11] attempt 1 succeeded