orcaLog in

Runs · run 287

load_day 2026-08-14, attempt 1 succeeded

Host
4e84322b8c45:48561
Started
2026-11-07T04:34:10Z
Ended
2026-11-07T04:35:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/287/load_day/2026-08-14/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:34:10Z [load_day 2026-08-14] attempt 1 started
2026-11-07T04:34:16Z [load_day 2026-08-14] 2026-08-14 hour 0: 163410 events in 4 files, snapshot 1900891535839379651 (task 3730 ms: download 1256 ms overlapping gunzip 201 ms, parse 782 ms, sort 108 ms, write 1632 ms, index 446 ms: 6 candidates, 66190 repo-hours, 32 releases; waiting 243 ms; commit 783 ms)
2026-11-07T04:34:17Z [load_day 2026-08-14] 2026-08-14 hour 1: 162335 events in 4 files, snapshot 5166435076280372563 (task 3985 ms: download 1597 ms overlapping gunzip 205 ms, parse 795 ms, sort 112 ms, write 1564 ms, index 502 ms: 9 candidates, 77532 repo-hours, 45 releases; waiting 499 ms; commit 849 ms)
2026-11-07T04:34:21Z [load_day 2026-08-14] 2026-08-14 hour 2: 166634 events in 4 files, snapshot 1712557579843012432 (task 4025 ms: download 1447 ms overlapping gunzip 215 ms, parse 817 ms, sort 112 ms, write 1574 ms, index 491 ms: 4 candidates, 68475 repo-hours, 44 releases; waiting 517 ms; commit 647 ms)
2026-11-07T04:34:21Z [load_day 2026-08-14] 2026-08-14 hour 3: 162046 events in 4 files, snapshot 6367382990158878802 (task 3918 ms: download 1618 ms overlapping gunzip 226 ms, parse 827 ms, sort 111 ms, write 1638 ms, index 293 ms: 4 candidates, 45345 repo-hours, 86 releases; waiting 509 ms; commit 679 ms)
2026-11-07T04:34:25Z [load_day 2026-08-14] 2026-08-14 hour 4: 165654 events in 4 files, snapshot 8667695941889173713 (task 4055 ms: download 1284 ms overlapping gunzip 230 ms, parse 821 ms, sort 116 ms, write 1770 ms, index 288 ms: 5 candidates, 44754 repo-hours, 80 releases; waiting 548 ms; commit 826 ms)
2026-11-07T04:34:26Z [load_day 2026-08-14] 2026-08-14 hour 5: 166744 events in 4 files, snapshot 7377834362543909031 (task 3977 ms: download 1417 ms overlapping gunzip 208 ms, parse 770 ms, sort 115 ms, write 1659 ms, index 317 ms: 3 candidates, 49580 repo-hours, 29 releases; waiting 474 ms; commit 870 ms)
2026-11-07T04:34:30Z [load_day 2026-08-14] 2026-08-14 hour 6: 161792 events in 4 files, snapshot 8546520305586978492 (task 3663 ms: download 1406 ms overlapping gunzip 199 ms, parse 759 ms, sort 104 ms, write 1467 ms, index 301 ms: 2 candidates, 42557 repo-hours, 58 releases; waiting 533 ms; commit 997 ms)
2026-11-07T04:34:31Z [load_day 2026-08-14] 2026-08-14 hour 7: 162710 events in 4 files, snapshot 5133812773073674802 (task 3725 ms: download 1161 ms overlapping gunzip 219 ms, parse 867 ms, sort 129 ms, write 1543 ms, index 296 ms: 2 candidates, 46108 repo-hours, 32 releases; waiting 472 ms; commit 730 ms)
2026-11-07T04:34:35Z [load_day 2026-08-14] 2026-08-14 hour 8: 159347 events in 4 files, snapshot 7519680776026003479 (task 3732 ms: download 1199 ms overlapping gunzip 198 ms, parse 735 ms, sort 101 ms, write 1502 ms, index 325 ms: 3 candidates, 48471 repo-hours, 45 releases; waiting 553 ms; commit 878 ms)
2026-11-07T04:34:35Z [load_day 2026-08-14] 2026-08-14 hour 9: 162059 events in 4 files, snapshot 4212793124127408410 (task 3722 ms: download 1402 ms overlapping gunzip 199 ms, parse 753 ms, sort 112 ms, write 1465 ms, index 344 ms: 11 candidates, 54097 repo-hours, 33 releases; waiting 526 ms; commit 733 ms)
2026-11-07T04:34:39Z [load_day 2026-08-14] 2026-08-14 hour 10: 156548 events in 4 files, snapshot 195628170381208845 (task 3779 ms: download 1182 ms overlapping gunzip 201 ms, parse 758 ms, sort 95 ms, write 1408 ms, index 344 ms: 4 candidates, 49683 repo-hours, 17 releases; waiting 520 ms; commit 802 ms)
2026-11-07T04:34:40Z [load_day 2026-08-14] 2026-08-14 hour 11: 157561 events in 4 files, snapshot 5352311376540600110 (task 3866 ms: download 1676 ms overlapping gunzip 205 ms, parse 742 ms, sort 96 ms, write 1405 ms, index 335 ms: 7 candidates, 52535 repo-hours, 19 releases; waiting 540 ms; commit 777 ms)
2026-11-07T04:34:43Z [load_day 2026-08-14] 2026-08-14 hour 12: 159401 events in 4 files, snapshot 9118583251783436941 (task 3693 ms: download 1497 ms overlapping gunzip 185 ms, parse 713 ms, sort 98 ms, write 1545 ms, index 312 ms: 2 candidates, 44713 repo-hours, 15 releases; waiting 529 ms; commit 943 ms)
2026-11-07T04:34:44Z [load_day 2026-08-14] 2026-08-14 hour 13: 161942 events in 4 files, snapshot 5554745384090493288 (task 3614 ms: download 1134 ms overlapping gunzip 190 ms, parse 726 ms, sort 102 ms, write 1590 ms, index 232 ms: 3 candidates, 35121 repo-hours, 14 releases; waiting 476 ms; commit 825 ms)
2026-11-07T04:34:48Z [load_day 2026-08-14] 2026-08-14 hour 14: 159870 events in 4 files, snapshot 794533242091612925 (task 3792 ms: download 1362 ms overlapping gunzip 206 ms, parse 779 ms, sort 109 ms, write 1584 ms, index 254 ms: 2 candidates, 36178 repo-hours, 21 releases; waiting 573 ms; commit 902 ms)
2026-11-07T04:34:49Z [load_day 2026-08-14] 2026-08-14 hour 15: 156135 events in 4 files, snapshot 9113105616600710530 (task 3606 ms: download 1540 ms overlapping gunzip 185 ms, parse 709 ms, sort 103 ms, write 1481 ms, index 272 ms: 4 candidates, 37765 repo-hours, 15 releases; waiting 539 ms; commit 932 ms)
2026-11-07T04:34:52Z [load_day 2026-08-14] 2026-08-14 hour 16: 161270 events in 4 files, snapshot 4982758875592626717 (task 3890 ms: download 1371 ms overlapping gunzip 203 ms, parse 775 ms, sort 117 ms, write 1672 ms, index 301 ms: 5 candidates, 45013 repo-hours, 12 releases; waiting 509 ms; commit 1139 ms)
2026-11-07T04:34:53Z [load_day 2026-08-14] 2026-08-14 hour 17: 167077 events in 4 files, snapshot 3400800537909000306 (task 3764 ms: download 1823 ms overlapping gunzip 198 ms, parse 758 ms, sort 111 ms, write 1592 ms, index 280 ms: 2 candidates, 40166 repo-hours, 19 releases; waiting 523 ms; commit 820 ms)
2026-11-07T04:34:57Z [load_day 2026-08-14] 2026-08-14 hour 18: 165563 events in 4 files, snapshot 1641251379673570476 (task 3802 ms: download 1320 ms overlapping gunzip 211 ms, parse 819 ms, sort 109 ms, write 1535 ms, index 284 ms: 5 candidates, 40148 repo-hours, 22 releases; waiting 536 ms; commit 1024 ms)
2026-11-07T04:34:58Z [load_day 2026-08-14] 2026-08-14 hour 19: 162979 events in 4 files, snapshot 2990714831626684918 (task 3688 ms: download 1399 ms overlapping gunzip 201 ms, parse 760 ms, sort 114 ms, write 1519 ms, index 271 ms: 1 candidates, 38898 repo-hours, 19 releases; waiting 528 ms; commit 978 ms)
2026-11-07T04:35:01Z [load_day 2026-08-14] 2026-08-14 hour 20: 163888 events in 4 files, snapshot 4833095433810342242 (task 3812 ms: download 2149 ms overlapping gunzip 214 ms, parse 800 ms, sort 109 ms, write 1534 ms, index 294 ms: 3 candidates, 39644 repo-hours, 11 releases; waiting 543 ms; commit 815 ms)
2026-11-07T04:35:02Z [load_day 2026-08-14] 2026-08-14 hour 21: 160880 events in 4 files, snapshot 7277559625188876157 (task 3907 ms: download 1462 ms overlapping gunzip 203 ms, parse 791 ms, sort 122 ms, write 1508 ms, index 277 ms: 2 candidates, 37012 repo-hours, 18 releases; waiting 529 ms; commit 950 ms)
2026-11-07T04:35:05Z [load_day 2026-08-14] 2026-08-14 hour 22: 167778 events in 4 files, snapshot 6162299515810054015 (task 3759 ms: download 1112 ms overlapping gunzip 197 ms, parse 773 ms, sort 122 ms, write 1544 ms, index 232 ms: 2 candidates, 33076 repo-hours, 8 releases; waiting 283 ms; commit 786 ms)
2026-11-07T04:35:06Z [load_day 2026-08-14] 2026-08-14 hour 23: 166914 events in 4 files, snapshot 3987195413170499885 (task 3657 ms: download 1225 ms overlapping gunzip 200 ms, parse 764 ms, sort 127 ms, write 1555 ms, index 198 ms: 1 candidates, 29881 repo-hours, 2 releases; waiting 511 ms; commit 837 ms)
2026-11-07T04:35:11Z [load_day 2026-08-14] 2026-08-14: repo_hour merged from 24 files to 1 (1102942 rows, 5114 ms)
2026-11-07T04:35:13Z [load_day 2026-08-14] 2026-08-14: index committed in 6882 ms (24 + 1 + 24 files)
2026-11-07T04:35:13Z [load_day 2026-08-14] 2026-08-14: 3900537 events in 24 hours
2026-11-07T04:35:13Z [load_day 2026-08-14] attempt 1 succeeded