orcaLog in

Runs · run 335

load_day 2026-07-29, attempt 1 succeeded

Host
4e84322b8c45:61323
Started
2026-11-07T04:51:57Z
Ended
2026-11-07T04:53:00Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/335/load_day/2026-07-29/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:51:57Z [load_day 2026-07-29] attempt 1 started
2026-11-07T04:52:04Z [load_day 2026-07-29] 2026-07-29 hour 0: 163157 events in 4 files, snapshot 4335773185228016578 (task 3921 ms: download 1592 ms overlapping gunzip 208 ms, parse 781 ms, sort 146 ms, write 1628 ms, index 285 ms: 3 candidates, 45726 repo-hours, 15 releases; waiting 523 ms; commit 995 ms)
2026-11-07T04:52:05Z [load_day 2026-07-29] 2026-07-29 hour 1: 167840 events in 4 files, snapshot 4794787260559642075 (task 3985 ms: download 1428 ms overlapping gunzip 198 ms, parse 783 ms, sort 117 ms, write 1784 ms, index 368 ms: 1 candidates, 57300 repo-hours, 21 releases; waiting 499 ms; commit 985 ms)
2026-11-07T04:52:09Z [load_day 2026-07-29] 2026-07-29 hour 2: 166280 events in 4 files, snapshot 2390566407443213670 (task 3548 ms: download 1272 ms overlapping gunzip 200 ms, parse 776 ms, sort 102 ms, write 1429 ms, index 310 ms: 5 candidates, 51581 repo-hours, 18 releases; waiting 516 ms; commit 923 ms)
2026-11-07T04:52:10Z [load_day 2026-07-29] 2026-07-29 hour 3: 165882 events in 4 files, snapshot 5060425233271003369 (task 3514 ms: download 1284 ms overlapping gunzip 207 ms, parse 767 ms, sort 104 ms, write 1393 ms, index 252 ms: 0 candidates, 34905 repo-hours, 13 releases; waiting 519 ms; commit 979 ms)
2026-11-07T04:52:13Z [load_day 2026-07-29] 2026-07-29 hour 4: 169770 events in 4 files, snapshot 5266973745800508221 (task 3731 ms: download 1298 ms overlapping gunzip 204 ms, parse 754 ms, sort 98 ms, write 1532 ms, index 314 ms: 5 candidates, 28745 repo-hours, 22 releases; waiting 531 ms; commit 858 ms)
2026-11-07T04:52:14Z [load_day 2026-07-29] 2026-07-29 hour 5: 168365 events in 4 files, snapshot 1315012061595622902 (task 3727 ms: download 1435 ms overlapping gunzip 195 ms, parse 745 ms, sort 103 ms, write 1497 ms, index 357 ms: 2 candidates, 29430 repo-hours, 29 releases; waiting 535 ms; commit 827 ms)
2026-11-07T04:52:17Z [load_day 2026-07-29] 2026-07-29 hour 6: 167979 events in 4 files, snapshot 4349722146162209337 (task 3331 ms: download 879 ms overlapping gunzip 200 ms, parse 765 ms, sort 104 ms, write 1508 ms, index 213 ms: 4 candidates, 30145 repo-hours, 12 releases; waiting 271 ms; commit 826 ms)
2026-11-07T04:52:18Z [load_day 2026-07-29] 2026-07-29 hour 7: 166784 events in 4 files, snapshot 2686223573268763419 (task 3223 ms: download 1133 ms overlapping gunzip 193 ms, parse 751 ms, sort 101 ms, write 1456 ms, index 231 ms: 4 candidates, 30662 repo-hours, 5 releases; waiting 279 ms; commit 919 ms)
2026-11-07T04:52:22Z [load_day 2026-07-29] 2026-07-29 hour 8: 168003 events in 4 files, snapshot 3250791678593888022 (task 3870 ms: download 1210 ms overlapping gunzip 193 ms, parse 754 ms, sort 106 ms, write 1563 ms, index 231 ms: 1 candidates, 32591 repo-hours, 20 releases; waiting 536 ms; commit 967 ms)
2026-11-07T04:52:22Z [load_day 2026-07-29] 2026-07-29 hour 9: 164587 events in 4 files, snapshot 4284492095640507550 (task 3668 ms: download 1272 ms overlapping gunzip 188 ms, parse 725 ms, sort 102 ms, write 1562 ms, index 202 ms: 6 candidates, 30989 repo-hours, 8 releases; waiting 535 ms; commit 953 ms)
2026-11-07T04:52:26Z [load_day 2026-07-29] 2026-07-29 hour 10: 164716 events in 4 files, snapshot 7040274487330391224 (task 3858 ms: download 1429 ms overlapping gunzip 195 ms, parse 760 ms, sort 101 ms, write 1537 ms, index 229 ms: 6 candidates, 33990 repo-hours, 28 releases; waiting 737 ms; commit 1120 ms)
2026-11-07T04:52:27Z [load_day 2026-07-29] 2026-07-29 hour 11: 167090 events in 4 files, snapshot 250303342960159652 (task 3687 ms: download 1426 ms overlapping gunzip 193 ms, parse 749 ms, sort 103 ms, write 1576 ms, index 234 ms: 2 candidates, 33943 repo-hours, 13 releases; waiting 537 ms; commit 883 ms)
2026-11-07T04:52:31Z [load_day 2026-07-29] 2026-07-29 hour 12: 169370 events in 4 files, snapshot 2351178962608444873 (task 3786 ms: download 1295 ms overlapping gunzip 199 ms, parse 779 ms, sort 113 ms, write 1574 ms, index 231 ms: 3 candidates, 33743 repo-hours, 5 releases; waiting 515 ms; commit 995 ms)
2026-11-07T04:52:31Z [load_day 2026-07-29] 2026-07-29 hour 13: 163100 events in 4 files, snapshot 854014484087261441 (task 3742 ms: download 1333 ms overlapping gunzip 197 ms, parse 779 ms, sort 107 ms, write 1490 ms, index 272 ms: 6 candidates, 34771 repo-hours, 9 releases; waiting 555 ms; commit 900 ms)
2026-11-07T04:52:35Z [load_day 2026-07-29] 2026-07-29 hour 14: 163293 events in 4 files, snapshot 2115905100076202479 (task 3661 ms: download 1200 ms overlapping gunzip 189 ms, parse 742 ms, sort 106 ms, write 1552 ms, index 275 ms: 3 candidates, 39291 repo-hours, 11 releases; waiting 535 ms; commit 884 ms)
2026-11-07T04:52:36Z [load_day 2026-07-29] 2026-07-29 hour 15: 160280 events in 4 files, snapshot 7253886734476892366 (task 3655 ms: download 1348 ms overlapping gunzip 196 ms, parse 750 ms, sort 123 ms, write 1486 ms, index 295 ms: 6 candidates, 42888 repo-hours, 12 releases; waiting 525 ms; commit 986 ms)
2026-11-07T04:52:39Z [load_day 2026-07-29] 2026-07-29 hour 16: 159928 events in 4 files, snapshot 5422937537473372040 (task 3601 ms: download 1454 ms overlapping gunzip 200 ms, parse 756 ms, sort 97 ms, write 1423 ms, index 277 ms: 4 candidates, 44208 repo-hours, 22 releases; waiting 533 ms; commit 823 ms)
2026-11-07T04:52:40Z [load_day 2026-07-29] 2026-07-29 hour 17: 168988 events in 4 files, snapshot 3704235357004593773 (task 3929 ms: download 1850 ms overlapping gunzip 211 ms, parse 794 ms, sort 160 ms, write 1529 ms, index 350 ms: 2 candidates, 48690 repo-hours, 26 releases; waiting 537 ms; commit 837 ms)
2026-11-07T04:52:44Z [load_day 2026-07-29] 2026-07-29 hour 18: 163458 events in 4 files, snapshot 4229220037907789033 (task 3702 ms: download 1492 ms overlapping gunzip 201 ms, parse 775 ms, sort 105 ms, write 1446 ms, index 299 ms: 3 candidates, 46043 repo-hours, 10 releases; waiting 525 ms; commit 1041 ms)
2026-11-07T04:52:45Z [load_day 2026-07-29] 2026-07-29 hour 19: 165463 events in 4 files, snapshot 9117545946349798938 (task 3805 ms: download 1426 ms overlapping gunzip 211 ms, parse 844 ms, sort 108 ms, write 1485 ms, index 324 ms: 3 candidates, 49102 repo-hours, 13 releases; waiting 527 ms; commit 1045 ms)
2026-11-07T04:52:48Z [load_day 2026-07-29] 2026-07-29 hour 20: 165068 events in 4 files, snapshot 2762938881852710557 (task 3844 ms: download 1284 ms overlapping gunzip 203 ms, parse 774 ms, sort 108 ms, write 1614 ms, index 305 ms: 4 candidates, 46497 repo-hours, 12 releases; waiting 517 ms; commit 870 ms)
2026-11-07T04:52:49Z [load_day 2026-07-29] 2026-07-29 hour 21: 165771 events in 4 files, snapshot 6435190533448839747 (task 3751 ms: download 1828 ms overlapping gunzip 203 ms, parse 767 ms, sort 116 ms, write 1514 ms, index 299 ms: 6 candidates, 47215 repo-hours, 13 releases; waiting 527 ms; commit 865 ms)
2026-11-07T04:52:53Z [load_day 2026-07-29] 2026-07-29 hour 22: 166558 events in 4 files, snapshot 3276915256035550191 (task 3815 ms: download 1218 ms overlapping gunzip 206 ms, parse 785 ms, sort 112 ms, write 1573 ms, index 310 ms: 4 candidates, 48883 repo-hours, 31 releases; waiting 200 ms; commit 952 ms)
2026-11-07T04:52:54Z [load_day 2026-07-29] 2026-07-29 hour 23: 166671 events in 4 files, snapshot 7759109250659367401 (task 3668 ms: download 1315 ms overlapping gunzip 208 ms, parse 785 ms, sort 106 ms, write 1467 ms, index 329 ms: 2 candidates, 49728 repo-hours, 19 releases; waiting 466 ms; commit 849 ms)
2026-11-07T04:52:58Z [load_day 2026-07-29] 2026-07-29: repo_hour merged from 24 files to 1 (971066 rows, 4624 ms)
2026-11-07T04:53:00Z [load_day 2026-07-29] 2026-07-29: index committed in 6234 ms (23 + 1 + 24 files)
2026-11-07T04:53:00Z [load_day 2026-07-29] 2026-07-29: 3978401 events in 24 hours
2026-11-07T04:53:00Z [load_day 2026-07-29] attempt 1 succeeded