orcaLog in

Runs · run 353

load_day 2026-07-23, attempt 1 succeeded

Host
4e84322b8c45:66443
Started
2026-11-07T04:58:16Z
Ended
2026-11-07T04:59:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/353/load_day/2026-07-23/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:58:16Z [load_day 2026-07-23] attempt 1 started
2026-11-07T04:58:22Z [load_day 2026-07-23] 2026-07-23 hour 0: 165757 events in 4 files, snapshot 4748966860848424979 (task 3926 ms: download 1429 ms overlapping gunzip 205 ms, parse 786 ms, sort 116 ms, write 1642 ms, index 426 ms: 3 candidates, 55362 repo-hours, 25 releases; waiting 519 ms; commit 734 ms)
2026-11-07T04:58:23Z [load_day 2026-07-23] 2026-07-23 hour 1: 164033 events in 4 files, snapshot 3784292726110615605 (task 4054 ms: download 1732 ms overlapping gunzip 205 ms, parse 805 ms, sort 146 ms, write 1587 ms, index 480 ms: 7 candidates, 69446 repo-hours, 39 releases; waiting 526 ms; commit 843 ms)
2026-11-07T04:58:27Z [load_day 2026-07-23] 2026-07-23 hour 2: 164954 events in 4 files, snapshot 946369139479484320 (task 4032 ms: download 1141 ms overlapping gunzip 198 ms, parse 765 ms, sort 99 ms, write 1714 ms, index 498 ms: 8 candidates, 76563 repo-hours, 23 releases; waiting 530 ms; commit 1029 ms)
2026-11-07T04:58:28Z [load_day 2026-07-23] 2026-07-23 hour 3: 162682 events in 4 files, snapshot 620956034200429052 (task 3524 ms: download 1357 ms overlapping gunzip 209 ms, parse 781 ms, sort 99 ms, write 1602 ms, index 278 ms: 4 candidates, 43770 repo-hours, 61 releases; waiting 312 ms; commit 923 ms)
2026-11-07T04:58:31Z [load_day 2026-07-23] 2026-07-23 hour 4: 170276 events in 4 files, snapshot 2186250208260163420 (task 3334 ms: download 1017 ms overlapping gunzip 206 ms, parse 763 ms, sort 109 ms, write 1537 ms, index 231 ms: 2 candidates, 33043 repo-hours, 8 releases; waiting 256 ms; commit 836 ms)
2026-11-07T04:58:32Z [load_day 2026-07-23] 2026-07-23 hour 5: 167790 events in 4 files, snapshot 235462426675047922 (task 3254 ms: download 737 ms overlapping gunzip 215 ms, parse 816 ms, sort 100 ms, write 1429 ms, index 220 ms: 3 candidates, 32894 repo-hours, 16 releases; waiting 191 ms; commit 877 ms)
2026-11-07T04:58:35Z [load_day 2026-07-23] 2026-07-23 hour 6: 165766 events in 4 files, snapshot 3465018533853648395 (task 3642 ms: download 1711 ms overlapping gunzip 196 ms, parse 766 ms, sort 101 ms, write 1493 ms, index 242 ms: 8 candidates, 35009 repo-hours, 23 releases; waiting 538 ms; commit 978 ms)
2026-11-07T04:58:36Z [load_day 2026-07-23] 2026-07-23 hour 7: 166654 events in 4 files, snapshot 289652047713642375 (task 3477 ms: download 1373 ms overlapping gunzip 199 ms, parse 757 ms, sort 96 ms, write 1400 ms, index 232 ms: 5 candidates, 33020 repo-hours, 16 releases; waiting 501 ms; commit 838 ms)
2026-11-07T04:58:39Z [load_day 2026-07-23] 2026-07-23 hour 8: 149345 events in 3 files, snapshot 5626223353360506640 (task 3371 ms: download 1159 ms overlapping gunzip 173 ms, parse 663 ms, sort 94 ms, write 1411 ms, index 194 ms: 5 candidates, 29693 repo-hours, 15 releases; waiting 531 ms; commit 989 ms)
2026-11-07T04:58:40Z [load_day 2026-07-23] 2026-07-23 hour 9: 142025 events in 3 files, snapshot 8804999499502800917 (task 3188 ms: download 1088 ms overlapping gunzip 188 ms, parse 677 ms, sort 96 ms, write 1249 ms, index 225 ms: 3 candidates, 28723 repo-hours, 9 releases; waiting 538 ms; commit 852 ms)
2026-11-07T04:58:43Z [load_day 2026-07-23] 2026-07-23 hour 10: 140465 events in 3 files, snapshot 1209011293649131646 (task 3252 ms: download 1178 ms overlapping gunzip 174 ms, parse 659 ms, sort 88 ms, write 1262 ms, index 211 ms: 5 candidates, 30401 repo-hours, 20 releases; waiting 532 ms; commit 1013 ms)
2026-11-07T04:58:45Z [load_day 2026-07-23] 2026-07-23 hour 11: 160178 events in 4 files, snapshot 1364362672649713183 (task 3225 ms: download 873 ms overlapping gunzip 180 ms, parse 702 ms, sort 97 ms, write 1505 ms, index 230 ms: 1 candidates, 34806 repo-hours, 15 releases; waiting 240 ms; commit 1484 ms)
2026-11-07T04:58:48Z [load_day 2026-07-23] 2026-07-23 hour 12: 160284 events in 4 files, snapshot 1541018654182902146 (task 3716 ms: download 1233 ms overlapping gunzip 190 ms, parse 730 ms, sort 106 ms, write 1497 ms, index 276 ms: 4 candidates, 36691 repo-hours, 15 releases; waiting 522 ms; commit 1038 ms)
2026-11-07T04:58:49Z [load_day 2026-07-23] 2026-07-23 hour 13: 161379 events in 4 files, snapshot 7003075689136896948 (task 3685 ms: download 1302 ms overlapping gunzip 189 ms, parse 727 ms, sort 99 ms, write 1442 ms, index 282 ms: 7 candidates, 45037 repo-hours, 8 releases; waiting 548 ms; commit 922 ms)
2026-11-07T04:58:52Z [load_day 2026-07-23] 2026-07-23 hour 14: 158182 events in 4 files, snapshot 7697104266683222766 (task 3548 ms: download 1313 ms overlapping gunzip 193 ms, parse 738 ms, sort 110 ms, write 1403 ms, index 301 ms: 1 candidates, 44792 repo-hours, 9 releases; waiting 523 ms; commit 833 ms)
2026-11-07T04:58:53Z [load_day 2026-07-23] 2026-07-23 hour 15: 160510 events in 4 files, snapshot 5216311690989089194 (task 3689 ms: download 1627 ms overlapping gunzip 202 ms, parse 735 ms, sort 99 ms, write 1466 ms, index 315 ms: 7 candidates, 44300 repo-hours, 36 releases; waiting 537 ms; commit 830 ms)
2026-11-07T04:58:56Z [load_day 2026-07-23] 2026-07-23 hour 16: 162875 events in 4 files, snapshot 7159673450184813446 (task 3661 ms: download 1305 ms overlapping gunzip 202 ms, parse 785 ms, sort 113 ms, write 1412 ms, index 321 ms: 1 candidates, 46085 repo-hours, 19 releases; waiting 537 ms; commit 851 ms)
2026-11-07T04:58:58Z [load_day 2026-07-23] 2026-07-23 hour 17: 165565 events in 4 files, snapshot 2646221412153463584 (task 3833 ms: download 1293 ms overlapping gunzip 206 ms, parse 796 ms, sort 100 ms, write 1530 ms, index 339 ms: 3 candidates, 50569 repo-hours, 15 releases; waiting 514 ms; commit 983 ms)
2026-11-07T04:59:00Z [load_day 2026-07-23] 2026-07-23 hour 18: 164479 events in 4 files, snapshot 7237529274504732994 (task 3753 ms: download 1230 ms overlapping gunzip 201 ms, parse 766 ms, sort 111 ms, write 1503 ms, index 324 ms: 6 candidates, 49277 repo-hours, 18 releases; waiting 524 ms; commit 1030 ms)
2026-11-07T04:59:02Z [load_day 2026-07-23] 2026-07-23 hour 19: 162665 events in 4 files, snapshot 7860269994887167982 (task 3591 ms: download 1261 ms overlapping gunzip 194 ms, parse 743 ms, sort 105 ms, write 1455 ms, index 376 ms: 4 candidates, 50451 repo-hours, 22 releases; waiting 397 ms; commit 1049 ms)
2026-11-07T04:59:04Z [load_day 2026-07-23] 2026-07-23 hour 20: 165170 events in 4 files, snapshot 6608990425107241447 (task 3827 ms: download 1486 ms overlapping gunzip 201 ms, parse 796 ms, sort 106 ms, write 1523 ms, index 373 ms: 10 candidates, 51697 repo-hours, 33 releases; waiting 523 ms; commit 804 ms)
2026-11-07T04:59:06Z [load_day 2026-07-23] 2026-07-23 hour 21: 168556 events in 4 files, snapshot 2779813932900677218 (task 3945 ms: download 1325 ms overlapping gunzip 216 ms, parse 817 ms, sort 118 ms, write 1572 ms, index 374 ms: 3 candidates, 51343 repo-hours, 29 releases; waiting 520 ms; commit 915 ms)
2026-11-07T04:59:08Z [load_day 2026-07-23] 2026-07-23 hour 22: 166050 events in 4 files, snapshot 1512769576421747998 (task 3539 ms: download 968 ms overlapping gunzip 196 ms, parse 755 ms, sort 106 ms, write 1575 ms, index 340 ms: 4 candidates, 51412 repo-hours, 38 releases; waiting 344 ms; commit 954 ms)
2026-11-07T04:59:11Z [load_day 2026-07-23] 2026-07-23 hour 23: 166049 events in 4 files, snapshot 6029990735285881711 (task 3691 ms: download 1221 ms overlapping gunzip 208 ms, parse 794 ms, sort 115 ms, write 1466 ms, index 322 ms: 5 candidates, 50249 repo-hours, 22 releases; waiting 525 ms; commit 1024 ms)
2026-11-07T04:59:15Z [load_day 2026-07-23] 2026-07-23: repo_hour merged from 24 files to 1 (1074633 rows, 4909 ms)
2026-11-07T04:59:17Z [load_day 2026-07-23] 2026-07-23: index committed in 6338 ms (24 + 1 + 24 files)
2026-11-07T04:59:17Z [load_day 2026-07-23] 2026-07-23: 3881689 events in 24 hours
2026-11-07T04:59:17Z [load_day 2026-07-23] attempt 1 succeeded