orcaLog in

Runs · run 506

load_day 2026-06-02, attempt 1 succeeded

Host
4e84322b8c45:110057
Started
2026-11-07T06:05:22Z
Ended
2026-11-07T06:06:28Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/506/load_day/2026-06-02/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:05:22Z [load_day 2026-06-02] attempt 1 started
2026-11-07T06:05:29Z [load_day 2026-06-02] 2026-06-02 hour 0: 152915 events in 4 files, snapshot 4050885773043467877 (task 4693 ms: download 1482 ms overlapping gunzip 276 ms, parse 1012 ms, sort 131 ms, write 1969 ms, index 513 ms: 3 candidates, 72543 repo-hours, 311 releases; waiting 512 ms; commit 963 ms)
2026-11-07T06:05:30Z [load_day 2026-06-02] 2026-06-02 hour 1: 153860 events in 4 files, snapshot 824004273788125575 (task 4912 ms: download 1937 ms overlapping gunzip 313 ms, parse 1109 ms, sort 205 ms, write 1898 ms, index 482 ms: 8 candidates, 73009 repo-hours, 344 releases; waiting 532 ms; commit 1002 ms)
2026-11-07T06:05:34Z [load_day 2026-06-02] 2026-06-02 hour 2: 155212 events in 4 files, snapshot 2236720651086833951 (task 4180 ms: download 1533 ms overlapping gunzip 219 ms, parse 814 ms, sort 106 ms, write 1719 ms, index 530 ms: 5 candidates, 81259 repo-hours, 112 releases; waiting 514 ms; commit 1160 ms)
2026-11-07T06:05:36Z [load_day 2026-06-02] 2026-06-02 hour 3: 156278 events in 4 files, snapshot 4989310455790681262 (task 4254 ms: download 1394 ms overlapping gunzip 255 ms, parse 830 ms, sort 118 ms, write 1743 ms, index 493 ms: 3 candidates, 77606 repo-hours, 203 releases; waiting 550 ms; commit 1380 ms)
2026-11-07T06:05:41Z [load_day 2026-06-02] 2026-06-02 hour 4: 153107 events in 4 files, snapshot 3560472420848190889 (task 4255 ms: download 1370 ms overlapping gunzip 226 ms, parse 832 ms, sort 119 ms, write 1620 ms, index 642 ms: 4 candidates, 81224 repo-hours, 139 releases; waiting 525 ms; commit 2803 ms)
2026-11-07T06:05:42Z [load_day 2026-06-02] 2026-06-02 hour 5: 153379 events in 4 files, snapshot 7747155870384935187 (task 4121 ms: download 1671 ms overlapping gunzip 236 ms, parse 824 ms, sort 123 ms, write 1606 ms, index 485 ms: 6 candidates, 75095 repo-hours, 167 releases; waiting 532 ms; commit 1021 ms)
2026-11-07T06:05:44Z [load_day 2026-06-02] 2026-06-02 hour 6: 153342 events in 4 files, snapshot 7882364159017053724 (task 4020 ms: download 1466 ms overlapping gunzip 224 ms, parse 798 ms, sort 106 ms, write 1517 ms, index 511 ms: 5 candidates, 76952 repo-hours, 105 releases; waiting 529 ms; commit 1156 ms)
2026-11-07T06:05:47Z [load_day 2026-06-02] 2026-06-02 hour 7: 156406 events in 4 files, snapshot 957328849061358210 (task 4140 ms: download 1186 ms overlapping gunzip 250 ms, parse 907 ms, sort 160 ms, write 1536 ms, index 548 ms: 9 candidates, 79337 repo-hours, 90 releases; waiting 520 ms; commit 1109 ms)
2026-11-07T06:05:48Z [load_day 2026-06-02] 2026-06-02 hour 8: 154018 events in 4 files, snapshot 6504529498485563259 (task 3645 ms: download 794 ms overlapping gunzip 207 ms, parse 721 ms, sort 104 ms, write 1564 ms, index 533 ms: 6 candidates, 80793 repo-hours, 61 releases; waiting 225 ms; commit 984 ms)
2026-11-07T06:05:52Z [load_day 2026-06-02] 2026-06-02 hour 9: 155625 events in 4 files, snapshot 6836056879693483391 (task 3995 ms: download 1221 ms overlapping gunzip 246 ms, parse 888 ms, sort 109 ms, write 1486 ms, index 573 ms: 10 candidates, 80234 repo-hours, 77 releases; waiting 472 ms; commit 1255 ms)
2026-11-07T06:05:53Z [load_day 2026-06-02] 2026-06-02 hour 10: 159634 events in 4 files, snapshot 4947912820506174425 (task 3858 ms: download 1193 ms overlapping gunzip 222 ms, parse 794 ms, sort 103 ms, write 1471 ms, index 537 ms: 6 candidates, 80752 repo-hours, 83 releases; waiting 512 ms; commit 1093 ms)
2026-11-07T06:05:56Z [load_day 2026-06-02] 2026-06-02 hour 11: 155544 events in 4 files, snapshot 5227245312848354917 (task 3982 ms: download 1345 ms overlapping gunzip 205 ms, parse 812 ms, sort 98 ms, write 1470 ms, index 556 ms: 5 candidates, 81074 repo-hours, 64 releases; waiting 532 ms; commit 1097 ms)
2026-11-07T06:05:57Z [load_day 2026-06-02] 2026-06-02 hour 12: 155255 events in 4 files, snapshot 70919691716836077 (task 3911 ms: download 1151 ms overlapping gunzip 198 ms, parse 747 ms, sort 110 ms, write 1482 ms, index 570 ms: 7 candidates, 81823 repo-hours, 24 releases; waiting 520 ms; commit 894 ms)
2026-11-07T06:06:01Z [load_day 2026-06-02] 2026-06-02 hour 13: 149878 events in 3 files, snapshot 8886161462248368601 (task 3959 ms: download 1240 ms overlapping gunzip 194 ms, parse 728 ms, sort 112 ms, write 1528 ms, index 593 ms: 5 candidates, 81849 repo-hours, 24 releases; waiting 543 ms; commit 1105 ms)
2026-11-07T06:06:02Z [load_day 2026-06-02] 2026-06-02 hour 14: 146670 events in 3 files, snapshot 1107563553892859692 (task 3663 ms: download 1171 ms overlapping gunzip 196 ms, parse 742 ms, sort 104 ms, write 1328 ms, index 563 ms: 5 candidates, 81122 repo-hours, 43 releases; waiting 515 ms; commit 935 ms)
2026-11-07T06:06:04Z [load_day 2026-06-02] 2026-06-02 hour 15: 108834 events in 3 files, snapshot 2973168837682769801 (task 2735 ms: download 681 ms overlapping gunzip 149 ms, parse 531 ms, sort 77 ms, write 1085 ms, index 409 ms: 5 candidates, 61569 repo-hours, 35 releases; waiting 236 ms; commit 1072 ms)
2026-11-07T06:06:05Z [load_day 2026-06-02] 2026-06-02 hour 16: 581 events in 1 files, snapshot 5116345485062739568 (task 890 ms: download 442 ms overlapping gunzip 8 ms, parse 17 ms, sort 1 ms, write 115 ms, index 18 ms: 0 candidates, 413 repo-hours, 0 releases; waiting 429 ms; commit 1062 ms)
2026-11-07T06:06:06Z [load_day 2026-06-02] 2026-06-02 hour 17: 34174 events in 1 files, snapshot 3927938003919093371 (task 1350 ms: download 382 ms overlapping gunzip 50 ms, parse 191 ms, sort 25 ms, write 355 ms, index 194 ms: 1 candidates, 22658 repo-hours, 27 releases; waiting 188 ms; commit 1069 ms)
2026-11-07T06:06:08Z [load_day 2026-06-02] 2026-06-02 hour 18: 102972 events in 3 files, snapshot 3697735613627150435 (task 2811 ms: download 1068 ms overlapping gunzip 137 ms, parse 493 ms, sort 69 ms, write 969 ms, index 381 ms: 6 candidates, 57525 repo-hours, 31 releases; waiting 538 ms; commit 963 ms)
2026-11-07T06:06:11Z [load_day 2026-06-02] 2026-06-02 hour 19: 154536 events in 4 files, snapshot 295293559834093549 (task 3668 ms: download 1137 ms overlapping gunzip 203 ms, parse 757 ms, sort 111 ms, write 1358 ms, index 512 ms: 10 candidates, 74567 repo-hours, 37 releases; waiting 503 ms; commit 1369 ms)
2026-11-07T06:06:13Z [load_day 2026-06-02] 2026-06-02 hour 20: 158635 events in 4 files, snapshot 5379736770390825560 (task 3647 ms: download 1191 ms overlapping gunzip 201 ms, parse 734 ms, sort 102 ms, write 1390 ms, index 514 ms: 6 candidates, 78508 repo-hours, 33 releases; waiting 407 ms; commit 1143 ms)
2026-11-07T06:06:15Z [load_day 2026-06-02] 2026-06-02 hour 21: 159670 events in 4 files, snapshot 5915655805738841001 (task 3904 ms: download 1329 ms overlapping gunzip 219 ms, parse 783 ms, sort 113 ms, write 1468 ms, index 472 ms: 8 candidates, 69219 repo-hours, 60 releases; waiting 512 ms; commit 996 ms)
2026-11-07T06:06:18Z [load_day 2026-06-02] 2026-06-02 hour 22: 158831 events in 4 files, snapshot 748466873065842930 (task 4241 ms: download 1286 ms overlapping gunzip 258 ms, parse 896 ms, sort 122 ms, write 1751 ms, index 497 ms: 12 candidates, 71600 repo-hours, 201 releases; waiting 509 ms; commit 1001 ms)
2026-11-07T06:06:19Z [load_day 2026-06-02] 2026-06-02 hour 23: 111500 events in 3 files, snapshot 3092779713489583893 (task 3302 ms: download 1208 ms overlapping gunzip 185 ms, parse 623 ms, sort 76 ms, write 1230 ms, index 366 ms: 4 candidates, 53905 repo-hours, 150 releases; waiting 522 ms; commit 1052 ms)
2026-11-07T06:06:26Z [load_day 2026-06-02] 2026-06-02: repo_hour merged from 24 files to 1 (1674636 rows, 6962 ms)
2026-11-07T06:06:28Z [load_day 2026-06-02] 2026-06-02: index committed in 9035 ms (23 + 1 + 23 files)
2026-11-07T06:06:28Z [load_day 2026-06-02] 2026-06-02: 3300856 events in 24 hours
2026-11-07T06:06:28Z [load_day 2026-06-02] attempt 1 succeeded