orcaLog in

Runs · run 542

load_day 2026-05-21, attempt 1 succeeded

Host
4e84322b8c45:120021
Started
2026-11-07T06:20:44Z
Ended
2026-11-07T06:22:00Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/542/load_day/2026-05-21/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:20:44Z [load_day 2026-05-21] attempt 1 started
2026-11-07T06:20:54Z [load_day 2026-05-21] 2026-05-21 hour 0: 153862 events in 4 files, snapshot 4514227755719460897 (task 5758 ms: download 1703 ms overlapping gunzip 337 ms, parse 1151 ms, sort 164 ms, write 2816 ms, index 473 ms: 10 candidates, 73346 repo-hours, 704 releases; waiting 509 ms; commit 965 ms)
2026-11-07T06:20:55Z [load_day 2026-05-21] 2026-05-21 hour 1: 154764 events in 4 files, snapshot 6965343204786627959 (task 5554 ms: download 1663 ms overlapping gunzip 342 ms, parse 1138 ms, sort 148 ms, write 2535 ms, index 556 ms: 14 candidates, 76751 repo-hours, 470 releases; waiting 521 ms; commit 1259 ms)
2026-11-07T06:21:00Z [load_day 2026-05-21] 2026-05-21 hour 2: 160612 events in 4 files, snapshot 6788963694025409184 (task 5821 ms: download 1506 ms overlapping gunzip 263 ms, parse 903 ms, sort 107 ms, write 3161 ms, index 522 ms: 10 candidates, 86667 repo-hours, 274 releases; waiting 534 ms; commit 1156 ms)
2026-11-07T06:21:01Z [load_day 2026-05-21] 2026-05-21 hour 3: 152538 events in 4 files, snapshot 5436514556093089947 (task 5359 ms: download 1776 ms overlapping gunzip 291 ms, parse 973 ms, sort 109 ms, write 2622 ms, index 500 ms: 7 candidates, 78901 repo-hours, 325 releases; waiting 435 ms; commit 944 ms)
2026-11-07T06:21:05Z [load_day 2026-05-21] 2026-05-21 hour 4: 154337 events in 4 files, snapshot 4552183986161184495 (task 4582 ms: download 1786 ms overlapping gunzip 260 ms, parse 922 ms, sort 119 ms, write 1899 ms, index 527 ms: 6 candidates, 81032 repo-hours, 290 releases; waiting 519 ms; commit 1144 ms)
2026-11-07T06:21:07Z [load_day 2026-05-21] 2026-05-21 hour 5: 154872 events in 4 files, snapshot 1478612832181920022 (task 5040 ms: download 2246 ms overlapping gunzip 312 ms, parse 1049 ms, sort 114 ms, write 2063 ms, index 490 ms: 5 candidates, 74734 repo-hours, 367 releases; waiting 715 ms; commit 1020 ms)
2026-11-07T06:21:10Z [load_day 2026-05-21] 2026-05-21 hour 6: 157846 events in 4 files, snapshot 1512860540223778205 (task 4357 ms: download 1495 ms overlapping gunzip 247 ms, parse 850 ms, sort 105 ms, write 1741 ms, index 568 ms: 4 candidates, 80068 repo-hours, 202 releases; waiting 531 ms; commit 1035 ms)
2026-11-07T06:21:12Z [load_day 2026-05-21] 2026-05-21 hour 7: 153912 events in 4 files, snapshot 7442388190732213840 (task 4032 ms: download 1252 ms overlapping gunzip 227 ms, parse 799 ms, sort 112 ms, write 1552 ms, index 544 ms: 7 candidates, 80635 repo-hours, 129 releases; waiting 547 ms; commit 1062 ms)
2026-11-07T06:21:15Z [load_day 2026-05-21] 2026-05-21 hour 8: 156974 events in 4 files, snapshot 9010166296069132262 (task 3922 ms: download 1300 ms overlapping gunzip 210 ms, parse 780 ms, sort 105 ms, write 1480 ms, index 540 ms: 7 candidates, 82481 repo-hours, 55 releases; waiting 532 ms; commit 938 ms)
2026-11-07T06:21:16Z [load_day 2026-05-21] 2026-05-21 hour 9: 152068 events in 4 files, snapshot 6272208648358793571 (task 4007 ms: download 1358 ms overlapping gunzip 208 ms, parse 755 ms, sort 97 ms, write 1568 ms, index 509 ms: 6 candidates, 79657 repo-hours, 87 releases; waiting 531 ms; commit 1087 ms)
2026-11-07T06:21:20Z [load_day 2026-05-21] 2026-05-21 hour 10: 146169 events in 3 files, snapshot 784734352480329977 (task 3909 ms: download 1190 ms overlapping gunzip 210 ms, parse 745 ms, sort 100 ms, write 1495 ms, index 565 ms: 8 candidates, 78587 repo-hours, 125 releases; waiting 525 ms; commit 1177 ms)
2026-11-07T06:21:21Z [load_day 2026-05-21] 2026-05-21 hour 11: 149124 events in 3 files, snapshot 4918414261952372887 (task 3920 ms: download 1256 ms overlapping gunzip 228 ms, parse 809 ms, sort 102 ms, write 1456 ms, index 530 ms: 9 candidates, 80500 repo-hours, 93 releases; waiting 542 ms; commit 1003 ms)
2026-11-07T06:21:24Z [load_day 2026-05-21] 2026-05-21 hour 12: 147915 events in 3 files, snapshot 5788288552474703321 (task 3812 ms: download 1378 ms overlapping gunzip 222 ms, parse 769 ms, sort 107 ms, write 1341 ms, index 592 ms: 6 candidates, 81716 repo-hours, 64 releases; waiting 521 ms; commit 1098 ms)
2026-11-07T06:21:27Z [load_day 2026-05-21] 2026-05-21 hour 13: 145884 events in 3 files, snapshot 8960157876102702735 (task 3850 ms: download 1162 ms overlapping gunzip 218 ms, parse 777 ms, sort 106 ms, write 1475 ms, index 521 ms: 8 candidates, 80242 repo-hours, 75 releases; waiting 485 ms; commit 3058 ms)
2026-11-07T06:21:29Z [load_day 2026-05-21] 2026-05-21 hour 14: 145065 events in 3 files, snapshot 3963269352527347217 (task 3895 ms: download 1310 ms overlapping gunzip 203 ms, parse 704 ms, sort 95 ms, write 1512 ms, index 552 ms: 10 candidates, 85433 repo-hours, 70 releases; waiting 528 ms; commit 1128 ms)
2026-11-07T06:21:30Z [load_day 2026-05-21] 2026-05-21 hour 15: 142829 events in 3 files, snapshot 120161513462900499 (task 3930 ms: download 1613 ms overlapping gunzip 223 ms, parse 779 ms, sort 94 ms, write 1405 ms, index 563 ms: 3 candidates, 85605 repo-hours, 86 releases; waiting 513 ms; commit 1140 ms)
2026-11-07T06:21:33Z [load_day 2026-05-21] 2026-05-21 hour 16: 148793 events in 3 files, snapshot 3521362455790154175 (task 3744 ms: download 1104 ms overlapping gunzip 227 ms, parse 814 ms, sort 110 ms, write 1396 ms, index 542 ms: 7 candidates, 82700 repo-hours, 107 releases; waiting 324 ms; commit 1089 ms)
2026-11-07T06:21:34Z [load_day 2026-05-21] 2026-05-21 hour 17: 151596 events in 4 files, snapshot 471791195904888960 (task 3936 ms: download 1443 ms overlapping gunzip 212 ms, parse 754 ms, sort 103 ms, write 1501 ms, index 555 ms: 6 candidates, 82720 repo-hours, 81 releases; waiting 537 ms; commit 1073 ms)
2026-11-07T06:21:38Z [load_day 2026-05-21] 2026-05-21 hour 18: 148708 events in 3 files, snapshot 236697464809003119 (task 4712 ms: download 1211 ms overlapping gunzip 217 ms, parse 799 ms, sort 116 ms, write 1740 ms, index 597 ms: 4 candidates, 77043 repo-hours, 107 releases; waiting 540 ms; commit 1211 ms)
2026-11-07T06:21:40Z [load_day 2026-05-21] 2026-05-21 hour 19: 148190 events in 3 files, snapshot 2313633320908158402 (task 4024 ms: download 1420 ms overlapping gunzip 207 ms, parse 759 ms, sort 100 ms, write 1610 ms, index 513 ms: 5 candidates, 77714 repo-hours, 136 releases; waiting 527 ms; commit 1261 ms)
2026-11-07T06:21:43Z [load_day 2026-05-21] 2026-05-21 hour 20: 149758 events in 3 files, snapshot 7850391282658167762 (task 4228 ms: download 1240 ms overlapping gunzip 254 ms, parse 860 ms, sort 116 ms, write 1635 ms, index 576 ms: 7 candidates, 77043 repo-hours, 171 releases; waiting 521 ms; commit 1099 ms)
2026-11-07T06:21:45Z [load_day 2026-05-21] 2026-05-21 hour 21: 151692 events in 4 files, snapshot 5500553765323432853 (task 4120 ms: download 1588 ms overlapping gunzip 239 ms, parse 886 ms, sort 109 ms, write 1601 ms, index 501 ms: 4 candidates, 74570 repo-hours, 144 releases; waiting 525 ms; commit 1732 ms)
2026-11-07T06:21:48Z [load_day 2026-05-21] 2026-05-21 hour 22: 146019 events in 3 files, snapshot 4357318652027726516 (task 4843 ms: download 1622 ms overlapping gunzip 286 ms, parse 966 ms, sort 115 ms, write 2070 ms, index 593 ms: 7 candidates, 71623 repo-hours, 395 releases; waiting 526 ms; commit 1019 ms)
2026-11-07T06:21:50Z [load_day 2026-05-21] 2026-05-21 hour 23: 144998 events in 3 files, snapshot 3610433617842389695 (task 5188 ms: download 2529 ms overlapping gunzip 380 ms, parse 1184 ms, sort 127 ms, write 2174 ms, index 467 ms: 3 candidates, 70653 repo-hours, 581 releases; waiting 527 ms; commit 1263 ms)
2026-11-07T06:21:58Z [load_day 2026-05-21] 2026-05-21: repo_hour merged from 24 files to 1 (1900421 rows, 7754 ms)
2026-11-07T06:22:00Z [load_day 2026-05-21] 2026-05-21: index committed in 9378 ms (24 + 1 + 24 files)
2026-11-07T06:22:00Z [load_day 2026-05-21] 2026-05-21: 3618525 events in 24 hours
2026-11-07T06:22:00Z [load_day 2026-05-21] attempt 1 succeeded