orcaLog in

Runs · run 359

load_day 2026-07-21, attempt 1 succeeded

Host
4e84322b8c45:68123
Started
2026-11-07T05:00:31Z
Ended
2026-11-07T05:01:32Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/359/load_day/2026-07-21/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:00:31Z [load_day 2026-07-21] attempt 1 started
2026-11-07T05:00:38Z [load_day 2026-07-21] 2026-07-21 hour 0: 166867 events in 4 files, snapshot 7659042870352508320 (task 3952 ms: download 1396 ms overlapping gunzip 213 ms, parse 827 ms, sort 129 ms, write 1594 ms, index 384 ms: 3 candidates, 49956 repo-hours, 14 releases; waiting 500 ms; commit 744 ms)
2026-11-07T05:00:38Z [load_day 2026-07-21] 2026-07-21 hour 1: 167375 events in 4 files, snapshot 6807830778739526540 (task 3963 ms: download 1635 ms overlapping gunzip 206 ms, parse 785 ms, sort 120 ms, write 1629 ms, index 378 ms: 6 candidates, 59523 repo-hours, 17 releases; waiting 526 ms; commit 918 ms)
2026-11-07T05:00:42Z [load_day 2026-07-21] 2026-07-21 hour 2: 166282 events in 4 files, snapshot 5510322326159443181 (task 3861 ms: download 1259 ms overlapping gunzip 198 ms, parse 774 ms, sort 104 ms, write 1573 ms, index 366 ms: 5 candidates, 59694 repo-hours, 11 releases; waiting 566 ms; commit 794 ms)
2026-11-07T05:00:43Z [load_day 2026-07-21] 2026-07-21 hour 3: 160882 events in 4 files, snapshot 6958740432476410702 (task 3594 ms: download 1264 ms overlapping gunzip 196 ms, parse 746 ms, sort 98 ms, write 1506 ms, index 241 ms: 3 candidates, 37335 repo-hours, 8 releases; waiting 508 ms; commit 862 ms)
2026-11-07T05:00:46Z [load_day 2026-07-21] 2026-07-21 hour 4: 164186 events in 4 files, snapshot 6870870287304697728 (task 3496 ms: download 1150 ms overlapping gunzip 185 ms, parse 732 ms, sort 107 ms, write 1467 ms, index 232 ms: 0 candidates, 33473 repo-hours, 13 releases; waiting 521 ms; commit 794 ms)
2026-11-07T05:00:47Z [load_day 2026-07-21] 2026-07-21 hour 5: 169288 events in 4 files, snapshot 8159209109716374166 (task 3442 ms: download 1378 ms overlapping gunzip 200 ms, parse 775 ms, sort 109 ms, write 1525 ms, index 206 ms: 2 candidates, 32208 repo-hours, 10 releases; waiting 285 ms; commit 748 ms)
2026-11-07T05:00:50Z [load_day 2026-07-21] 2026-07-21 hour 6: 167086 events in 4 files, snapshot 338718630975046361 (task 3466 ms: download 1441 ms overlapping gunzip 196 ms, parse 761 ms, sort 100 ms, write 1413 ms, index 220 ms: 3 candidates, 30772 repo-hours, 8 releases; waiting 519 ms; commit 959 ms)
2026-11-07T05:00:51Z [load_day 2026-07-21] 2026-07-21 hour 7: 166377 events in 4 files, snapshot 711470853857753772 (task 3509 ms: download 1223 ms overlapping gunzip 197 ms, parse 762 ms, sort 110 ms, write 1366 ms, index 241 ms: 1 candidates, 31927 repo-hours, 4 releases; waiting 527 ms; commit 896 ms)
2026-11-07T05:00:54Z [load_day 2026-07-21] 2026-07-21 hour 8: 168190 events in 4 files, snapshot 2363053415631667401 (task 3691 ms: download 1275 ms overlapping gunzip 190 ms, parse 745 ms, sort 105 ms, write 1577 ms, index 242 ms: 3 candidates, 34678 repo-hours, 5 releases; waiting 526 ms; commit 940 ms)
2026-11-07T05:00:55Z [load_day 2026-07-21] 2026-07-21 hour 9: 160389 events in 4 files, snapshot 4220163754674463001 (task 3389 ms: download 1212 ms overlapping gunzip 179 ms, parse 701 ms, sort 97 ms, write 1413 ms, index 224 ms: 2 candidates, 31744 repo-hours, 11 releases; waiting 473 ms; commit 815 ms)
2026-11-07T05:00:59Z [load_day 2026-07-21] 2026-07-21 hour 10: 164974 events in 4 files, snapshot 1284052755666629153 (task 3639 ms: download 1471 ms overlapping gunzip 186 ms, parse 745 ms, sort 99 ms, write 1443 ms, index 278 ms: 1 candidates, 37442 repo-hours, 8 releases; waiting 529 ms; commit 983 ms)
2026-11-07T05:01:00Z [load_day 2026-07-21] 2026-07-21 hour 11: 165986 events in 4 files, snapshot 8688307960238311586 (task 3605 ms: download 1244 ms overlapping gunzip 188 ms, parse 746 ms, sort 104 ms, write 1455 ms, index 282 ms: 4 candidates, 35411 repo-hours, 11 releases; waiting 524 ms; commit 868 ms)
2026-11-07T05:01:03Z [load_day 2026-07-21] 2026-07-21 hour 12: 167128 events in 4 files, snapshot 7686805230871155752 (task 3887 ms: download 1250 ms overlapping gunzip 196 ms, parse 807 ms, sort 109 ms, write 1696 ms, index 224 ms: 3 candidates, 30933 repo-hours, 7 releases; waiting 541 ms; commit 917 ms)
2026-11-07T05:01:04Z [load_day 2026-07-21] 2026-07-21 hour 13: 162234 events in 4 files, snapshot 2028909173177372529 (task 3714 ms: download 1366 ms overlapping gunzip 185 ms, parse 723 ms, sort 103 ms, write 1550 ms, index 287 ms: 4 candidates, 38494 repo-hours, 6 releases; waiting 521 ms; commit 897 ms)
2026-11-07T05:01:07Z [load_day 2026-07-21] 2026-07-21 hour 14: 161070 events in 4 files, snapshot 2198355542193168470 (task 3320 ms: download 988 ms overlapping gunzip 195 ms, parse 755 ms, sort 115 ms, write 1410 ms, index 311 ms: 4 candidates, 39174 repo-hours, 23 releases; waiting 229 ms; commit 990 ms)
2026-11-07T05:01:08Z [load_day 2026-07-21] 2026-07-21 hour 15: 166086 events in 4 files, snapshot 5969865377075332209 (task 3745 ms: download 2057 ms overlapping gunzip 192 ms, parse 742 ms, sort 102 ms, write 1555 ms, index 296 ms: 8 candidates, 43251 repo-hours, 10 releases; waiting 519 ms; commit 946 ms)
2026-11-07T05:01:11Z [load_day 2026-07-21] 2026-07-21 hour 16: 162067 events in 4 files, snapshot 8923573705024307436 (task 3703 ms: download 1302 ms overlapping gunzip 199 ms, parse 776 ms, sort 104 ms, write 1501 ms, index 335 ms: 9 candidates, 46948 repo-hours, 8 releases; waiting 497 ms; commit 852 ms)
2026-11-07T05:01:13Z [load_day 2026-07-21] 2026-07-21 hour 17: 166383 events in 4 files, snapshot 4499293604619228474 (task 3838 ms: download 1427 ms overlapping gunzip 194 ms, parse 758 ms, sort 107 ms, write 1594 ms, index 345 ms: 2 candidates, 45551 repo-hours, 5 releases; waiting 524 ms; commit 765 ms)
2026-11-07T05:01:15Z [load_day 2026-07-21] 2026-07-21 hour 18: 165175 events in 4 files, snapshot 5433048972930720655 (task 3493 ms: download 969 ms overlapping gunzip 200 ms, parse 783 ms, sort 107 ms, write 1517 ms, index 333 ms: 6 candidates, 46742 repo-hours, 16 releases; waiting 264 ms; commit 730 ms)
2026-11-07T05:01:17Z [load_day 2026-07-21] 2026-07-21 hour 19: 164487 events in 4 files, snapshot 8720120700863579163 (task 3300 ms: download 737 ms overlapping gunzip 188 ms, parse 716 ms, sort 106 ms, write 1476 ms, index 334 ms: 2 candidates, 50493 repo-hours, 13 releases; waiting 187 ms; commit 908 ms)
2026-11-07T05:01:20Z [load_day 2026-07-21] 2026-07-21 hour 20: 163480 events in 4 files, snapshot 3921374891853536209 (task 3663 ms: download 1278 ms overlapping gunzip 194 ms, parse 737 ms, sort 102 ms, write 1418 ms, index 348 ms: 3 candidates, 49858 repo-hours, 5 releases; waiting 480 ms; commit 936 ms)
2026-11-07T05:01:21Z [load_day 2026-07-21] 2026-07-21 hour 21: 167080 events in 4 files, snapshot 6387688473779923719 (task 3743 ms: download 1395 ms overlapping gunzip 194 ms, parse 747 ms, sort 111 ms, write 1485 ms, index 336 ms: 2 candidates, 52488 repo-hours, 5 releases; waiting 531 ms; commit 1057 ms)
2026-11-07T05:01:24Z [load_day 2026-07-21] 2026-07-21 hour 22: 165770 events in 4 files, snapshot 4763258330709951963 (task 3827 ms: download 1594 ms overlapping gunzip 204 ms, parse 749 ms, sort 105 ms, write 1494 ms, index 374 ms: 6 candidates, 53384 repo-hours, 13 releases; waiting 546 ms; commit 847 ms)
2026-11-07T05:01:25Z [load_day 2026-07-21] 2026-07-21 hour 23: 160085 events in 4 files, snapshot 5606811952955142851 (task 3624 ms: download 1500 ms overlapping gunzip 195 ms, parse 735 ms, sort 101 ms, write 1365 ms, index 345 ms: 6 candidates, 53504 repo-hours, 11 releases; waiting 521 ms; commit 935 ms)
2026-11-07T05:01:30Z [load_day 2026-07-21] 2026-07-21: repo_hour merged from 24 files to 1 (1024983 rows, 4899 ms)
2026-11-07T05:01:32Z [load_day 2026-07-21] 2026-07-21: index committed in 6906 ms (23 + 1 + 24 files)
2026-11-07T05:01:32Z [load_day 2026-07-21] 2026-07-21: 3958927 events in 24 hours
2026-11-07T05:01:32Z [load_day 2026-07-21] attempt 1 succeeded