orcaLog in

Runs · run 398

load_day 2026-07-08, attempt 1 succeeded

Host
4e84322b8c45:79259
Started
2026-11-07T05:14:45Z
Ended
2026-11-07T05:15:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/398/load_day/2026-07-08/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:14:45Z [load_day 2026-07-08] attempt 1 started
2026-11-07T05:14:52Z [load_day 2026-07-08] 2026-07-08 hour 0: 163593 events in 4 files, snapshot 1287126284833057905 (task 3640 ms: download 958 ms overlapping gunzip 204 ms, parse 793 ms, sort 132 ms, write 1661 ms, index 470 ms: 5 candidates, 62418 repo-hours, 47 releases; waiting 171 ms; commit 962 ms)
2026-11-07T05:14:53Z [load_day 2026-07-08] 2026-07-08 hour 1: 163051 events in 4 files, snapshot 145368655578238090 (task 3776 ms: download 951 ms overlapping gunzip 188 ms, parse 751 ms, sort 114 ms, write 1626 ms, index 554 ms: 7 candidates, 74754 repo-hours, 34 releases; waiting 228 ms; commit 879 ms)
2026-11-07T05:14:58Z [load_day 2026-07-08] 2026-07-08 hour 2: 164275 events in 4 files, snapshot 3249251394710648166 (task 4026 ms: download 1459 ms overlapping gunzip 230 ms, parse 823 ms, sort 100 ms, write 1457 ms, index 500 ms: 8 candidates, 78033 repo-hours, 25 releases; waiting 532 ms; commit 2675 ms)
2026-11-07T05:14:59Z [load_day 2026-07-08] 2026-07-08 hour 3: 164021 events in 4 files, snapshot 6116154924496867053 (task 4382 ms: download 1059 ms overlapping gunzip 199 ms, parse 749 ms, sort 103 ms, write 2192 ms, index 443 ms: 13 candidates, 68685 repo-hours, 47 releases; waiting 399 ms; commit 1041 ms)
2026-11-07T05:15:02Z [load_day 2026-07-08] 2026-07-08 hour 4: 165163 events in 4 files, snapshot 6020386569415735171 (task 3826 ms: download 1128 ms overlapping gunzip 206 ms, parse 786 ms, sort 118 ms, write 1498 ms, index 463 ms: 16 candidates, 64282 repo-hours, 23 releases; waiting 540 ms; commit 958 ms)
2026-11-07T05:15:04Z [load_day 2026-07-08] 2026-07-08 hour 5: 160342 events in 4 files, snapshot 4727660424039897392 (task 3821 ms: download 1405 ms overlapping gunzip 188 ms, parse 737 ms, sort 114 ms, write 1455 ms, index 486 ms: 10 candidates, 65098 repo-hours, 15 releases; waiting 539 ms; commit 1120 ms)
2026-11-07T05:15:07Z [load_day 2026-07-08] 2026-07-08 hour 6: 163934 events in 4 files, snapshot 4668852448054146587 (task 3803 ms: download 1338 ms overlapping gunzip 199 ms, parse 765 ms, sort 117 ms, write 1415 ms, index 458 ms: 7 candidates, 69219 repo-hours, 25 releases; waiting 537 ms; commit 1762 ms)
2026-11-07T05:15:08Z [load_day 2026-07-08] 2026-07-08 hour 7: 165163 events in 4 files, snapshot 718378724204667092 (task 3809 ms: download 1415 ms overlapping gunzip 207 ms, parse 769 ms, sort 114 ms, write 1471 ms, index 443 ms: 7 candidates, 68407 repo-hours, 15 releases; waiting 520 ms; commit 898 ms)
2026-11-07T05:15:12Z [load_day 2026-07-08] 2026-07-08 hour 8: 166262 events in 4 files, snapshot 4880460397441221898 (task 3924 ms: download 1285 ms overlapping gunzip 200 ms, parse 780 ms, sort 111 ms, write 1559 ms, index 463 ms: 11 candidates, 67525 repo-hours, 14 releases; waiting 521 ms; commit 1065 ms)
2026-11-07T05:15:13Z [load_day 2026-07-08] 2026-07-08 hour 9: 165775 events in 4 files, snapshot 1576723585100470218 (task 3760 ms: download 1392 ms overlapping gunzip 199 ms, parse 772 ms, sort 107 ms, write 1499 ms, index 377 ms: 3 candidates, 59363 repo-hours, 13 releases; waiting 515 ms; commit 953 ms)
2026-11-07T05:15:16Z [load_day 2026-07-08] 2026-07-08 hour 10: 165266 events in 4 files, snapshot 7491171455206908091 (task 3812 ms: download 1374 ms overlapping gunzip 215 ms, parse 801 ms, sort 114 ms, write 1474 ms, index 391 ms: 6 candidates, 57094 repo-hours, 22 releases; waiting 528 ms; commit 1115 ms)
2026-11-07T05:15:17Z [load_day 2026-07-08] 2026-07-08 hour 11: 168073 events in 4 files, snapshot 6625410468879733070 (task 3866 ms: download 1334 ms overlapping gunzip 210 ms, parse 820 ms, sort 105 ms, write 1535 ms, index 370 ms: 7 candidates, 57724 repo-hours, 12 releases; waiting 499 ms; commit 930 ms)
2026-11-07T05:15:20Z [load_day 2026-07-08] 2026-07-08 hour 12: 164443 events in 4 files, snapshot 8365391923043355455 (task 3143 ms: download 368 ms overlapping gunzip 203 ms, parse 766 ms, sort 105 ms, write 1474 ms, index 386 ms: 6 candidates, 57350 repo-hours, 29 releases; waiting 18 ms; commit 1000 ms)
2026-11-07T05:15:22Z [load_day 2026-07-08] 2026-07-08 hour 13: 163566 events in 4 files, snapshot 6575119573705495957 (task 4024 ms: download 1737 ms overlapping gunzip 212 ms, parse 787 ms, sort 106 ms, write 1520 ms, index 507 ms: 4 candidates, 66875 repo-hours, 15 releases; waiting 533 ms; commit 973 ms)
2026-11-07T05:15:24Z [load_day 2026-07-08] 2026-07-08 hour 14: 159060 events in 4 files, snapshot 1425361371660079072 (task 3687 ms: download 1225 ms overlapping gunzip 190 ms, parse 720 ms, sort 111 ms, write 1426 ms, index 417 ms: 7 candidates, 64189 repo-hours, 13 releases; waiting 512 ms; commit 912 ms)
2026-11-07T05:15:26Z [load_day 2026-07-08] 2026-07-08 hour 15: 167850 events in 4 files, snapshot 4733813401852746403 (task 3650 ms: download 1326 ms overlapping gunzip 205 ms, parse 764 ms, sort 99 ms, write 1450 ms, index 432 ms: 4 candidates, 64582 repo-hours, 24 releases; waiting 400 ms; commit 959 ms)
2026-11-07T05:15:28Z [load_day 2026-07-08] 2026-07-08 hour 16: 163715 events in 4 files, snapshot 7810658765159810809 (task 3736 ms: download 1175 ms overlapping gunzip 196 ms, parse 748 ms, sort 110 ms, write 1394 ms, index 502 ms: 0 candidates, 67990 repo-hours, 17 releases; waiting 470 ms; commit 1000 ms)
2026-11-07T05:15:31Z [load_day 2026-07-08] 2026-07-08 hour 17: 163446 events in 4 files, snapshot 2115229939205801783 (task 3745 ms: download 2245 ms overlapping gunzip 192 ms, parse 721 ms, sort 97 ms, write 1417 ms, index 477 ms: 6 candidates, 64355 repo-hours, 14 releases; waiting 529 ms; commit 1225 ms)
2026-11-07T05:15:32Z [load_day 2026-07-08] 2026-07-08 hour 18: 159737 events in 4 files, snapshot 413538336705447702 (task 3497 ms: download 1436 ms overlapping gunzip 185 ms, parse 716 ms, sort 99 ms, write 1301 ms, index 389 ms: 3 candidates, 62880 repo-hours, 16 releases; waiting 528 ms; commit 913 ms)
2026-11-07T05:15:35Z [load_day 2026-07-08] 2026-07-08 hour 19: 164650 events in 4 files, snapshot 2629316114311746957 (task 3812 ms: download 1188 ms overlapping gunzip 196 ms, parse 752 ms, sort 103 ms, write 1494 ms, index 495 ms: 3 candidates, 65573 repo-hours, 8 releases; waiting 523 ms; commit 1010 ms)
2026-11-07T05:15:37Z [load_day 2026-07-08] 2026-07-08 hour 20: 162251 events in 4 files, snapshot 4954662048855467926 (task 3666 ms: download 1303 ms overlapping gunzip 191 ms, parse 721 ms, sort 97 ms, write 1356 ms, index 485 ms: 4 candidates, 67636 repo-hours, 14 releases; waiting 521 ms; commit 962 ms)
2026-11-07T05:15:39Z [load_day 2026-07-08] 2026-07-08 hour 21: 165961 events in 4 files, snapshot 8220128012295190219 (task 3784 ms: download 1323 ms overlapping gunzip 210 ms, parse 777 ms, sort 108 ms, write 1412 ms, index 451 ms: 6 candidates, 68531 repo-hours, 15 releases; waiting 534 ms; commit 990 ms)
2026-11-07T05:15:41Z [load_day 2026-07-08] 2026-07-08 hour 22: 166970 events in 4 files, snapshot 7367451057054443369 (task 3756 ms: download 1708 ms overlapping gunzip 200 ms, parse 745 ms, sort 100 ms, write 1373 ms, index 436 ms: 4 candidates, 66844 repo-hours, 21 releases; waiting 519 ms; commit 934 ms)
2026-11-07T05:15:43Z [load_day 2026-07-08] 2026-07-08 hour 23: 165873 events in 4 files, snapshot 4730820105883977181 (task 3603 ms: download 1441 ms overlapping gunzip 199 ms, parse 741 ms, sort 102 ms, write 1385 ms, index 373 ms: 5 candidates, 63056 repo-hours, 19 releases; waiting 524 ms; commit 861 ms)
2026-11-07T05:15:50Z [load_day 2026-07-08] 2026-07-08: repo_hour merged from 24 files to 1 (1572463 rows, 6503 ms)
2026-11-07T05:15:52Z [load_day 2026-07-08] 2026-07-08: index committed in 8427 ms (23 + 1 + 24 files)
2026-11-07T05:15:52Z [load_day 2026-07-08] 2026-07-08: 3942440 events in 24 hours
2026-11-07T05:15:52Z [load_day 2026-07-08] attempt 1 succeeded