orcaLog in

Runs · run 275

load_day 2026-08-18, attempt 1 succeeded

Host
4e84322b8c45:45675
Started
2026-11-07T04:30:22Z
Ended
2026-11-07T04:31:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/275/load_day/2026-08-18/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:30:22Z [load_day 2026-08-18] attempt 1 started
2026-11-07T04:30:28Z [load_day 2026-08-18] 2026-08-18 hour 0: 157724 events in 4 files, snapshot 2830402194569367407 (task 3850 ms: download 1472 ms overlapping gunzip 180 ms, parse 723 ms, sort 109 ms, write 1694 ms, index 280 ms: 2 candidates, 42709 repo-hours, 12 releases; waiting 521 ms; commit 739 ms)
2026-11-07T04:30:29Z [load_day 2026-08-18] 2026-08-18 hour 1: 166884 events in 4 files, snapshot 6096656616469440333 (task 3986 ms: download 1324 ms overlapping gunzip 202 ms, parse 825 ms, sort 112 ms, write 1730 ms, index 321 ms: 2 candidates, 47101 repo-hours, 4 releases; waiting 515 ms; commit 765 ms)
2026-11-07T04:30:32Z [load_day 2026-08-18] 2026-08-18 hour 2: 164085 events in 4 files, snapshot 7747516770524026489 (task 3609 ms: download 1153 ms overlapping gunzip 194 ms, parse 742 ms, sort 96 ms, write 1538 ms, index 249 ms: 3 candidates, 38588 repo-hours, 18 releases; waiting 516 ms; commit 581 ms)
2026-11-07T04:30:33Z [load_day 2026-08-18] 2026-08-18 hour 3: 169186 events in 4 files, snapshot 465578981984480677 (task 3721 ms: download 1513 ms overlapping gunzip 206 ms, parse 835 ms, sort 111 ms, write 1494 ms, index 241 ms: 1 candidates, 36226 repo-hours, 18 releases; waiting 541 ms; commit 683 ms)
2026-11-07T04:30:37Z [load_day 2026-08-18] 2026-08-18 hour 4: 171283 events in 4 files, snapshot 3633615118559887495 (task 4173 ms: download 1409 ms overlapping gunzip 214 ms, parse 811 ms, sort 115 ms, write 1645 ms, index 240 ms: 2 candidates, 34942 repo-hours, 12 releases; waiting 874 ms; commit 837 ms)
2026-11-07T04:30:38Z [load_day 2026-08-18] 2026-08-18 hour 5: 169382 events in 4 files, snapshot 5092138752688949594 (task 3696 ms: download 1623 ms overlapping gunzip 202 ms, parse 783 ms, sort 115 ms, write 1529 ms, index 260 ms: 5 candidates, 37902 repo-hours, 14 releases; waiting 521 ms; commit 815 ms)
2026-11-07T04:30:41Z [load_day 2026-08-18] 2026-08-18 hour 6: 167870 events in 4 files, snapshot 7016090844059019047 (task 3547 ms: download 1461 ms overlapping gunzip 195 ms, parse 750 ms, sort 101 ms, write 1464 ms, index 235 ms: 2 candidates, 29902 repo-hours, 17 releases; waiting 530 ms; commit 736 ms)
2026-11-07T04:30:42Z [load_day 2026-08-18] 2026-08-18 hour 7: 160080 events in 4 files, snapshot 7759073149749898229 (task 3531 ms: download 1278 ms overlapping gunzip 191 ms, parse 785 ms, sort 112 ms, write 1459 ms, index 151 ms: 0 candidates, 24369 repo-hours, 13 releases; waiting 542 ms; commit 694 ms)
2026-11-07T04:30:45Z [load_day 2026-08-18] 2026-08-18 hour 8: 126260 events in 3 files, snapshot 489921791682542298 (task 3142 ms: download 1457 ms overlapping gunzip 160 ms, parse 613 ms, sort 80 ms, write 1266 ms, index 169 ms: 0 candidates, 23903 repo-hours, 21 releases; waiting 545 ms; commit 972 ms)
2026-11-07T04:30:46Z [load_day 2026-08-18] 2026-08-18 hour 9: 105049 events in 3 files, snapshot 8097490656110776702 (task 2665 ms: download 1109 ms overlapping gunzip 129 ms, parse 485 ms, sort 64 ms, write 990 ms, index 156 ms: 2 candidates, 22399 repo-hours, 27 releases; waiting 539 ms; commit 771 ms)
2026-11-07T04:30:48Z [load_day 2026-08-18] 2026-08-18 hour 10: 82124 events in 2 files, snapshot 8836238855876475603 (task 2519 ms: download 1077 ms overlapping gunzip 112 ms, parse 417 ms, sort 51 ms, write 909 ms, index 156 ms: 0 candidates, 20900 repo-hours, 34 releases; waiting 550 ms; commit 862 ms)
2026-11-07T04:30:49Z [load_day 2026-08-18] 2026-08-18 hour 11: 79964 events in 2 files, snapshot 7660587502335553830 (task 2191 ms: download 784 ms overlapping gunzip 112 ms, parse 392 ms, sort 51 ms, write 760 ms, index 155 ms: 1 candidates, 21666 repo-hours, 58 releases; waiting 425 ms; commit 889 ms)
2026-11-07T04:30:51Z [load_day 2026-08-18] 2026-08-18 hour 12: 76711 events in 2 files, snapshot 4785920160862167923 (task 2316 ms: download 899 ms overlapping gunzip 105 ms, parse 393 ms, sort 45 ms, write 756 ms, index 152 ms: 2 candidates, 19167 repo-hours, 57 releases; waiting 551 ms; commit 967 ms)
2026-11-07T04:30:52Z [load_day 2026-08-18] 2026-08-18 hour 13: 47659 events in 1 files, snapshot 5627925746077365666 (task 1802 ms: download 806 ms overlapping gunzip 71 ms, parse 262 ms, sort 35 ms, write 473 ms, index 110 ms: 1 candidates, 14420 repo-hours, 25 releases; waiting 541 ms; commit 862 ms)
2026-11-07T04:30:53Z [load_day 2026-08-18] 2026-08-18 hour 14: 41906 events in 1 files, snapshot 3140665651922476264 (task 1692 ms: download 790 ms overlapping gunzip 64 ms, parse 235 ms, sort 25 ms, write 411 ms, index 95 ms: 0 candidates, 13691 repo-hours, 30 releases; waiting 534 ms; commit 934 ms)
2026-11-07T04:30:54Z [load_day 2026-08-18] 2026-08-18 hour 15: 41127 events in 1 files, snapshot 150832500443728328 (task 1630 ms: download 775 ms overlapping gunzip 61 ms, parse 220 ms, sort 23 ms, write 426 ms, index 88 ms: 0 candidates, 13526 repo-hours, 33 releases; waiting 532 ms; commit 694 ms)
2026-11-07T04:30:55Z [load_day 2026-08-18] 2026-08-18 hour 16: 35913 events in 1 files, snapshot 4034903872820037860 (task 1700 ms: download 776 ms overlapping gunzip 59 ms, parse 213 ms, sort 20 ms, write 401 ms, index 95 ms: 0 candidates, 13267 repo-hours, 21 releases; waiting 537 ms; commit 860 ms)
2026-11-07T04:30:56Z [load_day 2026-08-18] 2026-08-18 hour 17: 35116 events in 1 files, snapshot 3528156304613817289 (task 1648 ms: download 772 ms overlapping gunzip 61 ms, parse 217 ms, sort 20 ms, write 404 ms, index 90 ms: 0 candidates, 13637 repo-hours, 30 releases; waiting 537 ms; commit 748 ms)
2026-11-07T04:30:58Z [load_day 2026-08-18] 2026-08-18 hour 18: 38721 events in 1 files, snapshot 747257133051600396 (task 1740 ms: download 792 ms overlapping gunzip 67 ms, parse 232 ms, sort 23 ms, write 416 ms, index 124 ms: 1 candidates, 14975 repo-hours, 40 releases; waiting 535 ms; commit 745 ms)
2026-11-07T04:30:59Z [load_day 2026-08-18] 2026-08-18 hour 19: 36881 events in 1 files, snapshot 4205051168030126797 (task 1750 ms: download 797 ms overlapping gunzip 68 ms, parse 235 ms, sort 23 ms, write 488 ms, index 106 ms: 4 candidates, 14466 repo-hours, 49 releases; waiting 528 ms; commit 784 ms)
2026-11-07T04:31:00Z [load_day 2026-08-18] 2026-08-18 hour 20: 35818 events in 1 files, snapshot 4712828921061596927 (task 1643 ms: download 779 ms overlapping gunzip 66 ms, parse 230 ms, sort 22 ms, write 407 ms, index 110 ms: 2 candidates, 14086 repo-hours, 40 releases; waiting 533 ms; commit 846 ms)
2026-11-07T04:31:01Z [load_day 2026-08-18] 2026-08-18 hour 21: 35512 events in 1 files, snapshot 4927518293152288826 (task 1732 ms: download 807 ms overlapping gunzip 73 ms, parse 250 ms, sort 24 ms, write 503 ms, index 119 ms: 1 candidates, 14472 repo-hours, 65 releases; waiting 546 ms; commit 854 ms)
2026-11-07T04:31:03Z [load_day 2026-08-18] 2026-08-18 hour 22: 34509 events in 1 files, snapshot 2940274100374167521 (task 1866 ms: download 815 ms overlapping gunzip 79 ms, parse 259 ms, sort 31 ms, write 525 ms, index 112 ms: 0 candidates, 14055 repo-hours, 98 releases; waiting 543 ms; commit 948 ms)
2026-11-07T04:31:04Z [load_day 2026-08-18] 2026-08-18 hour 23: 32583 events in 1 files, snapshot 2564299252273859143 (task 2066 ms: download 860 ms overlapping gunzip 82 ms, parse 270 ms, sort 21 ms, write 543 ms, index 102 ms: 1 candidates, 13861 repo-hours, 96 releases; waiting 576 ms; commit 1097 ms)
2026-11-07T04:31:07Z [load_day 2026-08-18] 2026-08-18: repo_hour merged from 24 files to 1 (554230 rows, 2871 ms)
2026-11-07T04:31:09Z [load_day 2026-08-18] 2026-08-18: index committed in 4407 ms (16 + 1 + 24 files)
2026-11-07T04:31:09Z [load_day 2026-08-18] 2026-08-18: 2212347 events in 24 hours
2026-11-07T04:31:09Z [load_day 2026-08-18] attempt 1 succeeded