orcaLog in

Runs · run 293

load_day 2026-08-12, attempt 1 succeeded

Host
4e84322b8c45:50273
Started
2026-11-07T04:36:19Z
Ended
2026-11-07T04:37:28Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/293/load_day/2026-08-12/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:36:19Z [load_day 2026-08-12] attempt 1 started
2026-11-07T04:36:27Z [load_day 2026-08-12] 2026-08-12 hour 0: 167071 events in 4 files, snapshot 4460816382297792506 (task 4256 ms: download 1414 ms overlapping gunzip 215 ms, parse 830 ms, sort 124 ms, write 1832 ms, index 454 ms: 10 candidates, 67763 repo-hours, 28 releases; waiting 503 ms; commit 760 ms)
2026-11-07T04:36:27Z [load_day 2026-08-12] 2026-08-12 hour 1: 167165 events in 4 files, snapshot 1028795668735249952 (task 4246 ms: download 1535 ms overlapping gunzip 200 ms, parse 793 ms, sort 118 ms, write 1665 ms, index 466 ms: 6 candidates, 74486 repo-hours, 20 releases; waiting 521 ms; commit 706 ms)
2026-11-07T04:36:31Z [load_day 2026-08-12] 2026-08-12 hour 2: 165533 events in 4 files, snapshot 4625412336752372566 (task 3816 ms: download 1525 ms overlapping gunzip 195 ms, parse 739 ms, sort 104 ms, write 1595 ms, index 293 ms: 2 candidates, 45097 repo-hours, 9 releases; waiting 604 ms; commit 834 ms)
2026-11-07T04:36:32Z [load_day 2026-08-12] 2026-08-12 hour 3: 169600 events in 4 files, snapshot 7298343453218330143 (task 3826 ms: download 1430 ms overlapping gunzip 216 ms, parse 809 ms, sort 121 ms, write 1575 ms, index 255 ms: 4 candidates, 38674 repo-hours, 44 releases; waiting 535 ms; commit 783 ms)
2026-11-07T04:36:36Z [load_day 2026-08-12] 2026-08-12 hour 4: 160559 events in 4 files, snapshot 286513535703027329 (task 4234 ms: download 1690 ms overlapping gunzip 238 ms, parse 833 ms, sort 108 ms, write 1820 ms, index 345 ms: 9 candidates, 52595 repo-hours, 163 releases; waiting 512 ms; commit 821 ms)
2026-11-07T04:36:37Z [load_day 2026-08-12] 2026-08-12 hour 5: 163126 events in 4 files, snapshot 6594264718494329162 (task 4260 ms: download 2028 ms overlapping gunzip 242 ms, parse 870 ms, sort 122 ms, write 1951 ms, index 273 ms: 2 candidates, 43053 repo-hours, 136 releases; waiting 528 ms; commit 836 ms)
2026-11-07T04:36:40Z [load_day 2026-08-12] 2026-08-12 hour 6: 162775 events in 4 files, snapshot 5163596209391116320 (task 3908 ms: download 1479 ms overlapping gunzip 221 ms, parse 801 ms, sort 133 ms, write 1638 ms, index 280 ms: 5 candidates, 41615 repo-hours, 44 releases; waiting 524 ms; commit 848 ms)
2026-11-07T04:36:41Z [load_day 2026-08-12] 2026-08-12 hour 7: 166236 events in 4 files, snapshot 1807053384863109595 (task 3792 ms: download 1432 ms overlapping gunzip 205 ms, parse 775 ms, sort 107 ms, write 1671 ms, index 270 ms: 3 candidates, 42056 repo-hours, 40 releases; waiting 514 ms; commit 857 ms)
2026-11-07T04:36:45Z [load_day 2026-08-12] 2026-08-12 hour 8: 168298 events in 4 files, snapshot 99193244647557257 (task 3878 ms: download 1411 ms overlapping gunzip 211 ms, parse 810 ms, sort 119 ms, write 1572 ms, index 279 ms: 1 candidates, 33971 repo-hours, 16 releases; waiting 522 ms; commit 938 ms)
2026-11-07T04:36:46Z [load_day 2026-08-12] 2026-08-12 hour 9: 160581 events in 4 files, snapshot 8040933345359734749 (task 3759 ms: download 1528 ms overlapping gunzip 197 ms, parse 736 ms, sort 105 ms, write 1628 ms, index 279 ms: 1 candidates, 40242 repo-hours, 34 releases; waiting 534 ms; commit 770 ms)
2026-11-07T04:36:50Z [load_day 2026-08-12] 2026-08-12 hour 10: 164743 events in 4 files, snapshot 4140722917157468885 (task 3960 ms: download 1917 ms overlapping gunzip 214 ms, parse 812 ms, sort 120 ms, write 1632 ms, index 346 ms: 3 candidates, 53760 repo-hours, 31 releases; waiting 514 ms; commit 906 ms)
2026-11-07T04:36:51Z [load_day 2026-08-12] 2026-08-12 hour 11: 165663 events in 4 files, snapshot 5405883229811490312 (task 3881 ms: download 1304 ms overlapping gunzip 202 ms, parse 758 ms, sort 112 ms, write 1599 ms, index 370 ms: 2 candidates, 58733 repo-hours, 19 releases; waiting 533 ms; commit 875 ms)
2026-11-07T04:36:54Z [load_day 2026-08-12] 2026-08-12 hour 12: 165276 events in 4 files, snapshot 6510366201566229311 (task 3910 ms: download 1388 ms overlapping gunzip 211 ms, parse 778 ms, sort 111 ms, write 1520 ms, index 446 ms: 5 candidates, 64330 repo-hours, 21 releases; waiting 535 ms; commit 822 ms)
2026-11-07T04:36:55Z [load_day 2026-08-12] 2026-08-12 hour 13: 163166 events in 4 files, snapshot 3535123855863929772 (task 3878 ms: download 1152 ms overlapping gunzip 207 ms, parse 777 ms, sort 115 ms, write 1564 ms, index 391 ms: 9 candidates, 59642 repo-hours, 24 releases; waiting 520 ms; commit 727 ms)
2026-11-07T04:36:59Z [load_day 2026-08-12] 2026-08-12 hour 14: 162301 events in 4 files, snapshot 7189514063427384114 (task 3932 ms: download 1094 ms overlapping gunzip 213 ms, parse 774 ms, sort 113 ms, write 1683 ms, index 365 ms: 5 candidates, 56283 repo-hours, 51 releases; waiting 210 ms; commit 908 ms)
2026-11-07T04:37:00Z [load_day 2026-08-12] 2026-08-12 hour 15: 156367 events in 4 files, snapshot 8580398954237296582 (task 3955 ms: download 1495 ms overlapping gunzip 212 ms, parse 753 ms, sort 103 ms, write 1734 ms, index 331 ms: 9 candidates, 52443 repo-hours, 64 releases; waiting 537 ms; commit 905 ms)
2026-11-07T04:37:04Z [load_day 2026-08-12] 2026-08-12 hour 16: 162815 events in 4 files, snapshot 26426342139457733 (task 4056 ms: download 1497 ms overlapping gunzip 230 ms, parse 844 ms, sort 126 ms, write 1789 ms, index 399 ms: 7 candidates, 56980 repo-hours, 50 releases; waiting 393 ms; commit 883 ms)
2026-11-07T04:37:04Z [load_day 2026-08-12] 2026-08-12 hour 17: 158458 events in 4 files, snapshot 5734649159944154409 (task 4078 ms: download 1250 ms overlapping gunzip 199 ms, parse 743 ms, sort 105 ms, write 1753 ms, index 415 ms: 4 candidates, 64395 repo-hours, 14 releases; waiting 527 ms; commit 751 ms)
2026-11-07T04:37:08Z [load_day 2026-08-12] 2026-08-12 hour 18: 158869 events in 4 files, snapshot 1441497886119153120 (task 3777 ms: download 1318 ms overlapping gunzip 197 ms, parse 754 ms, sort 101 ms, write 1475 ms, index 464 ms: 10 candidates, 67045 repo-hours, 31 releases; waiting 533 ms; commit 952 ms)
2026-11-07T04:37:09Z [load_day 2026-08-12] 2026-08-12 hour 19: 161217 events in 4 files, snapshot 8779957237293509570 (task 4155 ms: download 1405 ms overlapping gunzip 205 ms, parse 761 ms, sort 106 ms, write 1482 ms, index 428 ms: 7 candidates, 63908 repo-hours, 22 releases; waiting 916 ms; commit 656 ms)
2026-11-07T04:37:13Z [load_day 2026-08-12] 2026-08-12 hour 20: 164049 events in 4 files, snapshot 4856393509123215768 (task 3962 ms: download 1590 ms overlapping gunzip 213 ms, parse 847 ms, sort 125 ms, write 1463 ms, index 439 ms: 11 candidates, 62194 repo-hours, 27 releases; waiting 511 ms; commit 877 ms)
2026-11-07T04:37:14Z [load_day 2026-08-12] 2026-08-12 hour 21: 161759 events in 4 files, snapshot 5476573076059210840 (task 4100 ms: download 1543 ms overlapping gunzip 206 ms, parse 754 ms, sort 106 ms, write 1481 ms, index 392 ms: 9 candidates, 61844 repo-hours, 15 releases; waiting 808 ms; commit 870 ms)
2026-11-07T04:37:17Z [load_day 2026-08-12] 2026-08-12 hour 22: 162556 events in 4 files, snapshot 508565274791979600 (task 3749 ms: download 1351 ms overlapping gunzip 206 ms, parse 764 ms, sort 109 ms, write 1438 ms, index 405 ms: 9 candidates, 64974 repo-hours, 26 releases; waiting 526 ms; commit 969 ms)
2026-11-07T04:37:18Z [load_day 2026-08-12] 2026-08-12 hour 23: 166857 events in 4 files, snapshot 6982599230836059305 (task 4095 ms: download 1377 ms overlapping gunzip 202 ms, parse 768 ms, sort 103 ms, write 1612 ms, index 466 ms: 3 candidates, 69792 repo-hours, 23 releases; waiting 556 ms; commit 826 ms)
2026-11-07T04:37:24Z [load_day 2026-08-12] 2026-08-12: repo_hour merged from 24 files to 1 (1335875 rows, 5803 ms)
2026-11-07T04:37:28Z [load_day 2026-08-12] 2026-08-12: index committed in 9323 ms (24 + 1 + 24 files)
2026-11-07T04:37:28Z [load_day 2026-08-12] 2026-08-12: 3925040 events in 24 hours
2026-11-07T04:37:28Z [load_day 2026-08-12] attempt 1 succeeded