orcaLog in

Runs · run 467

load_day 2026-06-15, attempt 1 succeeded

Host
4e84322b8c45:99197
Started
2026-11-07T05:48:00Z
Ended
2026-11-07T05:49:11Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/467/load_day/2026-06-15/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:48:00Z [load_day 2026-06-15] attempt 1 started
2026-11-07T05:48:08Z [load_day 2026-06-15] 2026-06-15 hour 0: 159868 events in 4 files, snapshot 5957985942576956558 (task 5237 ms: download 1788 ms overlapping gunzip 308 ms, parse 1060 ms, sort 151 ms, write 2477 ms, index 444 ms: 5 candidates, 66647 repo-hours, 425 releases; waiting 523 ms; commit 997 ms)
2026-11-07T05:48:09Z [load_day 2026-06-15] 2026-06-15 hour 1: 155899 events in 4 files, snapshot 5910427327822457438 (task 5019 ms: download 1734 ms overlapping gunzip 282 ms, parse 999 ms, sort 144 ms, write 2323 ms, index 441 ms: 9 candidates, 68260 repo-hours, 366 releases; waiting 519 ms; commit 984 ms)
2026-11-07T05:48:13Z [load_day 2026-06-15] 2026-06-15 hour 2: 160662 events in 4 files, snapshot 2181027970864753945 (task 4259 ms: download 1735 ms overlapping gunzip 238 ms, parse 863 ms, sort 112 ms, write 1664 ms, index 535 ms: 6 candidates, 79448 repo-hours, 124 releases; waiting 530 ms; commit 1043 ms)
2026-11-07T05:48:14Z [load_day 2026-06-15] 2026-06-15 hour 3: 160991 events in 4 files, snapshot 3728566281615093344 (task 4377 ms: download 1528 ms overlapping gunzip 242 ms, parse 866 ms, sort 109 ms, write 1665 ms, index 524 ms: 11 candidates, 75454 repo-hours, 147 releases; waiting 668 ms; commit 863 ms)
2026-11-07T05:48:17Z [load_day 2026-06-15] 2026-06-15 hour 4: 165302 events in 4 files, snapshot 5388653450220622810 (task 4200 ms: download 1797 ms overlapping gunzip 244 ms, parse 828 ms, sort 105 ms, write 1631 ms, index 529 ms: 8 candidates, 82995 repo-hours, 76 releases; waiting 527 ms; commit 978 ms)
2026-11-07T05:48:19Z [load_day 2026-06-15] 2026-06-15 hour 5: 163797 events in 4 files, snapshot 9000976645626820309 (task 3984 ms: download 1225 ms overlapping gunzip 225 ms, parse 817 ms, sort 112 ms, write 1517 ms, index 551 ms: 10 candidates, 78050 repo-hours, 75 releases; waiting 521 ms; commit 996 ms)
2026-11-07T05:48:22Z [load_day 2026-06-15] 2026-06-15 hour 6: 160330 events in 4 files, snapshot 2204149264464046802 (task 3984 ms: download 1306 ms overlapping gunzip 219 ms, parse 809 ms, sort 104 ms, write 1540 ms, index 517 ms: 6 candidates, 73683 repo-hours, 53 releases; waiting 525 ms; commit 1071 ms)
2026-11-07T05:48:23Z [load_day 2026-06-15] 2026-06-15 hour 7: 160623 events in 4 files, snapshot 7665260727937425871 (task 3805 ms: download 1482 ms overlapping gunzip 204 ms, parse 759 ms, sort 106 ms, write 1403 ms, index 504 ms: 7 candidates, 75023 repo-hours, 46 releases; waiting 519 ms; commit 986 ms)
2026-11-07T05:48:27Z [load_day 2026-06-15] 2026-06-15 hour 8: 160925 events in 4 files, snapshot 8522181871347308391 (task 4058 ms: download 1193 ms overlapping gunzip 211 ms, parse 775 ms, sort 106 ms, write 1667 ms, index 528 ms: 6 candidates, 79713 repo-hours, 37 releases; waiting 536 ms; commit 846 ms)
2026-11-07T05:48:28Z [load_day 2026-06-15] 2026-06-15 hour 9: 161931 events in 4 files, snapshot 3258231837394529269 (task 3909 ms: download 1334 ms overlapping gunzip 204 ms, parse 758 ms, sort 102 ms, write 1477 ms, index 570 ms: 4 candidates, 83768 repo-hours, 28 releases; waiting 529 ms; commit 989 ms)
2026-11-07T05:48:31Z [load_day 2026-06-15] 2026-06-15 hour 10: 160287 events in 4 files, snapshot 9067529647242246586 (task 4008 ms: download 1333 ms overlapping gunzip 208 ms, parse 767 ms, sort 109 ms, write 1536 ms, index 536 ms: 7 candidates, 79831 repo-hours, 64 releases; waiting 525 ms; commit 968 ms)
2026-11-07T05:48:32Z [load_day 2026-06-15] 2026-06-15 hour 11: 159920 events in 4 files, snapshot 3641654554132751897 (task 3852 ms: download 1865 ms overlapping gunzip 205 ms, parse 790 ms, sort 103 ms, write 1399 ms, index 526 ms: 14 candidates, 80263 repo-hours, 40 releases; waiting 529 ms; commit 932 ms)
2026-11-07T05:48:36Z [load_day 2026-06-15] 2026-06-15 hour 12: 162822 events in 4 files, snapshot 8563243972879088150 (task 4013 ms: download 1333 ms overlapping gunzip 223 ms, parse 816 ms, sort 104 ms, write 1410 ms, index 595 ms: 11 candidates, 82504 repo-hours, 29 releases; waiting 522 ms; commit 1641 ms)
2026-11-07T05:48:37Z [load_day 2026-06-15] 2026-06-15 hour 13: 160740 events in 4 files, snapshot 2835214979195230541 (task 4262 ms: download 1136 ms overlapping gunzip 224 ms, parse 782 ms, sort 104 ms, write 1817 ms, index 594 ms: 10 candidates, 81781 repo-hours, 21 releases; waiting 508 ms; commit 884 ms)
2026-11-07T05:48:41Z [load_day 2026-06-15] 2026-06-15 hour 14: 158388 events in 4 files, snapshot 5339117224595122766 (task 3747 ms: download 1194 ms overlapping gunzip 207 ms, parse 740 ms, sort 99 ms, write 1462 ms, index 532 ms: 9 candidates, 83983 repo-hours, 45 releases; waiting 393 ms; commit 887 ms)
2026-11-07T05:48:42Z [load_day 2026-06-15] 2026-06-15 hour 15: 157497 events in 4 files, snapshot 6950884685149140018 (task 3922 ms: download 1513 ms overlapping gunzip 227 ms, parse 829 ms, sort 102 ms, write 1349 ms, index 582 ms: 8 candidates, 82132 repo-hours, 40 releases; waiting 531 ms; commit 1130 ms)
2026-11-07T05:48:46Z [load_day 2026-06-15] 2026-06-15 hour 16: 159451 events in 4 files, snapshot 5460172947751969779 (task 4055 ms: download 1309 ms overlapping gunzip 200 ms, parse 756 ms, sort 108 ms, write 1603 ms, index 553 ms: 9 candidates, 82554 repo-hours, 21 releases; waiting 551 ms; commit 774 ms)
2026-11-07T05:48:47Z [load_day 2026-06-15] 2026-06-15 hour 17: 159895 events in 4 files, snapshot 4616397433248043501 (task 3933 ms: download 923 ms overlapping gunzip 203 ms, parse 764 ms, sort 111 ms, write 1664 ms, index 575 ms: 15 candidates, 87461 repo-hours, 60 releases; waiting 16 ms; commit 920 ms)
2026-11-07T05:48:50Z [load_day 2026-06-15] 2026-06-15 hour 18: 158410 events in 4 files, snapshot 6617910665376611953 (task 4160 ms: download 1376 ms overlapping gunzip 219 ms, parse 839 ms, sort 113 ms, write 1476 ms, index 549 ms: 10 candidates, 80243 repo-hours, 60 releases; waiting 525 ms; commit 960 ms)
2026-11-07T05:48:54Z [load_day 2026-06-15] 2026-06-15 hour 19: 157232 events in 4 files, snapshot 6007079872829769813 (task 4394 ms: download 1528 ms overlapping gunzip 251 ms, parse 847 ms, sort 106 ms, write 1426 ms, index 535 ms: 12 candidates, 79253 repo-hours, 63 releases; waiting 527 ms; commit 2852 ms)
2026-11-07T05:48:56Z [load_day 2026-06-15] 2026-06-15 hour 20: 159976 events in 4 files, snapshot 5498489920952578916 (task 4336 ms: download 1592 ms overlapping gunzip 206 ms, parse 795 ms, sort 109 ms, write 1789 ms, index 523 ms: 12 candidates, 76819 repo-hours, 75 releases; waiting 529 ms; commit 975 ms)
2026-11-07T05:48:56Z [load_day 2026-06-15] 2026-06-15 hour 21: 160376 events in 4 files, snapshot 7406901074692027666 (task 4281 ms: download 1511 ms overlapping gunzip 236 ms, parse 809 ms, sort 119 ms, write 1751 ms, index 521 ms: 14 candidates, 76520 repo-hours, 100 releases; waiting 528 ms; commit 861 ms)
2026-11-07T05:49:00Z [load_day 2026-06-15] 2026-06-15 hour 22: 157797 events in 4 files, snapshot 1929792690921797863 (task 4217 ms: download 1541 ms overlapping gunzip 230 ms, parse 825 ms, sort 115 ms, write 1716 ms, index 492 ms: 8 candidates, 73276 repo-hours, 122 releases; waiting 522 ms; commit 941 ms)
2026-11-07T05:49:02Z [load_day 2026-06-15] 2026-06-15 hour 23: 156755 events in 4 files, snapshot 4347817399127240775 (task 4312 ms: download 1325 ms overlapping gunzip 260 ms, parse 941 ms, sort 124 ms, write 1742 ms, index 459 ms: 7 candidates, 71682 repo-hours, 236 releases; waiting 526 ms; commit 1119 ms)
2026-11-07T05:49:09Z [load_day 2026-06-15] 2026-06-15: repo_hour merged from 24 files to 1 (1881343 rows, 7603 ms)
2026-11-07T05:49:11Z [load_day 2026-06-15] 2026-06-15: index committed in 9195 ms (24 + 1 + 24 files)
2026-11-07T05:49:11Z [load_day 2026-06-15] 2026-06-15: 3839874 events in 24 hours
2026-11-07T05:49:11Z [load_day 2026-06-15] attempt 1 succeeded