orcaLog in

Runs · run 524

load_day 2026-05-27, attempt 1 succeeded

Host
4e84322b8c45:114997
Started
2026-11-07T06:12:46Z
Ended
2026-11-07T06:14:00Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/524/load_day/2026-05-27/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:12:46Z [load_day 2026-05-27] attempt 1 started
2026-11-07T06:12:54Z [load_day 2026-05-27] 2026-05-27 hour 0: 146982 events in 3 files, snapshot 5945597007670273761 (task 5569 ms: download 1872 ms overlapping gunzip 332 ms, parse 1138 ms, sort 155 ms, write 2592 ms, index 440 ms: 5 candidates, 69463 repo-hours, 676 releases; waiting 576 ms; commit 989 ms)
2026-11-07T06:12:56Z [load_day 2026-05-27] 2026-05-27 hour 1: 144884 events in 3 files, snapshot 8486216316833904752 (task 5544 ms: download 1928 ms overlapping gunzip 313 ms, parse 1068 ms, sort 147 ms, write 2469 ms, index 462 ms: 10 candidates, 70524 repo-hours, 588 releases; waiting 530 ms; commit 1287 ms)
2026-11-07T06:13:00Z [load_day 2026-05-27] 2026-05-27 hour 2: 155316 events in 4 files, snapshot 7275986356510611944 (task 4623 ms: download 1616 ms overlapping gunzip 281 ms, parse 980 ms, sort 155 ms, write 1813 ms, index 589 ms: 7 candidates, 87317 repo-hours, 224 releases; waiting 531 ms; commit 1405 ms)
2026-11-07T06:13:01Z [load_day 2026-05-27] 2026-05-27 hour 3: 157935 events in 4 files, snapshot 986369014451910777 (task 4501 ms: download 1662 ms overlapping gunzip 261 ms, parse 887 ms, sort 123 ms, write 1873 ms, index 513 ms: 3 candidates, 82090 repo-hours, 246 releases; waiting 545 ms; commit 1043 ms)
2026-11-07T06:13:05Z [load_day 2026-05-27] 2026-05-27 hour 4: 156086 events in 4 files, snapshot 8893415211837653573 (task 4390 ms: download 1740 ms overlapping gunzip 256 ms, parse 875 ms, sort 124 ms, write 1783 ms, index 555 ms: 7 candidates, 79417 repo-hours, 197 releases; waiting 526 ms; commit 1143 ms)
2026-11-07T06:13:06Z [load_day 2026-05-27] 2026-05-27 hour 5: 154607 events in 4 files, snapshot 4040836315290736860 (task 4613 ms: download 1546 ms overlapping gunzip 298 ms, parse 982 ms, sort 143 ms, write 1865 ms, index 500 ms: 8 candidates, 74735 repo-hours, 294 releases; waiting 529 ms; commit 1080 ms)
2026-11-07T06:13:10Z [load_day 2026-05-27] 2026-05-27 hour 6: 156636 events in 4 files, snapshot 1525275110246175383 (task 4287 ms: download 1702 ms overlapping gunzip 256 ms, parse 879 ms, sort 101 ms, write 1660 ms, index 538 ms: 5 candidates, 80076 repo-hours, 166 releases; waiting 530 ms; commit 1111 ms)
2026-11-07T06:13:11Z [load_day 2026-05-27] 2026-05-27 hour 7: 158435 events in 4 files, snapshot 740373667550161092 (task 3957 ms: download 1280 ms overlapping gunzip 234 ms, parse 834 ms, sort 100 ms, write 1460 ms, index 480 ms: 4 candidates, 73898 repo-hours, 91 releases; waiting 88 ms; commit 1073 ms)
2026-11-07T06:13:14Z [load_day 2026-05-27] 2026-05-27 hour 8: 155868 events in 4 files, snapshot 8449894983315158426 (task 3884 ms: download 1246 ms overlapping gunzip 219 ms, parse 781 ms, sort 103 ms, write 1468 ms, index 525 ms: 8 candidates, 79696 repo-hours, 77 releases; waiting 526 ms; commit 918 ms)
2026-11-07T06:13:15Z [load_day 2026-05-27] 2026-05-27 hour 9: 154449 events in 4 files, snapshot 741089484247938715 (task 3836 ms: download 1198 ms overlapping gunzip 202 ms, parse 739 ms, sort 106 ms, write 1429 ms, index 513 ms: 3 candidates, 77880 repo-hours, 66 releases; waiting 546 ms; commit 997 ms)
2026-11-07T06:13:19Z [load_day 2026-05-27] 2026-05-27 hour 10: 150080 events in 4 files, snapshot 810370031887203499 (task 3978 ms: download 1209 ms overlapping gunzip 203 ms, parse 733 ms, sort 105 ms, write 1646 ms, index 493 ms: 5 candidates, 75647 repo-hours, 88 releases; waiting 539 ms; commit 1361 ms)
2026-11-07T06:13:20Z [load_day 2026-05-27] 2026-05-27 hour 11: 145843 events in 3 files, snapshot 8058297652894795577 (task 4203 ms: download 1338 ms overlapping gunzip 246 ms, parse 887 ms, sort 136 ms, write 1771 ms, index 475 ms: 5 candidates, 74911 repo-hours, 260 releases; waiting 366 ms; commit 1232 ms)
2026-11-07T06:13:24Z [load_day 2026-05-27] 2026-05-27 hour 12: 139956 events in 3 files, snapshot 2104941808242912058 (task 4480 ms: download 1564 ms overlapping gunzip 257 ms, parse 886 ms, sort 122 ms, write 1901 ms, index 499 ms: 7 candidates, 79522 repo-hours, 330 releases; waiting 529 ms; commit 1221 ms)
2026-11-07T06:13:25Z [load_day 2026-05-27] 2026-05-27 hour 13: 146637 events in 3 files, snapshot 41437163969809333 (task 3922 ms: download 1346 ms overlapping gunzip 206 ms, parse 748 ms, sort 98 ms, write 1436 ms, index 525 ms: 3 candidates, 78819 repo-hours, 111 releases; waiting 607 ms; commit 1053 ms)
2026-11-07T06:13:29Z [load_day 2026-05-27] 2026-05-27 hour 14: 150735 events in 4 files, snapshot 3180449774040506112 (task 3922 ms: download 1621 ms overlapping gunzip 211 ms, parse 785 ms, sort 106 ms, write 1388 ms, index 608 ms: 4 candidates, 84278 repo-hours, 60 releases; waiting 528 ms; commit 1103 ms)
2026-11-07T06:13:30Z [load_day 2026-05-27] 2026-05-27 hour 15: 151510 events in 4 files, snapshot 24003038201281317 (task 3842 ms: download 1269 ms overlapping gunzip 208 ms, parse 741 ms, sort 110 ms, write 1425 ms, index 568 ms: 4 candidates, 87330 repo-hours, 51 releases; waiting 572 ms; commit 1082 ms)
2026-11-07T06:13:34Z [load_day 2026-05-27] 2026-05-27 hour 16: 155390 events in 4 files, snapshot 8174591764471475670 (task 4298 ms: download 1436 ms overlapping gunzip 211 ms, parse 768 ms, sort 111 ms, write 1797 ms, index 601 ms: 6 candidates, 83992 repo-hours, 64 releases; waiting 529 ms; commit 1009 ms)
2026-11-07T06:13:35Z [load_day 2026-05-27] 2026-05-27 hour 17: 159022 events in 4 files, snapshot 7988982241893533318 (task 4212 ms: download 1386 ms overlapping gunzip 213 ms, parse 770 ms, sort 115 ms, write 1780 ms, index 552 ms: 14 candidates, 84241 repo-hours, 71 releases; waiting 519 ms; commit 1476 ms)
2026-11-07T06:13:39Z [load_day 2026-05-27] 2026-05-27 hour 18: 152966 events in 4 files, snapshot 4481186578550049646 (task 4033 ms: download 1386 ms overlapping gunzip 209 ms, parse 744 ms, sort 105 ms, write 1592 ms, index 576 ms: 10 candidates, 80214 repo-hours, 74 releases; waiting 522 ms; commit 1126 ms)
2026-11-07T06:13:40Z [load_day 2026-05-27] 2026-05-27 hour 19: 156239 events in 4 files, snapshot 4644565171426301629 (task 4257 ms: download 1522 ms overlapping gunzip 218 ms, parse 770 ms, sort 102 ms, write 1762 ms, index 556 ms: 10 candidates, 81309 repo-hours, 97 releases; waiting 534 ms; commit 983 ms)
2026-11-07T06:13:44Z [load_day 2026-05-27] 2026-05-27 hour 20: 156188 events in 4 files, snapshot 8078457689548047610 (task 4677 ms: download 1484 ms overlapping gunzip 269 ms, parse 857 ms, sort 131 ms, write 1654 ms, index 544 ms: 6 candidates, 81952 repo-hours, 124 releases; waiting 518 ms; commit 908 ms)
2026-11-07T06:13:45Z [load_day 2026-05-27] 2026-05-27 hour 21: 157897 events in 4 files, snapshot 960409454521722627 (task 4001 ms: download 935 ms overlapping gunzip 270 ms, parse 898 ms, sort 123 ms, write 1701 ms, index 494 ms: 12 candidates, 75536 repo-hours, 197 releases; waiting 184 ms; commit 1512 ms)
2026-11-07T06:13:50Z [load_day 2026-05-27] 2026-05-27 hour 22: 152133 events in 4 files, snapshot 2882482477520763953 (task 5167 ms: download 2008 ms overlapping gunzip 257 ms, parse 892 ms, sort 121 ms, write 2500 ms, index 456 ms: 8 candidates, 70624 repo-hours, 275 releases; waiting 564 ms; commit 1310 ms)
2026-11-07T06:13:51Z [load_day 2026-05-27] 2026-05-27 hour 23: 150972 events in 4 files, snapshot 9163020140229233658 (task 5458 ms: download 1714 ms overlapping gunzip 322 ms, parse 1113 ms, sort 153 ms, write 2364 ms, index 479 ms: 8 candidates, 75768 repo-hours, 581 releases; waiting 531 ms; commit 978 ms)
2026-11-07T06:13:59Z [load_day 2026-05-27] 2026-05-27: repo_hour merged from 24 files to 1 (1889239 rows, 7678 ms)
2026-11-07T06:14:00Z [load_day 2026-05-27] 2026-05-27: index committed in 9416 ms (24 + 1 + 24 files)
2026-11-07T06:14:00Z [load_day 2026-05-27] 2026-05-27: 3666766 events in 24 hours
2026-11-07T06:14:00Z [load_day 2026-05-27] attempt 1 succeeded