orcaLog in

Runs · run 377

load_day 2026-07-15, attempt 1 succeeded

Host
4e84322b8c45:73239
Started
2026-11-07T05:07:00Z
Ended
2026-11-07T05:08:14Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/377/load_day/2026-07-15/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:07:00Z [load_day 2026-07-15] attempt 1 started
2026-11-07T05:07:08Z [load_day 2026-07-15] 2026-07-15 hour 0: 159610 events in 4 files, snapshot 8811265323788531964 (task 4260 ms: download 1378 ms overlapping gunzip 256 ms, parse 935 ms, sort 113 ms, write 1516 ms, index 438 ms: 8 candidates, 67079 repo-hours, 99 releases; waiting 492 ms; commit 1028 ms)
2026-11-07T05:07:09Z [load_day 2026-07-15] 2026-07-15 hour 1: 162631 events in 4 files, snapshot 76422033147292940 (task 3951 ms: download 1428 ms overlapping gunzip 203 ms, parse 786 ms, sort 109 ms, write 1599 ms, index 525 ms: 9 candidates, 83981 repo-hours, 41 releases; waiting 505 ms; commit 965 ms)
2026-11-07T05:07:15Z [load_day 2026-07-15] 2026-07-15 hour 2: 163580 events in 4 files, snapshot 1999015910681463283 (task 4998 ms: download 1504 ms overlapping gunzip 240 ms, parse 821 ms, sort 113 ms, write 2370 ms, index 591 ms: 9 candidates, 92932 repo-hours, 78 releases; waiting 589 ms; commit 2342 ms)
2026-11-07T05:07:16Z [load_day 2026-07-15] 2026-07-15 hour 3: 162479 events in 4 files, snapshot 1223186334005076764 (task 6383 ms: download 1487 ms overlapping gunzip 223 ms, parse 830 ms, sort 108 ms, write 3700 ms, index 503 ms: 6 candidates, 73857 repo-hours, 67 releases; waiting 783 ms; commit 1025 ms)
2026-11-07T05:07:19Z [load_day 2026-07-15] 2026-07-15 hour 4: 164445 events in 4 files, snapshot 3578239354962320594 (task 3939 ms: download 1276 ms overlapping gunzip 202 ms, parse 769 ms, sort 114 ms, write 1650 ms, index 340 ms: 6 candidates, 53308 repo-hours, 22 releases; waiting 547 ms; commit 902 ms)
2026-11-07T05:07:20Z [load_day 2026-07-15] 2026-07-15 hour 5: 167966 events in 4 files, snapshot 3933365034421364478 (task 3691 ms: download 1489 ms overlapping gunzip 199 ms, parse 751 ms, sort 108 ms, write 1485 ms, index 331 ms: 1 candidates, 47677 repo-hours, 17 releases; waiting 521 ms; commit 951 ms)
2026-11-07T05:07:24Z [load_day 2026-07-15] 2026-07-15 hour 6: 163279 events in 4 files, snapshot 5505392899793227223 (task 3666 ms: download 1163 ms overlapping gunzip 200 ms, parse 756 ms, sort 120 ms, write 1502 ms, index 330 ms: 2 candidates, 49702 repo-hours, 17 releases; waiting 516 ms; commit 1333 ms)
2026-11-07T05:07:25Z [load_day 2026-07-15] 2026-07-15 hour 7: 165970 events in 4 files, snapshot 8903480782677092408 (task 3767 ms: download 1309 ms overlapping gunzip 195 ms, parse 727 ms, sort 104 ms, write 1538 ms, index 345 ms: 3 candidates, 54410 repo-hours, 14 releases; waiting 525 ms; commit 832 ms)
2026-11-07T05:07:31Z [load_day 2026-07-15] 2026-07-15 hour 8: 167783 events in 4 files, snapshot 8611881839752081396 (task 4751 ms: download 1294 ms overlapping gunzip 205 ms, parse 774 ms, sort 101 ms, write 2433 ms, index 395 ms: 1 candidates, 55234 repo-hours, 18 releases; waiting 522 ms; commit 2929 ms)
2026-11-07T05:07:32Z [load_day 2026-07-15] 2026-07-15 hour 9: 167128 events in 4 files, snapshot 8483614880037331047 (task 3813 ms: download 1293 ms overlapping gunzip 202 ms, parse 744 ms, sort 103 ms, write 1536 ms, index 387 ms: 0 candidates, 61303 repo-hours, 31 releases; waiting 553 ms; commit 909 ms)
2026-11-07T05:07:36Z [load_day 2026-07-15] 2026-07-15 hour 10: 166333 events in 4 files, snapshot 8724204904914781748 (task 4050 ms: download 1681 ms overlapping gunzip 227 ms, parse 825 ms, sort 106 ms, write 1554 ms, index 458 ms: 4 candidates, 70382 repo-hours, 35 releases; waiting 524 ms; commit 1130 ms)
2026-11-07T05:07:37Z [load_day 2026-07-15] 2026-07-15 hour 11: 167756 events in 4 files, snapshot 3044807611528936611 (task 4004 ms: download 1498 ms overlapping gunzip 242 ms, parse 872 ms, sort 115 ms, write 1522 ms, index 424 ms: 5 candidates, 62823 repo-hours, 19 releases; waiting 515 ms; commit 970 ms)
2026-11-07T05:07:40Z [load_day 2026-07-15] 2026-07-15 hour 12: 169372 events in 4 files, snapshot 6637550721359235235 (task 3764 ms: download 1339 ms overlapping gunzip 209 ms, parse 802 ms, sort 132 ms, write 1502 ms, index 371 ms: 6 candidates, 56603 repo-hours, 22 releases; waiting 518 ms; commit 1074 ms)
2026-11-07T05:07:41Z [load_day 2026-07-15] 2026-07-15 hour 13: 157865 events in 4 files, snapshot 8129496827076164107 (task 3718 ms: download 1156 ms overlapping gunzip 190 ms, parse 721 ms, sort 100 ms, write 1455 ms, index 486 ms: 1 candidates, 74795 repo-hours, 24 releases; waiting 507 ms; commit 832 ms)
2026-11-07T05:07:45Z [load_day 2026-07-15] 2026-07-15 hour 14: 160644 events in 4 files, snapshot 5446092653728701882 (task 3875 ms: download 1352 ms overlapping gunzip 195 ms, parse 720 ms, sort 105 ms, write 1510 ms, index 474 ms: 5 candidates, 68766 repo-hours, 30 releases; waiting 528 ms; commit 1027 ms)
2026-11-07T05:07:47Z [load_day 2026-07-15] 2026-07-15 hour 15: 165161 events in 4 files, snapshot 3883640961356252537 (task 3357 ms: download 344 ms overlapping gunzip 202 ms, parse 747 ms, sort 107 ms, write 1607 ms, index 473 ms: 4 candidates, 70099 repo-hours, 24 releases; waiting 16 ms; commit 1970 ms)
2026-11-07T05:07:49Z [load_day 2026-07-15] 2026-07-15 hour 16: 162159 events in 4 files, snapshot 2600926493160338970 (task 4112 ms: download 1257 ms overlapping gunzip 200 ms, parse 726 ms, sort 102 ms, write 1784 ms, index 410 ms: 7 candidates, 64487 repo-hours, 20 releases; waiting 528 ms; commit 859 ms)
2026-11-07T05:07:51Z [load_day 2026-07-15] 2026-07-15 hour 17: 162672 events in 4 files, snapshot 4110964476658098295 (task 3663 ms: download 1040 ms overlapping gunzip 202 ms, parse 765 ms, sort 110 ms, write 1509 ms, index 394 ms: 5 candidates, 59730 repo-hours, 15 releases; waiting 413 ms; commit 1031 ms)
2026-11-07T05:07:54Z [load_day 2026-07-15] 2026-07-15 hour 18: 165376 events in 4 files, snapshot 6191690298965795570 (task 3847 ms: download 1294 ms overlapping gunzip 204 ms, parse 761 ms, sort 103 ms, write 1437 ms, index 487 ms: 5 candidates, 62872 repo-hours, 12 releases; waiting 527 ms; commit 941 ms)
2026-11-07T05:07:56Z [load_day 2026-07-15] 2026-07-15 hour 19: 163751 events in 4 files, snapshot 1138377443921140898 (task 3951 ms: download 1352 ms overlapping gunzip 198 ms, parse 749 ms, sort 109 ms, write 1490 ms, index 447 ms: 3 candidates, 63512 repo-hours, 27 releases; waiting 541 ms; commit 1072 ms)
2026-11-07T05:07:58Z [load_day 2026-07-15] 2026-07-15 hour 20: 166578 events in 4 files, snapshot 2457602387002887633 (task 3833 ms: download 1663 ms overlapping gunzip 198 ms, parse 720 ms, sort 102 ms, write 1467 ms, index 573 ms: 6 candidates, 67800 repo-hours, 26 releases; waiting 222 ms; commit 1075 ms)
2026-11-07T05:08:00Z [load_day 2026-07-15] 2026-07-15 hour 21: 166447 events in 4 files, snapshot 7091251751641341658 (task 3970 ms: download 1417 ms overlapping gunzip 210 ms, parse 777 ms, sort 107 ms, write 1538 ms, index 536 ms: 5 candidates, 69894 repo-hours, 31 releases; waiting 517 ms; commit 1011 ms)
2026-11-07T05:08:03Z [load_day 2026-07-15] 2026-07-15 hour 22: 166423 events in 4 files, snapshot 7330743115355745499 (task 4209 ms: download 1301 ms overlapping gunzip 215 ms, parse 801 ms, sort 120 ms, write 1641 ms, index 546 ms: 3 candidates, 72860 repo-hours, 49 releases; waiting 530 ms; commit 1080 ms)
2026-11-07T05:08:05Z [load_day 2026-07-15] 2026-07-15 hour 23: 163258 events in 4 files, snapshot 6422116040085238548 (task 3996 ms: download 1621 ms overlapping gunzip 223 ms, parse 812 ms, sort 104 ms, write 1515 ms, index 499 ms: 4 candidates, 71063 repo-hours, 129 releases; waiting 522 ms; commit 1177 ms)
2026-11-07T05:08:12Z [load_day 2026-07-15] 2026-07-15: repo_hour merged from 24 files to 1 (1575169 rows, 6598 ms)
2026-11-07T05:08:14Z [load_day 2026-07-15] 2026-07-15: index committed in 8496 ms (23 + 1 + 24 files)
2026-11-07T05:08:14Z [load_day 2026-07-15] 2026-07-15: 3948666 events in 24 hours
2026-11-07T05:08:14Z [load_day 2026-07-15] attempt 1 succeeded