orcaLog in

Runs · run 224

load_day 2026-09-04, attempt 1 succeeded

Host
4e84322b8c45:38425
Started
2026-11-07T04:17:15Z
Ended
2026-11-07T04:19:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/224/load_day/2026-09-04/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:17:15Z [load_day 2026-09-04] attempt 1 started
2026-11-07T04:17:25Z [load_day 2026-09-04] 2026-09-04 hour 0: 45663 events in 1 files, snapshot 4408699972403041896 (task 6977 ms: download 2506 ms overlapping gunzip 437 ms, parse 1437 ms, sort 158 ms, write 3630 ms, index 160 ms: 12 candidates, 22986 repo-hours, 1269 releases; waiting 808 ms; commit 840 ms)
2026-11-07T04:17:26Z [load_day 2026-09-04] 2026-09-04 hour 1: 49497 events in 1 files, snapshot 4269786192767842356 (task 7404 ms: download 2247 ms overlapping gunzip 468 ms, parse 1483 ms, sort 156 ms, write 3683 ms, index 161 ms: 2 candidates, 25190 repo-hours, 1334 releases; waiting 708 ms; commit 847 ms)
2026-11-07T04:17:33Z [load_day 2026-09-04] 2026-09-04 hour 2: 51343 events in 2 files, snapshot 6074645443513120297 (task 7238 ms: download 2121 ms overlapping gunzip 472 ms, parse 1509 ms, sort 172 ms, write 3794 ms, index 169 ms: 8 candidates, 25807 repo-hours, 1418 releases; waiting 632 ms; commit 873 ms)
2026-11-07T04:17:34Z [load_day 2026-09-04] 2026-09-04 hour 3: 55639 events in 2 files, snapshot 3372630952562896011 (task 7119 ms: download 2208 ms overlapping gunzip 479 ms, parse 1445 ms, sort 163 ms, write 3956 ms, index 207 ms: 6 candidates, 26753 repo-hours, 1545 releases; waiting 563 ms; commit 919 ms)
2026-11-07T04:17:42Z [load_day 2026-09-04] 2026-09-04 hour 4: 59972 events in 2 files, snapshot 5845596969660953751 (task 7609 ms: download 2464 ms overlapping gunzip 566 ms, parse 1722 ms, sort 197 ms, write 3874 ms, index 176 ms: 2 candidates, 27882 repo-hours, 1687 releases; waiting 742 ms; commit 924 ms)
2026-11-07T04:17:43Z [load_day 2026-09-04] 2026-09-04 hour 5: 59954 events in 2 files, snapshot 629985836679627136 (task 7663 ms: download 2307 ms overlapping gunzip 569 ms, parse 1879 ms, sort 184 ms, write 3706 ms, index 189 ms: 5 candidates, 28623 repo-hours, 1647 releases; waiting 874 ms; commit 923 ms)
2026-11-07T04:17:50Z [load_day 2026-09-04] 2026-09-04 hour 6: 61372 events in 2 files, snapshot 7361465230742772554 (task 7272 ms: download 2090 ms overlapping gunzip 525 ms, parse 1536 ms, sort 91 ms, write 4151 ms, index 208 ms: 5 candidates, 31033 repo-hours, 1566 releases; waiting 546 ms; commit 885 ms)
2026-11-07T04:17:50Z [load_day 2026-09-04] 2026-09-04 hour 7: 59820 events in 2 files, snapshot 556490186264775022 (task 7331 ms: download 2752 ms overlapping gunzip 619 ms, parse 1799 ms, sort 207 ms, write 3635 ms, index 204 ms: 3 candidates, 31750 repo-hours, 1641 releases; waiting 585 ms; commit 679 ms)
2026-11-07T04:17:58Z [load_day 2026-09-04] 2026-09-04 hour 8: 62963 events in 2 files, snapshot 5890667215026249135 (task 7813 ms: download 2469 ms overlapping gunzip 543 ms, parse 1564 ms, sort 95 ms, write 4359 ms, index 255 ms: 2 candidates, 33773 repo-hours, 1776 releases; waiting 705 ms; commit 785 ms)
2026-11-07T04:17:59Z [load_day 2026-09-04] 2026-09-04 hour 9: 62430 events in 2 files, snapshot 3811725053237396142 (task 8052 ms: download 2748 ms overlapping gunzip 637 ms, parse 1957 ms, sort 223 ms, write 3872 ms, index 218 ms: 3 candidates, 33571 repo-hours, 1798 releases; waiting 703 ms; commit 695 ms)
2026-11-07T04:18:06Z [load_day 2026-09-04] 2026-09-04 hour 10: 57794 events in 2 files, snapshot 8387256301172808475 (task 7295 ms: download 2290 ms overlapping gunzip 512 ms, parse 1453 ms, sort 170 ms, write 4037 ms, index 204 ms: 6 candidates, 31189 repo-hours, 1770 releases; waiting 638 ms; commit 717 ms)
2026-11-07T04:18:07Z [load_day 2026-09-04] 2026-09-04 hour 11: 48738 events in 1 files, snapshot 5611487581775882230 (task 6503 ms: download 2539 ms overlapping gunzip 545 ms, parse 1576 ms, sort 156 ms, write 2986 ms, index 187 ms: 7 candidates, 27759 repo-hours, 1551 releases; waiting 739 ms; commit 665 ms)
2026-11-07T04:18:12Z [load_day 2026-09-04] 2026-09-04 hour 12: 43759 events in 1 files, snapshot 7036444606002094535 (task 5810 ms: download 1487 ms overlapping gunzip 452 ms, parse 1268 ms, sort 152 ms, write 3244 ms, index 170 ms: 7 candidates, 25694 repo-hours, 1311 releases; waiting 267 ms; commit 780 ms)
2026-11-07T04:18:13Z [load_day 2026-09-04] 2026-09-04 hour 13: 45848 events in 1 files, snapshot 6118638608177186788 (task 5886 ms: download 1882 ms overlapping gunzip 431 ms, parse 1370 ms, sort 195 ms, write 2939 ms, index 171 ms: 7 candidates, 26918 repo-hours, 1371 releases; waiting 562 ms; commit 804 ms)
2026-11-07T04:18:20Z [load_day 2026-09-04] 2026-09-04 hour 14: 44593 events in 1 files, snapshot 4538030601591074911 (task 6652 ms: download 2168 ms overlapping gunzip 462 ms, parse 1348 ms, sort 162 ms, write 3441 ms, index 169 ms: 6 candidates, 26569 repo-hours, 1289 releases; waiting 760 ms; commit 797 ms)
2026-11-07T04:18:22Z [load_day 2026-09-04] 2026-09-04 hour 15: 59621 events in 2 files, snapshot 1684082288509115929 (task 7855 ms: download 2994 ms overlapping gunzip 621 ms, parse 1756 ms, sort 281 ms, write 3758 ms, index 212 ms: 3 candidates, 32241 repo-hours, 1648 releases; waiting 911 ms; commit 654 ms)
2026-11-07T04:18:30Z [load_day 2026-09-04] 2026-09-04 hour 16: 79245 events in 2 files, snapshot 2782752756577127134 (task 9996 ms: download 2868 ms overlapping gunzip 774 ms, parse 2266 ms, sort 228 ms, write 5449 ms, index 300 ms: 10 candidates, 38975 repo-hours, 2254 releases; waiting 660 ms; commit 934 ms)
2026-11-07T04:18:32Z [load_day 2026-09-04] 2026-09-04 hour 17: 80720 events in 2 files, snapshot 3923991138119198004 (task 9683 ms: download 3142 ms overlapping gunzip 809 ms, parse 2551 ms, sort 226 ms, write 4898 ms, index 239 ms: 12 candidates, 37869 repo-hours, 2302 releases; waiting 680 ms; commit 900 ms)
2026-11-07T04:18:42Z [load_day 2026-09-04] 2026-09-04 hour 18: 79884 events in 2 files, snapshot 8962905963634053849 (task 10979 ms: download 3796 ms overlapping gunzip 771 ms, parse 2247 ms, sort 253 ms, write 6221 ms, index 246 ms: 5 candidates, 37812 repo-hours, 2213 releases; waiting 865 ms; commit 817 ms)
2026-11-07T04:18:43Z [load_day 2026-09-04] 2026-09-04 hour 19: 79777 events in 2 files, snapshot 5658856051157626841 (task 9778 ms: download 3858 ms overlapping gunzip 732 ms, parse 2162 ms, sort 226 ms, write 5614 ms, index 250 ms: 4 candidates, 36040 repo-hours, 2215 releases; waiting 568 ms; commit 710 ms)
2026-11-07T04:18:53Z [load_day 2026-09-04] 2026-09-04 hour 20: 79471 events in 2 files, snapshot 702080085238694483 (task 10180 ms: download 3316 ms overlapping gunzip 732 ms, parse 2230 ms, sort 218 ms, write 5733 ms, index 262 ms: 5 candidates, 35853 repo-hours, 2240 releases; waiting 762 ms; commit 843 ms)
2026-11-07T04:18:54Z [load_day 2026-09-04] 2026-09-04 hour 21: 79198 events in 2 files, snapshot 2268429791168787724 (task 10264 ms: download 2920 ms overlapping gunzip 854 ms, parse 2717 ms, sort 305 ms, write 5173 ms, index 235 ms: 5 candidates, 33505 repo-hours, 2122 releases; waiting 644 ms; commit 753 ms)
2026-11-07T04:19:03Z [load_day 2026-09-04] 2026-09-04 hour 22: 74374 events in 2 files, snapshot 7303690023041294832 (task 9426 ms: download 2339 ms overlapping gunzip 683 ms, parse 2130 ms, sort 227 ms, write 5273 ms, index 432 ms: 5 candidates, 30964 repo-hours, 1907 releases; waiting 444 ms; commit 1004 ms)
2026-11-07T04:19:04Z [load_day 2026-09-04] 2026-09-04 hour 23: 77627 events in 2 files, snapshot 6459174555328481992 (task 10198 ms: download 3426 ms overlapping gunzip 914 ms, parse 2788 ms, sort 213 ms, write 4957 ms, index 247 ms: 8 candidates, 29879 repo-hours, 2190 releases; waiting 773 ms; commit 749 ms)
2026-11-07T04:19:08Z [load_day 2026-09-04] 2026-09-04: repo_hour merged from 24 files to 1 (738635 rows, 3492 ms)
2026-11-07T04:19:10Z [load_day 2026-09-04] 2026-09-04: index committed in 5151 ms (24 + 1 + 24 files)
2026-11-07T04:19:10Z [load_day 2026-09-04] 2026-09-04: 1499302 events in 24 hours
2026-11-07T04:19:10Z [load_day 2026-09-04] attempt 1 succeeded