orcaLog in

Runs · run 257

load_day 2026-08-24, attempt 1 succeeded

Host
4e84322b8c45:42487
Started
2026-11-07T04:25:46Z
Ended
2026-11-07T04:26:37Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/257/load_day/2026-08-24/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:25:46Z [load_day 2026-08-24] attempt 1 started
2026-11-07T04:25:52Z [load_day 2026-08-24] 2026-08-24 hour 0: 168982 events in 4 files, snapshot 7645131956294785343 (task 3714 ms: download 1349 ms overlapping gunzip 207 ms, parse 794 ms, sort 107 ms, write 1462 ms, index 265 ms: 5 candidates, 41361 repo-hours, 8 releases; waiting 535 ms; commit 628 ms)
2026-11-07T04:25:53Z [load_day 2026-08-24] 2026-08-24 hour 1: 172674 events in 4 files, snapshot 3478478575721329125 (task 3557 ms: download 921 ms overlapping gunzip 204 ms, parse 790 ms, sort 116 ms, write 1627 ms, index 297 ms: 3 candidates, 46701 repo-hours, 11 releases; waiting 248 ms; commit 838 ms)
2026-11-07T04:25:57Z [load_day 2026-08-24] 2026-08-24 hour 2: 169379 events in 4 files, snapshot 3390635746350150964 (task 3887 ms: download 1559 ms overlapping gunzip 228 ms, parse 865 ms, sort 141 ms, write 1539 ms, index 240 ms: 6 candidates, 37413 repo-hours, 13 releases; waiting 509 ms; commit 788 ms)
2026-11-07T04:25:58Z [load_day 2026-08-24] 2026-08-24 hour 3: 166182 events in 4 files, snapshot 9067186749627824443 (task 3504 ms: download 1187 ms overlapping gunzip 186 ms, parse 734 ms, sort 96 ms, write 1483 ms, index 195 ms: 3 candidates, 27247 repo-hours, 8 releases; waiting 523 ms; commit 780 ms)
2026-11-07T04:26:01Z [load_day 2026-08-24] 2026-08-24 hour 4: 170087 events in 4 files, snapshot 5388994747729171212 (task 3308 ms: download 1050 ms overlapping gunzip 189 ms, parse 743 ms, sort 101 ms, write 1519 ms, index 175 ms: 2 candidates, 25749 repo-hours, 8 releases; waiting 373 ms; commit 855 ms)
2026-11-07T04:26:02Z [load_day 2026-08-24] 2026-08-24 hour 5: 170286 events in 4 files, snapshot 9060848689573319648 (task 3818 ms: download 1450 ms overlapping gunzip 198 ms, parse 779 ms, sort 105 ms, write 1617 ms, index 188 ms: 1 candidates, 25602 repo-hours, 9 releases; waiting 512 ms; commit 846 ms)
2026-11-07T04:26:05Z [load_day 2026-08-24] 2026-08-24 hour 6: 166328 events in 4 files, snapshot 6192104906968086628 (task 3662 ms: download 1353 ms overlapping gunzip 197 ms, parse 756 ms, sort 105 ms, write 1525 ms, index 190 ms: 5 candidates, 29395 repo-hours, 8 releases; waiting 595 ms; commit 752 ms)
2026-11-07T04:26:06Z [load_day 2026-08-24] 2026-08-24 hour 7: 164679 events in 4 files, snapshot 5905570030540449706 (task 3626 ms: download 1292 ms overlapping gunzip 199 ms, parse 761 ms, sort 95 ms, write 1451 ms, index 217 ms: 3 candidates, 29483 repo-hours, 15 releases; waiting 531 ms; commit 711 ms)
2026-11-07T04:26:09Z [load_day 2026-08-24] 2026-08-24 hour 8: 155470 events in 4 files, snapshot 1179266463543576996 (task 3368 ms: download 1138 ms overlapping gunzip 188 ms, parse 722 ms, sort 92 ms, write 1353 ms, index 204 ms: 1 candidates, 25901 repo-hours, 10 releases; waiting 512 ms; commit 694 ms)
2026-11-07T04:26:10Z [load_day 2026-08-24] 2026-08-24 hour 9: 131736 events in 3 files, snapshot 9022479778710628453 (task 3273 ms: download 1130 ms overlapping gunzip 162 ms, parse 608 ms, sort 80 ms, write 1246 ms, index 179 ms: 5 candidates, 24576 repo-hours, 20 releases; waiting 533 ms; commit 789 ms)
2026-11-07T04:26:12Z [load_day 2026-08-24] 2026-08-24 hour 10: 106268 events in 3 files, snapshot 6320957317874768009 (task 2671 ms: download 990 ms overlapping gunzip 132 ms, parse 526 ms, sort 85 ms, write 992 ms, index 171 ms: 4 candidates, 23956 repo-hours, 16 releases; waiting 537 ms; commit 713 ms)
2026-11-07T04:26:13Z [load_day 2026-08-24] 2026-08-24 hour 11: 104148 events in 3 files, snapshot 8945111018194558473 (task 2437 ms: download 1008 ms overlapping gunzip 126 ms, parse 497 ms, sort 64 ms, write 961 ms, index 169 ms: 4 candidates, 24562 repo-hours, 13 releases; waiting 408 ms; commit 877 ms)
2026-11-07T04:26:15Z [load_day 2026-08-24] 2026-08-24 hour 12: 99152 events in 2 files, snapshot 6441876972155778138 (task 2722 ms: download 1256 ms overlapping gunzip 128 ms, parse 495 ms, sort 61 ms, write 972 ms, index 168 ms: 3 candidates, 22502 repo-hours, 25 releases; waiting 516 ms; commit 752 ms)
2026-11-07T04:26:16Z [load_day 2026-08-24] 2026-08-24 hour 13: 88244 events in 2 files, snapshot 6595031993885750764 (task 2344 ms: download 960 ms overlapping gunzip 110 ms, parse 426 ms, sort 52 ms, write 798 ms, index 142 ms: 2 candidates, 21218 repo-hours, 20 releases; waiting 544 ms; commit 843 ms)
2026-11-07T04:26:18Z [load_day 2026-08-24] 2026-08-24 hour 14: 81636 events in 2 files, snapshot 2179908766496004755 (task 2346 ms: download 918 ms overlapping gunzip 108 ms, parse 416 ms, sort 56 ms, write 813 ms, index 139 ms: 2 candidates, 20161 repo-hours, 16 releases; waiting 531 ms; commit 790 ms)
2026-11-07T04:26:19Z [load_day 2026-08-24] 2026-08-24 hour 15: 82549 events in 2 files, snapshot 8954284959924192302 (task 2222 ms: download 920 ms overlapping gunzip 103 ms, parse 403 ms, sort 52 ms, write 773 ms, index 132 ms: 3 candidates, 18591 repo-hours, 22 releases; waiting 535 ms; commit 859 ms)
2026-11-07T04:26:23Z [load_day 2026-08-24] 2026-08-24 hour 16: 74577 events in 2 files, snapshot 7223860051277526977 (task 2340 ms: download 873 ms overlapping gunzip 100 ms, parse 382 ms, sort 46 ms, write 756 ms, index 133 ms: 2 candidates, 18856 repo-hours, 28 releases; waiting 529 ms; commit 2006 ms)
2026-11-07T04:26:24Z [load_day 2026-08-24] 2026-08-24 hour 17: 76386 events in 2 files, snapshot 3638227410397079425 (task 2190 ms: download 885 ms overlapping gunzip 101 ms, parse 382 ms, sort 45 ms, write 790 ms, index 151 ms: 5 candidates, 19617 repo-hours, 21 releases; waiting 520 ms; commit 981 ms)
2026-11-07T04:26:25Z [load_day 2026-08-24] 2026-08-24 hour 18: 78392 events in 2 files, snapshot 8666347377011696667 (task 2247 ms: download 925 ms overlapping gunzip 102 ms, parse 393 ms, sort 52 ms, write 734 ms, index 146 ms: 4 candidates, 19885 repo-hours, 20 releases; waiting 539 ms; commit 850 ms)
2026-11-07T04:26:26Z [load_day 2026-08-24] 2026-08-24 hour 19: 79742 events in 2 files, snapshot 2912933408676910920 (task 2246 ms: download 897 ms overlapping gunzip 107 ms, parse 422 ms, sort 49 ms, write 751 ms, index 140 ms: 4 candidates, 19561 repo-hours, 24 releases; waiting 514 ms; commit 903 ms)
2026-11-07T04:26:28Z [load_day 2026-08-24] 2026-08-24 hour 20: 81118 events in 2 files, snapshot 1618379423971243130 (task 2385 ms: download 952 ms overlapping gunzip 104 ms, parse 401 ms, sort 49 ms, write 816 ms, index 137 ms: 3 candidates, 19863 repo-hours, 17 releases; waiting 554 ms; commit 948 ms)
2026-11-07T04:26:29Z [load_day 2026-08-24] 2026-08-24 hour 21: 79599 events in 2 files, snapshot 3138186102702862979 (task 2344 ms: download 912 ms overlapping gunzip 112 ms, parse 408 ms, sort 50 ms, write 732 ms, index 160 ms: 2 candidates, 19978 repo-hours, 17 releases; waiting 543 ms; commit 750 ms)
2026-11-07T04:26:30Z [load_day 2026-08-24] 2026-08-24 hour 22: 75846 events in 2 files, snapshot 92589448809369087 (task 2221 ms: download 923 ms overlapping gunzip 98 ms, parse 378 ms, sort 44 ms, write 711 ms, index 123 ms: 0 candidates, 19143 repo-hours, 22 releases; waiting 557 ms; commit 697 ms)
2026-11-07T04:26:32Z [load_day 2026-08-24] 2026-08-24 hour 23: 73452 events in 2 files, snapshot 8841834611923393369 (task 2257 ms: download 890 ms overlapping gunzip 106 ms, parse 397 ms, sort 42 ms, write 734 ms, index 153 ms: 2 candidates, 18822 repo-hours, 15 releases; waiting 539 ms; commit 860 ms)
2026-11-07T04:26:35Z [load_day 2026-08-24] 2026-08-24: repo_hour merged from 24 files to 1 (600143 rows, 3101 ms)
2026-11-07T04:26:37Z [load_day 2026-08-24] 2026-08-24: index committed in 4657 ms (23 + 1 + 24 files)
2026-11-07T04:26:37Z [load_day 2026-08-24] 2026-08-24: 2816912 events in 24 hours
2026-11-07T04:26:37Z [load_day 2026-08-24] attempt 1 succeeded