orcaLog in

Runs · run 263

load_day 2026-08-22, attempt 1 succeeded

Host
4e84322b8c45:43979
Started
2026-11-07T04:27:39Z
Ended
2026-11-07T04:28:34Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/263/load_day/2026-08-22/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:27:39Z [load_day 2026-08-22] attempt 1 started
2026-11-07T04:27:44Z [load_day 2026-08-22] 2026-08-22 hour 0: 37605 events in 1 files, snapshot 8390604844234892925 (task 1330 ms: download 486 ms overlapping gunzip 54 ms, parse 213 ms, sort 22 ms, write 415 ms, index 105 ms: 1 candidates, 11710 repo-hours, 19 releases; waiting 253 ms; commit 695 ms)
2026-11-07T04:27:44Z [load_day 2026-08-22] 2026-08-22 hour 1: 49720 events in 1 files, snapshot 6783682975883051414 (task 1750 ms: download 806 ms overlapping gunzip 80 ms, parse 290 ms, sort 32 ms, write 473 ms, index 114 ms: 1 candidates, 15094 repo-hours, 29 releases; waiting 538 ms; commit 749 ms)
2026-11-07T04:27:47Z [load_day 2026-08-22] 2026-08-22 hour 2: 86776 events in 2 files, snapshot 7630036039399482754 (task 2352 ms: download 923 ms overlapping gunzip 111 ms, parse 436 ms, sort 57 ms, write 792 ms, index 142 ms: 1 candidates, 19324 repo-hours, 17 releases; waiting 529 ms; commit 912 ms)
2026-11-07T04:27:48Z [load_day 2026-08-22] 2026-08-22 hour 3: 128621 events in 3 files, snapshot 5922101379816475203 (task 3023 ms: download 1176 ms overlapping gunzip 160 ms, parse 630 ms, sort 82 ms, write 1231 ms, index 176 ms: 5 candidates, 22639 repo-hours, 14 releases; waiting 524 ms; commit 811 ms)
2026-11-07T04:27:50Z [load_day 2026-08-22] 2026-08-22 hour 4: 131916 events in 3 files, snapshot 1888529212751512570 (task 2761 ms: download 939 ms overlapping gunzip 151 ms, parse 602 ms, sort 77 ms, write 1150 ms, index 177 ms: 0 candidates, 22913 repo-hours, 10 releases; waiting 402 ms; commit 776 ms)
2026-11-07T04:27:52Z [load_day 2026-08-22] 2026-08-22 hour 5: 142430 events in 3 files, snapshot 3131144573703869015 (task 3160 ms: download 1127 ms overlapping gunzip 164 ms, parse 652 ms, sort 92 ms, write 1266 ms, index 172 ms: 1 candidates, 24231 repo-hours, 14 releases; waiting 522 ms; commit 737 ms)
2026-11-07T04:27:54Z [load_day 2026-08-22] 2026-08-22 hour 6: 152311 events in 4 files, snapshot 956684496608979145 (task 3171 ms: download 1170 ms overlapping gunzip 171 ms, parse 679 ms, sort 94 ms, write 1247 ms, index 174 ms: 2 candidates, 24276 repo-hours, 14 releases; waiting 523 ms; commit 842 ms)
2026-11-07T04:27:56Z [load_day 2026-08-22] 2026-08-22 hour 7: 155829 events in 4 files, snapshot 5660210808598587291 (task 3320 ms: download 1223 ms overlapping gunzip 179 ms, parse 721 ms, sort 110 ms, write 1359 ms, index 153 ms: 0 candidates, 22792 repo-hours, 8 releases; waiting 512 ms; commit 920 ms)
2026-11-07T04:27:58Z [load_day 2026-08-22] 2026-08-22 hour 8: 157590 events in 4 files, snapshot 7671517249985169966 (task 3303 ms: download 1084 ms overlapping gunzip 183 ms, parse 718 ms, sort 96 ms, write 1333 ms, index 151 ms: 0 candidates, 22559 repo-hours, 13 releases; waiting 526 ms; commit 826 ms)
2026-11-07T04:28:00Z [load_day 2026-08-22] 2026-08-22 hour 9: 152563 events in 4 files, snapshot 3993264778519223165 (task 3427 ms: download 1731 ms overlapping gunzip 173 ms, parse 697 ms, sort 98 ms, write 1402 ms, index 149 ms: 1 candidates, 21920 repo-hours, 6 releases; waiting 529 ms; commit 757 ms)
2026-11-07T04:28:02Z [load_day 2026-08-22] 2026-08-22 hour 10: 152764 events in 4 files, snapshot 3839054316372429564 (task 3313 ms: download 1162 ms overlapping gunzip 173 ms, parse 686 ms, sort 104 ms, write 1433 ms, index 163 ms: 3 candidates, 23051 repo-hours, 5 releases; waiting 531 ms; commit 744 ms)
2026-11-07T04:28:04Z [load_day 2026-08-22] 2026-08-22 hour 11: 156846 events in 4 files, snapshot 5553487081591272613 (task 3364 ms: download 1069 ms overlapping gunzip 174 ms, parse 712 ms, sort 100 ms, write 1472 ms, index 179 ms: 4 candidates, 22750 repo-hours, 8 releases; waiting 512 ms; commit 808 ms)
2026-11-07T04:28:06Z [load_day 2026-08-22] 2026-08-22 hour 12: 155458 events in 4 files, snapshot 8351703165580307633 (task 3533 ms: download 1165 ms overlapping gunzip 173 ms, parse 696 ms, sort 96 ms, write 1483 ms, index 194 ms: 1 candidates, 26876 repo-hours, 9 releases; waiting 532 ms; commit 805 ms)
2026-11-07T04:28:09Z [load_day 2026-08-22] 2026-08-22 hour 13: 157835 events in 4 files, snapshot 6528360346468895551 (task 3501 ms: download 1217 ms overlapping gunzip 177 ms, parse 720 ms, sort 105 ms, write 1474 ms, index 174 ms: 3 candidates, 26289 repo-hours, 8 releases; waiting 533 ms; commit 932 ms)
2026-11-07T04:28:10Z [load_day 2026-08-22] 2026-08-22 hour 14: 149803 events in 3 files, snapshot 4879726325951805698 (task 3247 ms: download 1283 ms overlapping gunzip 174 ms, parse 670 ms, sort 96 ms, write 1314 ms, index 158 ms: 0 candidates, 25260 repo-hours, 10 releases; waiting 526 ms; commit 754 ms)
2026-11-07T04:28:12Z [load_day 2026-08-22] 2026-08-22 hour 15: 151928 events in 4 files, snapshot 8166281682181698994 (task 3440 ms: download 1375 ms overlapping gunzip 184 ms, parse 734 ms, sort 107 ms, write 1370 ms, index 188 ms: 0 candidates, 27625 repo-hours, 12 releases; waiting 519 ms; commit 810 ms)
2026-11-07T04:28:13Z [load_day 2026-08-22] 2026-08-22 hour 16: 155468 events in 4 files, snapshot 5072849191235632782 (task 3322 ms: download 1273 ms overlapping gunzip 180 ms, parse 723 ms, sort 96 ms, write 1325 ms, index 186 ms: 2 candidates, 27742 repo-hours, 16 releases; waiting 512 ms; commit 816 ms)
2026-11-07T04:28:17Z [load_day 2026-08-22] 2026-08-22 hour 17: 147285 events in 3 files, snapshot 6828467203495995985 (task 3273 ms: download 1095 ms overlapping gunzip 168 ms, parse 667 ms, sort 95 ms, write 1375 ms, index 212 ms: 3 candidates, 28691 repo-hours, 21 releases; waiting 516 ms; commit 975 ms)
2026-11-07T04:28:18Z [load_day 2026-08-22] 2026-08-22 hour 18: 154554 events in 4 files, snapshot 7155731109541348614 (task 3359 ms: download 1383 ms overlapping gunzip 173 ms, parse 697 ms, sort 105 ms, write 1361 ms, index 200 ms: 4 candidates, 30230 repo-hours, 20 releases; waiting 537 ms; commit 891 ms)
2026-11-07T04:28:21Z [load_day 2026-08-22] 2026-08-22 hour 19: 157489 events in 4 files, snapshot 7635943196363372640 (task 3581 ms: download 1459 ms overlapping gunzip 192 ms, parse 760 ms, sort 107 ms, write 1504 ms, index 184 ms: 1 candidates, 27754 repo-hours, 11 releases; waiting 521 ms; commit 873 ms)
2026-11-07T04:28:22Z [load_day 2026-08-22] 2026-08-22 hour 20: 160832 events in 4 files, snapshot 9212358802870570826 (task 3536 ms: download 1291 ms overlapping gunzip 184 ms, parse 710 ms, sort 106 ms, write 1442 ms, index 205 ms: 2 candidates, 27612 repo-hours, 8 releases; waiting 554 ms; commit 1178 ms)
2026-11-07T04:28:25Z [load_day 2026-08-22] 2026-08-22 hour 21: 164828 events in 4 files, snapshot 6966455583855968934 (task 3635 ms: download 1156 ms overlapping gunzip 191 ms, parse 768 ms, sort 110 ms, write 1559 ms, index 189 ms: 6 candidates, 28350 repo-hours, 4 releases; waiting 525 ms; commit 664 ms)
2026-11-07T04:28:26Z [load_day 2026-08-22] 2026-08-22 hour 22: 172889 events in 4 files, snapshot 680888590833907771 (task 3611 ms: download 1262 ms overlapping gunzip 205 ms, parse 793 ms, sort 116 ms, write 1507 ms, index 251 ms: 5 candidates, 26045 repo-hours, 6 releases; waiting 517 ms; commit 719 ms)
2026-11-07T04:28:29Z [load_day 2026-08-22] 2026-08-22 hour 23: 172790 events in 4 files, snapshot 3758101744663625707 (task 3636 ms: download 1575 ms overlapping gunzip 210 ms, parse 793 ms, sort 109 ms, write 1563 ms, index 160 ms: 1 candidates, 24270 repo-hours, 5 releases; waiting 520 ms; commit 993 ms)
2026-11-07T04:28:33Z [load_day 2026-08-22] 2026-08-22: repo_hour merged from 24 files to 1 (580003 rows, 3316 ms)
2026-11-07T04:28:34Z [load_day 2026-08-22] 2026-08-22: index committed in 5086 ms (19 + 1 + 24 files)
2026-11-07T04:28:34Z [load_day 2026-08-22] 2026-08-22: 3406130 events in 24 hours
2026-11-07T04:28:34Z [load_day 2026-08-22] attempt 1 succeeded