orcaLog in

Runs · run 107

load_day 2026-10-13, attempt 1 succeeded

Host
4e84322b8c45:19925
Started
2026-11-07T03:35:26Z
Ended
2026-11-07T03:36:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/107/load_day/2026-10-13/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:35:26Z [load_day 2026-10-13] attempt 1 started
2026-11-07T03:35:32Z [load_day 2026-10-13] 2026-10-13 hour 0: 82370 events in 2 files, snapshot 7262127256656621047 (task 3189 ms: download 1141 ms overlapping gunzip 140 ms, parse 512 ms, sort 72 ms, write 1257 ms, index 327 ms: 13 candidates, 48069 repo-hours, 167 releases; waiting 522 ms; commit 615 ms)
2026-11-07T03:35:32Z [load_day 2026-10-13] 2026-10-13 hour 1: 83270 events in 2 files, snapshot 8238400841777656001 (task 3182 ms: download 1194 ms overlapping gunzip 147 ms, parse 524 ms, sort 72 ms, write 1301 ms, index 324 ms: 8 candidates, 48376 repo-hours, 255 releases; waiting 500 ms; commit 510 ms)
2026-11-07T03:35:36Z [load_day 2026-10-13] 2026-10-13 hour 2: 81307 events in 2 files, snapshot 7320922756929441616 (task 3260 ms: download 1291 ms overlapping gunzip 177 ms, parse 562 ms, sort 58 ms, write 1281 ms, index 350 ms: 6 candidates, 48808 repo-hours, 310 releases; waiting 562 ms; commit 769 ms)
2026-11-07T03:35:37Z [load_day 2026-10-13] 2026-10-13 hour 3: 80870 events in 2 files, snapshot 4424246953945476310 (task 3384 ms: download 1507 ms overlapping gunzip 189 ms, parse 606 ms, sort 71 ms, write 1238 ms, index 417 ms: 8 candidates, 47598 repo-hours, 359 releases; waiting 553 ms; commit 757 ms)
2026-11-07T03:35:40Z [load_day 2026-10-13] 2026-10-13 hour 4: 81515 events in 2 files, snapshot 4752851291637675209 (task 3280 ms: download 1258 ms overlapping gunzip 162 ms, parse 534 ms, sort 61 ms, write 1301 ms, index 396 ms: 1 candidates, 51408 repo-hours, 406 releases; waiting 538 ms; commit 628 ms)
2026-11-07T03:35:40Z [load_day 2026-10-13] 2026-10-13 hour 5: 83223 events in 2 files, snapshot 1736675305178027018 (task 3354 ms: download 1325 ms overlapping gunzip 166 ms, parse 536 ms, sort 72 ms, write 1330 ms, index 370 ms: 5 candidates, 52902 repo-hours, 278 releases; waiting 570 ms; commit 664 ms)
2026-11-07T03:35:43Z [load_day 2026-10-13] 2026-10-13 hour 6: 87821 events in 2 files, snapshot 4483989624431238156 (task 2378 ms: download 291 ms overlapping gunzip 151 ms, parse 478 ms, sort 61 ms, write 1125 ms, index 361 ms: 7 candidates, 56211 repo-hours, 165 releases; waiting 14 ms; commit 666 ms)
2026-11-07T03:35:43Z [load_day 2026-10-13] 2026-10-13 hour 7: 84474 events in 2 files, snapshot 7051131193487147042 (task 2315 ms: download 266 ms overlapping gunzip 139 ms, parse 445 ms, sort 64 ms, write 1094 ms, index 346 ms: 7 candidates, 53294 repo-hours, 139 releases; waiting 17 ms; commit 761 ms)
2026-11-07T03:35:45Z [load_day 2026-10-13] 2026-10-13 hour 8: 81567 events in 2 files, snapshot 5572698531484920931 (task 2154 ms: download 261 ms overlapping gunzip 125 ms, parse 403 ms, sort 61 ms, write 1026 ms, index 338 ms: 10 candidates, 51438 repo-hours, 74 releases; waiting 15 ms; commit 748 ms)
2026-11-07T03:35:46Z [load_day 2026-10-13] 2026-10-13 hour 9: 81388 events in 2 files, snapshot 6626381363888855222 (task 2057 ms: download 216 ms overlapping gunzip 119 ms, parse 392 ms, sort 51 ms, write 936 ms, index 344 ms: 9 candidates, 52052 repo-hours, 113 releases; waiting 18 ms; commit 793 ms)
2026-11-07T03:35:48Z [load_day 2026-10-13] 2026-10-13 hour 10: 83856 events in 2 files, snapshot 2272254777930004317 (task 2124 ms: download 216 ms overlapping gunzip 122 ms, parse 417 ms, sort 56 ms, write 938 ms, index 378 ms: 16 candidates, 53623 repo-hours, 57 releases; waiting 21 ms; commit 816 ms)
2026-11-07T03:35:49Z [load_day 2026-10-13] 2026-10-13 hour 11: 91127 events in 2 files, snapshot 7912915400120496034 (task 2299 ms: download 238 ms overlapping gunzip 134 ms, parse 451 ms, sort 60 ms, write 1045 ms, index 381 ms: 12 candidates, 56573 repo-hours, 72 releases; waiting 16 ms; commit 649 ms)
2026-11-07T03:35:51Z [load_day 2026-10-13] 2026-10-13 hour 12: 90725 events in 2 files, snapshot 8381209376135603664 (task 2248 ms: download 274 ms overlapping gunzip 136 ms, parse 440 ms, sort 59 ms, write 1006 ms, index 393 ms: 11 candidates, 58067 repo-hours, 99 releases; waiting 19 ms; commit 816 ms)
2026-11-07T03:35:52Z [load_day 2026-10-13] 2026-10-13 hour 13: 91031 events in 2 files, snapshot 790898773519508966 (task 2295 ms: download 243 ms overlapping gunzip 151 ms, parse 503 ms, sort 63 ms, write 954 ms, index 414 ms: 9 candidates, 59962 repo-hours, 88 releases; waiting 15 ms; commit 599 ms)
2026-11-07T03:35:54Z [load_day 2026-10-13] 2026-10-13 hour 14: 87410 events in 2 files, snapshot 3409160295245144270 (task 2199 ms: download 261 ms overlapping gunzip 145 ms, parse 467 ms, sort 65 ms, write 973 ms, index 350 ms: 14 candidates, 56966 repo-hours, 69 releases; waiting 16 ms; commit 570 ms)
2026-11-07T03:35:54Z [load_day 2026-10-13] 2026-10-13 hour 15: 80662 events in 2 files, snapshot 6175565570360198626 (task 2031 ms: download 233 ms overlapping gunzip 132 ms, parse 415 ms, sort 59 ms, write 881 ms, index 346 ms: 11 candidates, 52698 repo-hours, 82 releases; waiting 15 ms; commit 629 ms)
2026-11-07T03:35:57Z [load_day 2026-10-13] 2026-10-13 hour 16: 79515 events in 2 files, snapshot 4422205401989804251 (task 2119 ms: download 237 ms overlapping gunzip 122 ms, parse 398 ms, sort 61 ms, write 976 ms, index 347 ms: 6 candidates, 51941 repo-hours, 78 releases; waiting 15 ms; commit 788 ms)
2026-11-07T03:35:57Z [load_day 2026-10-13] 2026-10-13 hour 17: 78299 events in 2 files, snapshot 1701288058158737282 (task 2055 ms: download 227 ms overlapping gunzip 125 ms, parse 422 ms, sort 58 ms, write 914 ms, index 317 ms: 10 candidates, 50831 repo-hours, 104 releases; waiting 17 ms; commit 812 ms)
2026-11-07T03:35:59Z [load_day 2026-10-13] 2026-10-13 hour 18: 82797 events in 2 files, snapshot 4293429067342833717 (task 2254 ms: download 246 ms overlapping gunzip 132 ms, parse 438 ms, sort 56 ms, write 1063 ms, index 363 ms: 10 candidates, 54549 repo-hours, 98 releases; waiting 16 ms; commit 806 ms)
2026-11-07T03:36:00Z [load_day 2026-10-13] 2026-10-13 hour 19: 84003 events in 2 files, snapshot 5051656243254675408 (task 2237 ms: download 248 ms overlapping gunzip 142 ms, parse 461 ms, sort 59 ms, write 1029 ms, index 337 ms: 6 candidates, 52948 repo-hours, 99 releases; waiting 14 ms; commit 661 ms)
2026-11-07T03:36:02Z [load_day 2026-10-13] 2026-10-13 hour 20: 85686 events in 2 files, snapshot 5007424796761772506 (task 2208 ms: download 242 ms overlapping gunzip 128 ms, parse 415 ms, sort 65 ms, write 1062 ms, index 333 ms: 8 candidates, 52253 repo-hours, 83 releases; waiting 14 ms; commit 758 ms)
2026-11-07T03:36:03Z [load_day 2026-10-13] 2026-10-13 hour 21: 84890 events in 2 files, snapshot 3365871874022081694 (task 2228 ms: download 256 ms overlapping gunzip 139 ms, parse 472 ms, sort 62 ms, write 995 ms, index 353 ms: 6 candidates, 51013 repo-hours, 94 releases; waiting 17 ms; commit 653 ms)
2026-11-07T03:36:04Z [load_day 2026-10-13] 2026-10-13 hour 22: 92094 events in 2 files, snapshot 1834249569499175404 (task 2218 ms: download 271 ms overlapping gunzip 139 ms, parse 469 ms, sort 63 ms, write 991 ms, index 347 ms: 9 candidates, 53847 repo-hours, 101 releases; waiting 17 ms; commit 591 ms)
2026-11-07T03:36:06Z [load_day 2026-10-13] 2026-10-13 hour 23: 89914 events in 2 files, snapshot 2792396512538953809 (task 2177 ms: download 237 ms overlapping gunzip 149 ms, parse 492 ms, sort 69 ms, write 933 ms, index 328 ms: 8 candidates, 50354 repo-hours, 62 releases; waiting 16 ms; commit 977 ms)
2026-11-07T03:36:12Z [load_day 2026-10-13] 2026-10-13: repo_hour merged from 24 files to 1 (1265781 rows, 5823 ms)
2026-11-07T03:36:13Z [load_day 2026-10-13] 2026-10-13: index committed in 7426 ms (24 + 1 + 24 files)
2026-11-07T03:36:13Z [load_day 2026-10-13] 2026-10-13: 2029814 events in 24 hours
2026-11-07T03:36:13Z [load_day 2026-10-13] attempt 1 succeeded