orcaLog in

Runs · run 596

load_day 2026-05-03, attempt 1 succeeded

Host
4e84322b8c45:133965
Started
2026-11-07T06:44:11Z
Ended
2026-11-07T06:49:51Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/596/load_day/2026-05-03/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:44:11Z [load_day 2026-05-03] attempt 1 started
2026-11-07T06:44:20Z [load_day 2026-05-03] 2026-05-03 hour 0: 147895 events in 3 files, snapshot 5094285827173620990 (task 5247 ms: download 1762 ms overlapping gunzip 361 ms, parse 1220 ms, sort 150 ms, write 2235 ms, index 377 ms: 7 candidates, 59484 repo-hours, 858 releases; waiting 517 ms; commit 1149 ms)
2026-11-07T06:46:42Z [load_day 2026-05-03] 2026-05-03 hour 1: 150181 events in 4 files, snapshot 2269862058354086902 (task 147208 ms: download 144641 ms overlapping gunzip 656 ms, parse 2175 ms, sort 179 ms, write 2284 ms, index 463 ms: 8 candidates, 71923 repo-hours, 751 releases; waiting 140171 ms; commit 1292 ms)
2026-11-07T06:46:43Z [load_day 2026-05-03] 2026-05-03 hour 2: 154610 events in 4 files, snapshot 2466812627448615435 (task 4863 ms: download 1397 ms overlapping gunzip 321 ms, parse 1063 ms, sort 125 ms, write 2151 ms, index 566 ms: 3 candidates, 79267 repo-hours, 579 releases; waiting 327 ms; commit 1104 ms)
2026-11-07T06:48:43Z [load_day 2026-05-03] 2026-05-03 hour 3: 153706 events in 4 files, snapshot 7406922485311491063 (task 120707 ms: download 118603 ms overlapping gunzip 652 ms, parse 2121 ms, sort 183 ms, write 2362 ms, index 492 ms: 9 candidates, 76783 repo-hours, 741 releases; waiting 113407 ms; commit 1010 ms)
2026-11-07T06:48:44Z [load_day 2026-05-03] 2026-05-03 hour 4: 147958 events in 3 files, snapshot 1553274796198318938 (task 5422 ms: download 1889 ms overlapping gunzip 379 ms, parse 1242 ms, sort 173 ms, write 2356 ms, index 441 ms: 11 candidates, 65873 repo-hours, 914 releases; waiting 527 ms; commit 1051 ms)
2026-11-07T06:48:49Z [load_day 2026-05-03] 2026-05-03 hour 5: 145777 events in 3 files, snapshot 1573003447825660954 (task 5786 ms: download 1714 ms overlapping gunzip 366 ms, parse 1244 ms, sort 138 ms, write 2777 ms, index 438 ms: 7 candidates, 64658 repo-hours, 859 releases; waiting 544 ms; commit 1044 ms)
2026-11-07T06:48:50Z [load_day 2026-05-03] 2026-05-03 hour 6: 155809 events in 4 files, snapshot 7915289966655710113 (task 5683 ms: download 1921 ms overlapping gunzip 343 ms, parse 1159 ms, sort 151 ms, write 2668 ms, index 463 ms: 6 candidates, 67252 repo-hours, 812 releases; waiting 562 ms; commit 1120 ms)
2026-11-07T06:48:55Z [load_day 2026-05-03] 2026-05-03 hour 7: 157146 events in 4 files, snapshot 3003484898861443435 (task 4910 ms: download 1326 ms overlapping gunzip 306 ms, parse 1086 ms, sort 127 ms, write 2264 ms, index 444 ms: 9 candidates, 69534 repo-hours, 522 releases; waiting 366 ms; commit 1329 ms)
2026-11-07T06:48:56Z [load_day 2026-05-03] 2026-05-03 hour 8: 157032 events in 4 files, snapshot 8514118233621714350 (task 5331 ms: download 1964 ms overlapping gunzip 320 ms, parse 1081 ms, sort 202 ms, write 2446 ms, index 459 ms: 9 candidates, 71817 repo-hours, 641 releases; waiting 529 ms; commit 1179 ms)
2026-11-07T06:49:00Z [load_day 2026-05-03] 2026-05-03 hour 9: 149805 events in 3 files, snapshot 6496367409290615730 (task 4738 ms: download 1394 ms overlapping gunzip 310 ms, parse 1021 ms, sort 116 ms, write 2188 ms, index 506 ms: 5 candidates, 75136 repo-hours, 704 releases; waiting 256 ms; commit 1225 ms)
2026-11-07T06:49:03Z [load_day 2026-05-03] 2026-05-03 hour 10: 155327 events in 4 files, snapshot 5101864866156143166 (task 5809 ms: download 2521 ms overlapping gunzip 318 ms, parse 1037 ms, sort 122 ms, write 2368 ms, index 650 ms: 7 candidates, 76188 repo-hours, 541 releases; waiting 779 ms; commit 1154 ms)
2026-11-07T06:49:06Z [load_day 2026-05-03] 2026-05-03 hour 11: 156477 events in 4 files, snapshot 7453925162329891697 (task 5349 ms: download 1896 ms overlapping gunzip 314 ms, parse 1071 ms, sort 120 ms, write 2386 ms, index 515 ms: 4 candidates, 76099 repo-hours, 616 releases; waiting 570 ms; commit 1322 ms)
2026-11-07T06:49:08Z [load_day 2026-05-03] 2026-05-03 hour 12: 163933 events in 4 files, snapshot 2239604327770746944 (task 4608 ms: download 1824 ms overlapping gunzip 250 ms, parse 902 ms, sort 110 ms, write 1956 ms, index 528 ms: 6 candidates, 81504 repo-hours, 303 releases; waiting 526 ms; commit 1193 ms)
2026-11-07T06:49:11Z [load_day 2026-05-03] 2026-05-03 hour 13: 158631 events in 4 files, snapshot 5926103964443249176 (task 4307 ms: download 1512 ms overlapping gunzip 258 ms, parse 889 ms, sort 105 ms, write 1699 ms, index 524 ms: 7 candidates, 83835 repo-hours, 228 releases; waiting 534 ms; commit 1168 ms)
2026-11-07T06:49:14Z [load_day 2026-05-03] 2026-05-03 hour 14: 156855 events in 4 files, snapshot 6351056173281682215 (task 5141 ms: download 2363 ms overlapping gunzip 318 ms, parse 1080 ms, sort 128 ms, write 2171 ms, index 528 ms: 9 candidates, 81844 repo-hours, 440 releases; waiting 504 ms; commit 1274 ms)
2026-11-07T06:49:17Z [load_day 2026-05-03] 2026-05-03 hour 15: 160838 events in 4 files, snapshot 5968556165992190865 (task 5057 ms: download 1668 ms overlapping gunzip 325 ms, parse 1058 ms, sort 115 ms, write 2310 ms, index 617 ms: 6 candidates, 82150 repo-hours, 528 releases; waiting 370 ms; commit 1261 ms)
2026-11-07T06:49:20Z [load_day 2026-05-03] 2026-05-03 hour 16: 158415 events in 4 files, snapshot 703623342107358462 (task 5262 ms: download 1838 ms overlapping gunzip 317 ms, parse 1047 ms, sort 124 ms, write 2316 ms, index 520 ms: 3 candidates, 81233 repo-hours, 547 releases; waiting 556 ms; commit 1144 ms)
2026-11-07T06:49:23Z [load_day 2026-05-03] 2026-05-03 hour 17: 155537 events in 4 files, snapshot 8034986449825815166 (task 5299 ms: download 1920 ms overlapping gunzip 345 ms, parse 1156 ms, sort 139 ms, write 2212 ms, index 569 ms: 7 candidates, 80275 repo-hours, 587 releases; waiting 557 ms; commit 1318 ms)
2026-11-07T06:49:27Z [load_day 2026-05-03] 2026-05-03 hour 18: 157684 events in 4 files, snapshot 4536237465768328334 (task 5564 ms: download 1920 ms overlapping gunzip 338 ms, parse 1107 ms, sort 128 ms, write 2589 ms, index 565 ms: 8 candidates, 80607 repo-hours, 571 releases; waiting 537 ms; commit 1389 ms)
2026-11-07T06:49:28Z [load_day 2026-05-03] 2026-05-03 hour 19: 159423 events in 4 files, snapshot 2244280566839854060 (task 4687 ms: download 1744 ms overlapping gunzip 278 ms, parse 989 ms, sort 115 ms, write 1996 ms, index 446 ms: 2 candidates, 67784 repo-hours, 408 releases; waiting 554 ms; commit 1096 ms)
2026-11-07T06:49:33Z [load_day 2026-05-03] 2026-05-03 hour 20: 156771 events in 4 files, snapshot 7163402644698411996 (task 5400 ms: download 1867 ms overlapping gunzip 349 ms, parse 1157 ms, sort 146 ms, write 2419 ms, index 488 ms: 3 candidates, 75081 repo-hours, 701 releases; waiting 535 ms; commit 1307 ms)
2026-11-07T06:49:34Z [load_day 2026-05-03] 2026-05-03 hour 21: 155999 events in 4 files, snapshot 8085959486609775159 (task 5742 ms: download 2453 ms overlapping gunzip 404 ms, parse 1358 ms, sort 147 ms, write 2374 ms, index 477 ms: 4 candidates, 72825 repo-hours, 716 releases; waiting 656 ms; commit 1238 ms)
2026-11-07T06:49:39Z [load_day 2026-05-03] 2026-05-03 hour 22: 149157 events in 3 files, snapshot 8534453575818089667 (task 5428 ms: download 2122 ms overlapping gunzip 347 ms, parse 1132 ms, sort 117 ms, write 2386 ms, index 479 ms: 4 candidates, 69863 repo-hours, 618 releases; waiting 599 ms; commit 1252 ms)
2026-11-07T06:49:40Z [load_day 2026-05-03] 2026-05-03 hour 23: 145843 events in 3 files, snapshot 4694842199588191256 (task 5241 ms: download 2109 ms overlapping gunzip 348 ms, parse 1162 ms, sort 172 ms, write 2232 ms, index 441 ms: 9 candidates, 66972 repo-hours, 675 releases; waiting 543 ms; commit 1250 ms)
2026-11-07T06:49:47Z [load_day 2026-05-03] 2026-05-03: repo_hour merged from 24 files to 1 (1777987 rows, 7189 ms)
2026-11-07T06:49:51Z [load_day 2026-05-03] 2026-05-03: index committed in 10988 ms (24 + 1 + 24 files)
2026-11-07T06:49:51Z [load_day 2026-05-03] 2026-05-03: 3710809 events in 24 hours
2026-11-07T06:49:51Z [load_day 2026-05-03] attempt 1 succeeded