orcaLog in

Runs · run 560

load_day 2026-05-15, attempt 1 succeeded

Host
4e84322b8c45:124653
Started
2026-11-07T06:28:24Z
Ended
2026-11-07T06:29:36Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/560/load_day/2026-05-15/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:28:24Z [load_day 2026-05-15] attempt 1 started
2026-11-07T06:28:33Z [load_day 2026-05-15] 2026-05-15 hour 0: 147873 events in 3 files, snapshot 3489438268758007191 (task 5928 ms: download 1911 ms overlapping gunzip 350 ms, parse 1197 ms, sort 152 ms, write 2930 ms, index 450 ms: 8 candidates, 70083 repo-hours, 626 releases; waiting 518 ms; commit 1072 ms)
2026-11-07T06:28:34Z [load_day 2026-05-15] 2026-05-15 hour 1: 149354 events in 3 files, snapshot 5283710251913821667 (task 5867 ms: download 1508 ms overlapping gunzip 367 ms, parse 1300 ms, sort 167 ms, write 2763 ms, index 535 ms: 10 candidates, 74682 repo-hours, 548 releases; waiting 499 ms; commit 1129 ms)
2026-11-07T06:28:38Z [load_day 2026-05-15] 2026-05-15 hour 2: 155409 events in 4 files, snapshot 5442775999955642578 (task 4487 ms: download 1286 ms overlapping gunzip 275 ms, parse 977 ms, sort 103 ms, write 1769 ms, index 610 ms: 9 candidates, 83677 repo-hours, 203 releases; waiting 525 ms; commit 1279 ms)
2026-11-07T06:28:40Z [load_day 2026-05-15] 2026-05-15 hour 3: 153618 events in 4 files, snapshot 7780610891911175661 (task 4826 ms: download 2734 ms overlapping gunzip 294 ms, parse 1031 ms, sort 112 ms, write 1902 ms, index 537 ms: 5 candidates, 82675 repo-hours, 336 releases; waiting 660 ms; commit 1128 ms)
2026-11-07T06:28:44Z [load_day 2026-05-15] 2026-05-15 hour 4: 154821 events in 4 files, snapshot 5540034476921190237 (task 4949 ms: download 1737 ms overlapping gunzip 317 ms, parse 1069 ms, sort 122 ms, write 2107 ms, index 486 ms: 8 candidates, 74924 repo-hours, 578 releases; waiting 528 ms; commit 1290 ms)
2026-11-07T06:28:45Z [load_day 2026-05-15] 2026-05-15 hour 5: 149828 events in 3 files, snapshot 6266738477332869379 (task 4831 ms: download 1734 ms overlapping gunzip 330 ms, parse 1080 ms, sort 121 ms, write 1999 ms, index 474 ms: 6 candidates, 72788 repo-hours, 426 releases; waiting 527 ms; commit 1283 ms)
2026-11-07T06:28:49Z [load_day 2026-05-15] 2026-05-15 hour 6: 154598 events in 4 files, snapshot 8810877954051125544 (task 4308 ms: download 1375 ms overlapping gunzip 280 ms, parse 931 ms, sort 117 ms, write 1709 ms, index 517 ms: 7 candidates, 80362 repo-hours, 310 releases; waiting 512 ms; commit 986 ms)
2026-11-07T06:28:50Z [load_day 2026-05-15] 2026-05-15 hour 7: 146437 events in 3 files, snapshot 2206608756116411683 (task 4286 ms: download 1326 ms overlapping gunzip 255 ms, parse 860 ms, sort 106 ms, write 1684 ms, index 505 ms: 7 candidates, 76676 repo-hours, 240 releases; waiting 538 ms; commit 1112 ms)
2026-11-07T06:28:54Z [load_day 2026-05-15] 2026-05-15 hour 8: 153835 events in 4 files, snapshot 6559539610506474558 (task 4154 ms: download 1538 ms overlapping gunzip 237 ms, parse 815 ms, sort 113 ms, write 1622 ms, index 546 ms: 9 candidates, 83605 repo-hours, 147 releases; waiting 533 ms; commit 1077 ms)
2026-11-07T06:28:54Z [load_day 2026-05-15] 2026-05-15 hour 9: 103849 events in 3 files, snapshot 6736600570296229649 (task 3045 ms: download 1044 ms overlapping gunzip 157 ms, parse 550 ms, sort 69 ms, write 1044 ms, index 386 ms: 5 candidates, 60649 repo-hours, 81 releases; waiting 548 ms; commit 908 ms)
2026-11-07T06:28:57Z [load_day 2026-05-15] 2026-05-15 hour 10: 85555 events in 2 files, snapshot 652180404351996404 (task 2798 ms: download 1078 ms overlapping gunzip 133 ms, parse 469 ms, sort 57 ms, write 937 ms, index 334 ms: 5 candidates, 51744 repo-hours, 78 releases; waiting 527 ms; commit 1190 ms)
2026-11-07T06:28:58Z [load_day 2026-05-15] 2026-05-15 hour 11: 88689 events in 2 files, snapshot 3449501201238329207 (task 2726 ms: download 931 ms overlapping gunzip 142 ms, parse 483 ms, sort 69 ms, write 997 ms, index 338 ms: 3 candidates, 53468 repo-hours, 110 releases; waiting 406 ms; commit 1110 ms)
2026-11-07T06:29:00Z [load_day 2026-05-15] 2026-05-15 hour 12: 87307 events in 2 files, snapshot 4671908470381031210 (task 2728 ms: download 1134 ms overlapping gunzip 125 ms, parse 455 ms, sort 50 ms, write 831 ms, index 375 ms: 6 candidates, 53603 repo-hours, 59 releases; waiting 536 ms; commit 1067 ms)
2026-11-07T06:29:01Z [load_day 2026-05-15] 2026-05-15 hour 13: 89513 events in 2 files, snapshot 4387707836047211987 (task 2497 ms: download 706 ms overlapping gunzip 136 ms, parse 459 ms, sort 53 ms, write 883 ms, index 392 ms: 5 candidates, 58773 repo-hours, 43 releases; waiting 273 ms; commit 1206 ms)
2026-11-07T06:29:03Z [load_day 2026-05-15] 2026-05-15 hour 14: 85121 events in 2 files, snapshot 2068102285561910356 (task 2641 ms: download 913 ms overlapping gunzip 118 ms, parse 419 ms, sort 54 ms, write 886 ms, index 396 ms: 2 candidates, 56056 repo-hours, 47 releases; waiting 520 ms; commit 1209 ms)
2026-11-07T06:29:06Z [load_day 2026-05-15] 2026-05-15 hour 15: 121756 events in 3 files, snapshot 2931846193294689440 (task 3406 ms: download 1027 ms overlapping gunzip 171 ms, parse 610 ms, sort 76 ms, write 1249 ms, index 521 ms: 7 candidates, 67939 repo-hours, 75 releases; waiting 489 ms; commit 1317 ms)
2026-11-07T06:29:08Z [load_day 2026-05-15] 2026-05-15 hour 16: 150242 events in 4 files, snapshot 5339876094428504766 (task 3913 ms: download 1301 ms overlapping gunzip 218 ms, parse 762 ms, sort 101 ms, write 1443 ms, index 582 ms: 10 candidates, 82044 repo-hours, 92 releases; waiting 543 ms; commit 1424 ms)
2026-11-07T06:29:10Z [load_day 2026-05-15] 2026-05-15 hour 17: 153379 events in 4 files, snapshot 8557642632525841181 (task 3844 ms: download 1135 ms overlapping gunzip 226 ms, parse 808 ms, sort 116 ms, write 1521 ms, index 563 ms: 5 candidates, 83122 repo-hours, 95 releases; waiting 392 ms; commit 1200 ms)
2026-11-07T06:29:13Z [load_day 2026-05-15] 2026-05-15 hour 18: 149798 events in 3 files, snapshot 7089472412130120421 (task 4364 ms: download 1650 ms overlapping gunzip 232 ms, parse 838 ms, sort 110 ms, write 1573 ms, index 538 ms: 11 candidates, 77955 repo-hours, 159 releases; waiting 528 ms; commit 1165 ms)
2026-11-07T06:29:15Z [load_day 2026-05-15] 2026-05-15 hour 19: 155470 events in 4 files, snapshot 8192770115851306055 (task 3980 ms: download 1289 ms overlapping gunzip 224 ms, parse 791 ms, sort 103 ms, write 1663 ms, index 598 ms: 28 candidates, 81491 repo-hours, 118 releases; waiting 391 ms; commit 1138 ms)
2026-11-07T06:29:18Z [load_day 2026-05-15] 2026-05-15 hour 20: 154484 events in 4 files, snapshot 7447726415107720939 (task 4400 ms: download 1442 ms overlapping gunzip 265 ms, parse 953 ms, sort 119 ms, write 1655 ms, index 538 ms: 7 candidates, 76810 repo-hours, 182 releases; waiting 545 ms; commit 1069 ms)
2026-11-07T06:29:20Z [load_day 2026-05-15] 2026-05-15 hour 21: 151388 events in 4 files, snapshot 8228365722852702924 (task 4519 ms: download 1218 ms overlapping gunzip 294 ms, parse 1009 ms, sort 116 ms, write 2037 ms, index 570 ms: 6 candidates, 75579 repo-hours, 429 releases; waiting 202 ms; commit 1481 ms)
2026-11-07T06:29:24Z [load_day 2026-05-15] 2026-05-15 hour 22: 146795 events in 3 files, snapshot 9108138689216484061 (task 5220 ms: download 1922 ms overlapping gunzip 343 ms, parse 1159 ms, sort 172 ms, write 2406 ms, index 447 ms: 4 candidates, 67120 repo-hours, 621 releases; waiting 385 ms; commit 1143 ms)
2026-11-07T06:29:27Z [load_day 2026-05-15] 2026-05-15 hour 23: 145313 events in 3 files, snapshot 3365828342651646262 (task 5857 ms: download 1954 ms overlapping gunzip 359 ms, parse 1236 ms, sort 121 ms, write 2736 ms, index 450 ms: 3 candidates, 68271 repo-hours, 909 releases; waiting 655 ms; commit 1522 ms)
2026-11-07T06:29:34Z [load_day 2026-05-15] 2026-05-15: repo_hour merged from 24 files to 1 (1714096 rows, 7090 ms)
2026-11-07T06:29:36Z [load_day 2026-05-15] 2026-05-15: index committed in 8795 ms (24 + 1 + 24 files)
2026-11-07T06:29:36Z [load_day 2026-05-15] 2026-05-15: 3234432 events in 24 hours
2026-11-07T06:29:36Z [load_day 2026-05-15] attempt 1 succeeded