orcaLog in

Runs · run 717

load_day 2026-03-24, attempt 1 succeeded

Host
4e84322b8c45:178086
Started
2026-11-07T13:29:22Z
Ended
2026-11-07T13:30:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/717/load_day/2026-03-24/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T13:29:22Z [load_day 2026-03-24] attempt 1 started
2026-11-07T13:29:32Z [load_day 2026-03-24] 2026-03-24 hour 0: 153418 events in 4 files, snapshot 4748520135565449043 (task 6261 ms: download 2350 ms overlapping gunzip 425 ms, parse 1460 ms, sort 178 ms, write 2850 ms, index 527 ms: 8 candidates, 75817 repo-hours, 711 releases; waiting 523 ms; commit 1269 ms)
2026-11-07T13:29:33Z [load_day 2026-03-24] 2026-03-24 hour 1: 168024 events in 4 files, snapshot 9169069316266851003 (task 5513 ms: download 2069 ms overlapping gunzip 344 ms, parse 1168 ms, sort 152 ms, write 2274 ms, index 710 ms: 12 candidates, 96772 repo-hours, 361 releases; waiting 524 ms; commit 1262 ms)
2026-11-07T13:29:38Z [load_day 2026-03-24] 2026-03-24 hour 2: 163016 events in 4 files, snapshot 8304782512162230569 (task 6152 ms: download 2288 ms overlapping gunzip 373 ms, parse 1201 ms, sort 144 ms, write 2813 ms, index 591 ms: 7 candidates, 92476 repo-hours, 473 releases; waiting 714 ms; commit 1415 ms)
2026-11-07T13:29:40Z [load_day 2026-03-24] 2026-03-24 hour 3: 152482 events in 4 files, snapshot 2378998124032205529 (task 6372 ms: download 1714 ms overlapping gunzip 441 ms, parse 1403 ms, sort 212 ms, write 3273 ms, index 506 ms: 7 candidates, 73170 repo-hours, 839 releases; waiting 194 ms; commit 1224 ms)
2026-11-07T13:29:49Z [load_day 2026-03-24] 2026-03-24 hour 4: 155158 events in 4 files, snapshot 2417149044750047873 (task 10069 ms: download 4054 ms overlapping gunzip 580 ms, parse 1776 ms, sort 299 ms, write 4519 ms, index 562 ms: 6 candidates, 75726 repo-hours, 682 releases; waiting 1984 ms; commit 1119 ms)
2026-11-07T13:29:50Z [load_day 2026-03-24] 2026-03-24 hour 5: 157287 events in 4 files, snapshot 7635528784210457854 (task 7147 ms: download 2645 ms overlapping gunzip 464 ms, parse 1472 ms, sort 149 ms, write 3381 ms, index 603 ms: 4 candidates, 79192 repo-hours, 606 releases; waiting 740 ms; commit 1278 ms)
2026-11-07T13:29:56Z [load_day 2026-03-24] 2026-03-24 hour 6: 158821 events in 4 files, snapshot 84929221754847874 (task 6458 ms: download 2750 ms overlapping gunzip 477 ms, parse 1437 ms, sort 191 ms, write 2624 ms, index 653 ms: 7 candidates, 83707 repo-hours, 601 releases; waiting 745 ms; commit 1134 ms)
2026-11-07T13:30:00Z [load_day 2026-03-24] 2026-03-24 hour 7: 154390 events in 4 files, snapshot 1963505033610101758 (task 6052 ms: download 1989 ms overlapping gunzip 370 ms, parse 1181 ms, sort 173 ms, write 2587 ms, index 575 ms: 10 candidates, 85885 repo-hours, 427 releases; waiting 557 ms; commit 3976 ms)
2026-11-07T13:30:03Z [load_day 2026-03-24] 2026-03-24 hour 8: 161811 events in 4 files, snapshot 8365631053370806656 (task 5486 ms: download 1341 ms overlapping gunzip 356 ms, parse 1135 ms, sort 149 ms, write 2671 ms, index 625 ms: 9 candidates, 86169 repo-hours, 373 releases; waiting 208 ms; commit 1304 ms)
2026-11-07T13:30:05Z [load_day 2026-03-24] 2026-03-24 hour 9: 161520 events in 4 files, snapshot 3924154610613604926 (task 6060 ms: download 2623 ms overlapping gunzip 466 ms, parse 1273 ms, sort 135 ms, write 2582 ms, index 588 ms: 8 candidates, 89031 repo-hours, 222 releases; waiting 649 ms; commit 1260 ms)
2026-11-07T13:30:09Z [load_day 2026-03-24] 2026-03-24 hour 10: 161560 events in 4 files, snapshot 8053439251546326345 (task 5252 ms: download 1760 ms overlapping gunzip 311 ms, parse 1032 ms, sort 161 ms, write 2096 ms, index 765 ms: 10 candidates, 91448 repo-hours, 230 releases; waiting 471 ms; commit 1444 ms)
2026-11-07T13:30:11Z [load_day 2026-03-24] 2026-03-24 hour 11: 159938 events in 4 files, snapshot 817920890095719835 (task 5637 ms: download 1970 ms overlapping gunzip 318 ms, parse 1027 ms, sort 133 ms, write 2306 ms, index 685 ms: 7 candidates, 88400 repo-hours, 292 releases; waiting 788 ms; commit 1391 ms)
2026-11-07T13:30:15Z [load_day 2026-03-24] 2026-03-24 hour 12: 159890 events in 4 files, snapshot 6008185681912720378 (task 5179 ms: download 1755 ms overlapping gunzip 286 ms, parse 926 ms, sort 135 ms, write 2243 ms, index 699 ms: 6 candidates, 95051 repo-hours, 114 releases; waiting 550 ms; commit 1284 ms)
2026-11-07T13:30:16Z [load_day 2026-03-24] 2026-03-24 hour 13: 163197 events in 4 files, snapshot 6995160137684590582 (task 4766 ms: download 1483 ms overlapping gunzip 262 ms, parse 906 ms, sort 142 ms, write 1923 ms, index 713 ms: 10 candidates, 100160 repo-hours, 93 releases; waiting 512 ms; commit 1343 ms)
2026-11-07T13:30:20Z [load_day 2026-03-24] 2026-03-24 hour 14: 155244 events in 4 files, snapshot 4117059313527675810 (task 4362 ms: download 1775 ms overlapping gunzip 250 ms, parse 875 ms, sort 108 ms, write 1753 ms, index 599 ms: 11 candidates, 91712 repo-hours, 149 releases; waiting 521 ms; commit 1334 ms)
2026-11-07T13:30:22Z [load_day 2026-03-24] 2026-03-24 hour 15: 154415 events in 4 files, snapshot 4534036523790711380 (task 4751 ms: download 1779 ms overlapping gunzip 278 ms, parse 913 ms, sort 114 ms, write 1870 ms, index 667 ms: 7 candidates, 90344 repo-hours, 141 releases; waiting 549 ms; commit 1195 ms)
2026-11-07T13:30:26Z [load_day 2026-03-24] 2026-03-24 hour 16: 164135 events in 4 files, snapshot 3893411955828108796 (task 4863 ms: download 1723 ms overlapping gunzip 272 ms, parse 909 ms, sort 118 ms, write 2002 ms, index 680 ms: 6 candidates, 93754 repo-hours, 128 releases; waiting 569 ms; commit 1458 ms)
2026-11-07T13:30:28Z [load_day 2026-03-24] 2026-03-24 hour 17: 156626 events in 4 files, snapshot 6084288648973108897 (task 4896 ms: download 1895 ms overlapping gunzip 289 ms, parse 969 ms, sort 141 ms, write 1900 ms, index 632 ms: 11 candidates, 89613 repo-hours, 147 releases; waiting 608 ms; commit 1284 ms)
2026-11-07T13:30:31Z [load_day 2026-03-24] 2026-03-24 hour 18: 161220 events in 4 files, snapshot 5617350045032659436 (task 4602 ms: download 1281 ms overlapping gunzip 284 ms, parse 917 ms, sort 130 ms, write 2048 ms, index 622 ms: 13 candidates, 88525 repo-hours, 144 releases; waiting 335 ms; commit 1166 ms)
2026-11-07T13:30:33Z [load_day 2026-03-24] 2026-03-24 hour 19: 162427 events in 4 files, snapshot 2096123310739178197 (task 4919 ms: download 1351 ms overlapping gunzip 302 ms, parse 1040 ms, sort 206 ms, write 2142 ms, index 643 ms: 15 candidates, 89745 repo-hours, 248 releases; waiting 272 ms; commit 1256 ms)
2026-11-07T13:30:37Z [load_day 2026-03-24] 2026-03-24 hour 20: 156945 events in 4 files, snapshot 7618506311612907770 (task 5084 ms: download 1916 ms overlapping gunzip 319 ms, parse 1056 ms, sort 147 ms, write 2028 ms, index 575 ms: 11 candidates, 82043 repo-hours, 331 releases; waiting 628 ms; commit 1451 ms)
2026-11-07T13:30:41Z [load_day 2026-03-24] 2026-03-24 hour 21: 161343 events in 4 files, snapshot 7675490069445507487 (task 6650 ms: download 2451 ms overlapping gunzip 366 ms, parse 1159 ms, sort 181 ms, write 2547 ms, index 609 ms: 17 candidates, 82554 repo-hours, 466 releases; waiting 1476 ms; commit 1544 ms)
2026-11-07T13:30:44Z [load_day 2026-03-24] 2026-03-24 hour 22: 159428 events in 4 files, snapshot 6267168196126776122 (task 6036 ms: download 1923 ms overlapping gunzip 413 ms, parse 1265 ms, sort 152 ms, write 2710 ms, index 666 ms: 13 candidates, 80646 repo-hours, 578 releases; waiting 545 ms; commit 1315 ms)
2026-11-07T13:30:48Z [load_day 2026-03-24] 2026-03-24 hour 23: 149900 events in 3 files, snapshot 4607700390417123965 (task 6046 ms: download 2275 ms overlapping gunzip 437 ms, parse 1472 ms, sort 184 ms, write 2604 ms, index 524 ms: 3 candidates, 75036 repo-hours, 875 releases; waiting 558 ms; commit 1283 ms)
2026-11-07T13:30:56Z [load_day 2026-03-24] 2026-03-24: repo_hour merged from 24 files to 1 (2076976 rows, 8491 ms)
2026-11-07T13:30:58Z [load_day 2026-03-24] 2026-03-24: index committed in 10673 ms (24 + 1 + 24 files)
2026-11-07T13:30:58Z [load_day 2026-03-24] 2026-03-24: 3812195 events in 24 hours
2026-11-07T13:30:58Z [load_day 2026-03-24] attempt 1 succeeded