orcaLog in

Runs · run 681

load_day 2026-04-05, attempt 1 succeeded

Host
4e84322b8c45:167634
Started
2026-11-07T13:08:22Z
Ended
2026-11-07T13:10:11Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/681/load_day/2026-04-05/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T13:08:22Z [load_day 2026-04-05] attempt 1 started
2026-11-07T13:08:32Z [load_day 2026-04-05] 2026-04-05 hour 0: 145672 events in 3 files, snapshot 4648154278782626004 (task 5902 ms: download 1968 ms overlapping gunzip 380 ms, parse 1304 ms, sort 275 ms, write 2617 ms, index 452 ms: 11 candidates, 66068 repo-hours, 976 releases; waiting 521 ms; commit 1113 ms)
2026-11-07T13:08:33Z [load_day 2026-04-05] 2026-04-05 hour 1: 152804 events in 4 files, snapshot 3427203186904408427 (task 6628 ms: download 1772 ms overlapping gunzip 412 ms, parse 1498 ms, sort 185 ms, write 3466 ms, index 507 ms: 4 candidates, 79717 repo-hours, 764 releases; waiting 197 ms; commit 1321 ms)
2026-11-07T13:08:38Z [load_day 2026-04-05] 2026-04-05 hour 2: 150315 events in 4 files, snapshot 7306041157800356884 (task 5595 ms: download 1833 ms overlapping gunzip 361 ms, parse 1223 ms, sort 127 ms, write 2515 ms, index 524 ms: 5 candidates, 83148 repo-hours, 695 releases; waiting 535 ms; commit 1240 ms)
2026-11-07T13:08:42Z [load_day 2026-04-05] 2026-04-05 hour 3: 155444 events in 4 files, snapshot 5476405555207633323 (task 7913 ms: download 2422 ms overlapping gunzip 529 ms, parse 1751 ms, sort 258 ms, write 3859 ms, index 754 ms: 5 candidates, 72556 repo-hours, 805 releases; waiting 446 ms; commit 1172 ms)
2026-11-07T13:08:48Z [load_day 2026-04-05] 2026-04-05 hour 4: 149845 events in 3 files, snapshot 7637916123994187766 (task 9583 ms: download 2781 ms overlapping gunzip 686 ms, parse 2358 ms, sort 303 ms, write 4909 ms, index 424 ms: 8 candidates, 60576 repo-hours, 896 releases; waiting 523 ms; commit 1164 ms)
2026-11-07T13:08:52Z [load_day 2026-04-05] 2026-04-05 hour 5: 152889 events in 4 files, snapshot 3695621074064961663 (task 9331 ms: download 3030 ms overlapping gunzip 690 ms, parse 2484 ms, sort 225 ms, write 4540 ms, index 459 ms: 10 candidates, 68705 repo-hours, 755 releases; waiting 574 ms; commit 1263 ms)
2026-11-07T13:08:57Z [load_day 2026-04-05] 2026-04-05 hour 6: 154391 events in 4 files, snapshot 581739402021098807 (task 7891 ms: download 2592 ms overlapping gunzip 564 ms, parse 1910 ms, sort 156 ms, write 4069 ms, index 514 ms: 8 candidates, 72537 repo-hours, 722 releases; waiting 347 ms; commit 1245 ms)
2026-11-07T13:09:02Z [load_day 2026-04-05] 2026-04-05 hour 7: 155216 events in 4 files, snapshot 3628970789629509772 (task 9374 ms: download 3265 ms overlapping gunzip 569 ms, parse 1941 ms, sort 156 ms, write 4970 ms, index 529 ms: 5 candidates, 73915 repo-hours, 630 releases; waiting 843 ms; commit 1437 ms)
2026-11-07T13:09:04Z [load_day 2026-04-05] 2026-04-05 hour 8: 156260 events in 4 files, snapshot 1232387625037617780 (task 6798 ms: download 2332 ms overlapping gunzip 420 ms, parse 1332 ms, sort 216 ms, write 3212 ms, index 618 ms: 5 candidates, 78600 repo-hours, 783 releases; waiting 667 ms; commit 1202 ms)
2026-11-07T13:09:11Z [load_day 2026-04-05] 2026-04-05 hour 9: 154357 events in 4 files, snapshot 3700630698970642729 (task 8500 ms: download 2324 ms overlapping gunzip 547 ms, parse 1837 ms, sort 204 ms, write 4499 ms, index 505 ms: 5 candidates, 75492 repo-hours, 732 releases; waiting 587 ms; commit 1230 ms)
2026-11-07T13:09:12Z [load_day 2026-04-05] 2026-04-05 hour 10: 155661 events in 4 files, snapshot 4452653852600723923 (task 6064 ms: download 1880 ms overlapping gunzip 428 ms, parse 1368 ms, sort 151 ms, write 3020 ms, index 535 ms: 6 candidates, 79120 repo-hours, 859 releases; waiting 265 ms; commit 1378 ms)
2026-11-07T13:09:18Z [load_day 2026-04-05] 2026-04-05 hour 11: 158263 events in 4 files, snapshot 2605665312553632104 (task 6762 ms: download 2237 ms overlapping gunzip 440 ms, parse 1383 ms, sort 158 ms, write 3146 ms, index 565 ms: 8 candidates, 77863 repo-hours, 793 releases; waiting 640 ms; commit 1272 ms)
2026-11-07T13:09:20Z [load_day 2026-04-05] 2026-04-05 hour 12: 159094 events in 4 files, snapshot 4477317410265149329 (task 6930 ms: download 2197 ms overlapping gunzip 471 ms, parse 1591 ms, sort 185 ms, write 3238 ms, index 555 ms: 10 candidates, 86621 repo-hours, 629 releases; waiting 536 ms; commit 1350 ms)
2026-11-07T13:09:26Z [load_day 2026-04-05] 2026-04-05 hour 13: 158576 events in 4 files, snapshot 5057218045944736773 (task 6581 ms: download 2450 ms overlapping gunzip 437 ms, parse 1434 ms, sort 167 ms, write 2995 ms, index 589 ms: 13 candidates, 88928 repo-hours, 679 releases; waiting 604 ms; commit 1494 ms)
2026-11-07T13:09:27Z [load_day 2026-04-05] 2026-04-05 hour 14: 155997 events in 4 files, snapshot 6635542439993709527 (task 6341 ms: download 2217 ms overlapping gunzip 457 ms, parse 1505 ms, sort 163 ms, write 2823 ms, index 600 ms: 9 candidates, 78952 repo-hours, 736 releases; waiting 498 ms; commit 1341 ms)
2026-11-07T13:09:34Z [load_day 2026-04-05] 2026-04-05 hour 15: 158060 events in 4 files, snapshot 2102785130032013905 (task 7666 ms: download 1090 ms overlapping gunzip 545 ms, parse 1721 ms, sort 207 ms, write 4295 ms, index 644 ms: 5 candidates, 78259 repo-hours, 840 releases; waiting 15 ms; commit 1840 ms)
2026-11-07T13:09:36Z [load_day 2026-04-05] 2026-04-05 hour 16: 158510 events in 4 files, snapshot 1690880389144971480 (task 7425 ms: download 2230 ms overlapping gunzip 479 ms, parse 1564 ms, sort 147 ms, write 3491 ms, index 911 ms: 12 candidates, 79407 repo-hours, 812 releases; waiting 534 ms; commit 1469 ms)
2026-11-07T13:09:42Z [load_day 2026-04-05] 2026-04-05 hour 17: 157271 events in 4 files, snapshot 2844664433469242014 (task 7390 ms: download 1566 ms overlapping gunzip 473 ms, parse 1495 ms, sort 216 ms, write 4131 ms, index 564 ms: 12 candidates, 77904 repo-hours, 803 releases; waiting 187 ms; commit 1414 ms)
2026-11-07T13:09:44Z [load_day 2026-04-05] 2026-04-05 hour 18: 150917 events in 4 files, snapshot 4523723456987118863 (task 6557 ms: download 2497 ms overlapping gunzip 466 ms, parse 1491 ms, sort 165 ms, write 2996 ms, index 542 ms: 12 candidates, 79519 repo-hours, 918 releases; waiting 599 ms; commit 1492 ms)
2026-11-07T13:09:49Z [load_day 2026-04-05] 2026-04-05 hour 19: 151937 events in 4 files, snapshot 5648891458103360327 (task 6730 ms: download 2250 ms overlapping gunzip 467 ms, parse 1479 ms, sort 135 ms, write 3019 ms, index 533 ms: 10 candidates, 73016 repo-hours, 921 releases; waiting 781 ms; commit 1267 ms)
2026-11-07T13:09:50Z [load_day 2026-04-05] 2026-04-05 hour 20: 150268 events in 4 files, snapshot 6013293043622050516 (task 5443 ms: download 1590 ms overlapping gunzip 437 ms, parse 1324 ms, sort 203 ms, write 2490 ms, index 520 ms: 10 candidates, 73672 repo-hours, 890 releases; waiting 186 ms; commit 1133 ms)
2026-11-07T13:09:56Z [load_day 2026-04-05] 2026-04-05 hour 21: 148938 events in 3 files, snapshot 5972725091555016020 (task 6058 ms: download 1982 ms overlapping gunzip 376 ms, parse 1257 ms, sort 153 ms, write 2628 ms, index 498 ms: 9 candidates, 71028 repo-hours, 770 releases; waiting 591 ms; commit 1176 ms)
2026-11-07T13:09:57Z [load_day 2026-04-05] 2026-04-05 hour 22: 149734 events in 3 files, snapshot 4186341197695365461 (task 5729 ms: download 2482 ms overlapping gunzip 371 ms, parse 1186 ms, sort 156 ms, write 2603 ms, index 485 ms: 8 candidates, 69305 repo-hours, 783 releases; waiting 651 ms; commit 1092 ms)
2026-11-07T13:10:02Z [load_day 2026-04-05] 2026-04-05 hour 23: 150467 events in 4 files, snapshot 3141552644040249541 (task 5218 ms: download 2020 ms overlapping gunzip 357 ms, parse 1181 ms, sort 159 ms, write 2089 ms, index 508 ms: 9 candidates, 69548 repo-hours, 798 releases; waiting 587 ms; commit 1431 ms)
2026-11-07T13:10:09Z [load_day 2026-04-05] 2026-04-05: repo_hour merged from 24 files to 1 (1814456 rows, 7447 ms)
2026-11-07T13:10:11Z [load_day 2026-04-05] 2026-04-05: index committed in 9337 ms (24 + 1 + 24 files)
2026-11-07T13:10:11Z [load_day 2026-04-05] 2026-04-05: 3690886 events in 24 hours
2026-11-07T13:10:11Z [load_day 2026-04-05] attempt 1 succeeded