orcaLog in

Runs · run 699

load_day 2026-03-30, attempt 1 succeeded

Host
4e84322b8c45:172831
Started
2026-11-07T13:19:01Z
Ended
2026-11-07T13:20:41Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/699/load_day/2026-03-30/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T13:19:01Z [load_day 2026-03-30] attempt 1 started
2026-11-07T13:19:12Z [load_day 2026-03-30] 2026-03-30 hour 0: 153472 events in 4 files, snapshot 7630654769806451668 (task 7250 ms: download 2319 ms overlapping gunzip 495 ms, parse 1646 ms, sort 220 ms, write 3458 ms, index 494 ms: 9 candidates, 69914 repo-hours, 1061 releases; waiting 541 ms; commit 1075 ms)
2026-11-07T13:19:14Z [load_day 2026-03-30] 2026-03-30 hour 1: 156814 events in 4 files, snapshot 1512062814904336726 (task 6546 ms: download 2407 ms overlapping gunzip 376 ms, parse 1307 ms, sort 190 ms, write 2880 ms, index 617 ms: 9 candidates, 87713 repo-hours, 585 releases; waiting 749 ms; commit 1199 ms)
2026-11-07T13:19:20Z [load_day 2026-03-30] 2026-03-30 hour 2: 164400 events in 4 files, snapshot 7195883787254237539 (task 7015 ms: download 2200 ms overlapping gunzip 465 ms, parse 1413 ms, sort 167 ms, write 3399 ms, index 564 ms: 9 candidates, 91423 repo-hours, 364 releases; waiting 682 ms; commit 1441 ms)
2026-11-07T13:19:24Z [load_day 2026-03-30] 2026-03-30 hour 3: 162899 events in 4 files, snapshot 6651502880682688706 (task 9333 ms: download 2939 ms overlapping gunzip 657 ms, parse 2081 ms, sort 257 ms, write 4886 ms, index 511 ms: 9 candidates, 77222 repo-hours, 356 releases; waiting 616 ms; commit 1488 ms)
2026-11-07T13:19:32Z [load_day 2026-03-30] 2026-03-30 hour 4: 161298 events in 4 files, snapshot 5770341497025167024 (task 11433 ms: download 4229 ms overlapping gunzip 826 ms, parse 2378 ms, sort 254 ms, write 5466 ms, index 494 ms: 5 candidates, 71515 repo-hours, 490 releases; waiting 1661 ms; commit 1237 ms)
2026-11-07T13:19:34Z [load_day 2026-03-30] 2026-03-30 hour 5: 158463 events in 4 files, snapshot 708929277282087917 (task 7985 ms: download 3054 ms overlapping gunzip 608 ms, parse 1811 ms, sort 241 ms, write 3631 ms, index 485 ms: 11 candidates, 73694 repo-hours, 509 releases; waiting 837 ms; commit 1270 ms)
2026-11-07T13:19:40Z [load_day 2026-03-30] 2026-03-30 hour 6: 156130 events in 4 files, snapshot 4658723987676153302 (task 6689 ms: download 2454 ms overlapping gunzip 518 ms, parse 1555 ms, sort 192 ms, write 2514 ms, index 530 ms: 7 candidates, 78599 repo-hours, 344 releases; waiting 746 ms; commit 1181 ms)
2026-11-07T13:19:41Z [load_day 2026-03-30] 2026-03-30 hour 7: 160291 events in 4 files, snapshot 1266616424421015012 (task 5821 ms: download 2326 ms overlapping gunzip 442 ms, parse 1320 ms, sort 156 ms, write 2487 ms, index 530 ms: 13 candidates, 84115 repo-hours, 253 releases; waiting 537 ms; commit 1045 ms)
2026-11-07T13:19:46Z [load_day 2026-03-30] 2026-03-30 hour 8: 157709 events in 4 files, snapshot 8159914027321354573 (task 5259 ms: download 1909 ms overlapping gunzip 358 ms, parse 1152 ms, sort 158 ms, write 2180 ms, index 561 ms: 11 candidates, 81126 repo-hours, 192 releases; waiting 537 ms; commit 1260 ms)
2026-11-07T13:19:47Z [load_day 2026-03-30] 2026-03-30 hour 9: 160125 events in 4 files, snapshot 3042274912849616393 (task 5203 ms: download 1840 ms overlapping gunzip 351 ms, parse 1070 ms, sort 137 ms, write 2317 ms, index 557 ms: 16 candidates, 85229 repo-hours, 185 releases; waiting 546 ms; commit 1323 ms)
2026-11-07T13:19:51Z [load_day 2026-03-30] 2026-03-30 hour 10: 160433 events in 4 files, snapshot 3513661886405879020 (task 4500 ms: download 1189 ms overlapping gunzip 313 ms, parse 1009 ms, sort 120 ms, write 1984 ms, index 610 ms: 8 candidates, 85058 repo-hours, 228 releases; waiting 242 ms; commit 1436 ms)
2026-11-07T13:19:52Z [load_day 2026-03-30] 2026-03-30 hour 11: 156500 events in 4 files, snapshot 2922209698412080874 (task 4819 ms: download 1776 ms overlapping gunzip 296 ms, parse 954 ms, sort 122 ms, write 2041 ms, index 577 ms: 7 candidates, 85901 repo-hours, 188 releases; waiting 562 ms; commit 1102 ms)
2026-11-07T13:19:56Z [load_day 2026-03-30] 2026-03-30 hour 12: 162007 events in 4 files, snapshot 8498650135019441406 (task 4717 ms: download 1963 ms overlapping gunzip 274 ms, parse 922 ms, sort 113 ms, write 1897 ms, index 617 ms: 12 candidates, 90373 repo-hours, 120 releases; waiting 551 ms; commit 1130 ms)
2026-11-07T13:19:58Z [load_day 2026-03-30] 2026-03-30 hour 13: 160313 events in 4 files, snapshot 226111572709825029 (task 4902 ms: download 1392 ms overlapping gunzip 243 ms, parse 862 ms, sort 128 ms, write 1936 ms, index 730 ms: 11 candidates, 98083 repo-hours, 86 releases; waiting 691 ms; commit 1206 ms)
2026-11-07T13:20:02Z [load_day 2026-03-30] 2026-03-30 hour 14: 157550 events in 4 files, snapshot 1492607809156491825 (task 4798 ms: download 1928 ms overlapping gunzip 272 ms, parse 901 ms, sort 143 ms, write 1832 ms, index 765 ms: 15 candidates, 90521 repo-hours, 86 releases; waiting 548 ms; commit 1455 ms)
2026-11-07T13:20:04Z [load_day 2026-03-30] 2026-03-30 hour 15: 158399 events in 4 files, snapshot 8232977869544319098 (task 4716 ms: download 1665 ms overlapping gunzip 263 ms, parse 867 ms, sort 130 ms, write 1904 ms, index 723 ms: 16 candidates, 88817 repo-hours, 77 releases; waiting 449 ms; commit 1370 ms)
2026-11-07T13:20:07Z [load_day 2026-03-30] 2026-03-30 hour 16: 163482 events in 4 files, snapshot 5174961268856044620 (task 4728 ms: download 1584 ms overlapping gunzip 281 ms, parse 954 ms, sort 139 ms, write 1903 ms, index 612 ms: 10 candidates, 90618 repo-hours, 58 releases; waiting 516 ms; commit 1297 ms)
2026-11-07T13:20:09Z [load_day 2026-03-30] 2026-03-30 hour 17: 159477 events in 4 files, snapshot 5203238156494879099 (task 4450 ms: download 1560 ms overlapping gunzip 235 ms, parse 807 ms, sort 113 ms, write 1825 ms, index 603 ms: 8 candidates, 88702 repo-hours, 54 releases; waiting 547 ms; commit 1156 ms)
2026-11-07T13:20:13Z [load_day 2026-03-30] 2026-03-30 hour 18: 162056 events in 4 files, snapshot 6750253986532452284 (task 4629 ms: download 1845 ms overlapping gunzip 261 ms, parse 916 ms, sort 118 ms, write 1839 ms, index 620 ms: 11 candidates, 90824 repo-hours, 80 releases; waiting 590 ms; commit 1588 ms)
2026-11-07T13:20:15Z [load_day 2026-03-30] 2026-03-30 hour 19: 165706 events in 4 files, snapshot 8357712468959489562 (task 4922 ms: download 1828 ms overlapping gunzip 280 ms, parse 935 ms, sort 128 ms, write 2055 ms, index 617 ms: 7 candidates, 91556 repo-hours, 127 releases; waiting 553 ms; commit 1328 ms)
2026-11-07T13:20:19Z [load_day 2026-03-30] 2026-03-30 hour 20: 159559 events in 4 files, snapshot 2384672241631932350 (task 4739 ms: download 1403 ms overlapping gunzip 292 ms, parse 985 ms, sort 128 ms, write 2154 ms, index 630 ms: 7 candidates, 87060 repo-hours, 180 releases; waiting 257 ms; commit 1357 ms)
2026-11-07T13:20:21Z [load_day 2026-03-30] 2026-03-30 hour 21: 160934 events in 4 files, snapshot 1563977883083258552 (task 5631 ms: download 1894 ms overlapping gunzip 345 ms, parse 1132 ms, sort 155 ms, write 2508 ms, index 605 ms: 12 candidates, 84656 repo-hours, 336 releases; waiting 623 ms; commit 1409 ms)
2026-11-07T13:20:26Z [load_day 2026-03-30] 2026-03-30 hour 22: 156637 events in 4 files, snapshot 9211410322997603491 (task 6970 ms: download 2341 ms overlapping gunzip 420 ms, parse 1371 ms, sort 214 ms, write 3439 ms, index 579 ms: 7 candidates, 77093 repo-hours, 558 releases; waiting 597 ms; commit 1306 ms)
2026-11-07T13:20:29Z [load_day 2026-03-30] 2026-03-30 hour 23: 153040 events in 4 files, snapshot 4161863997381557821 (task 7259 ms: download 2399 ms overlapping gunzip 476 ms, parse 1601 ms, sort 159 ms, write 3632 ms, index 496 ms: 9 candidates, 73984 repo-hours, 879 releases; waiting 589 ms; commit 1319 ms)
2026-11-07T13:20:37Z [load_day 2026-03-30] 2026-03-30: repo_hour merged from 24 files to 1 (2023796 rows, 8150 ms)
2026-11-07T13:20:41Z [load_day 2026-03-30] 2026-03-30: index committed in 12091 ms (24 + 1 + 24 files)
2026-11-07T13:20:41Z [load_day 2026-03-30] 2026-03-30: 3827694 events in 24 hours
2026-11-07T13:20:41Z [load_day 2026-03-30] attempt 1 succeeded