orcaLog in

Runs · run 428

load_day 2026-06-28, attempt 1 succeeded

Host
4e84322b8c45:88005
Started
2026-11-07T05:31:03Z
Ended
2026-11-07T05:32:12Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/428/load_day/2026-06-28/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:31:03Z [load_day 2026-06-28] attempt 1 started
2026-11-07T05:31:11Z [load_day 2026-06-28] 2026-06-28 hour 0: 159721 events in 4 files, snapshot 4657292136957134609 (task 4583 ms: download 1525 ms overlapping gunzip 263 ms, parse 948 ms, sort 117 ms, write 1969 ms, index 422 ms: 9 candidates, 59167 repo-hours, 369 releases; waiting 516 ms; commit 1136 ms)
2026-11-07T05:31:12Z [load_day 2026-06-28] 2026-06-28 hour 1: 156189 events in 4 files, snapshot 2596462030052914252 (task 4648 ms: download 1641 ms overlapping gunzip 294 ms, parse 1035 ms, sort 192 ms, write 1921 ms, index 347 ms: 9 candidates, 56761 repo-hours, 477 releases; waiting 537 ms; commit 947 ms)
2026-11-07T05:31:16Z [load_day 2026-06-28] 2026-06-28 hour 2: 163783 events in 4 files, snapshot 6717744755208343213 (task 4238 ms: download 1349 ms overlapping gunzip 226 ms, parse 840 ms, sort 107 ms, write 1691 ms, index 626 ms: 3 candidates, 76746 repo-hours, 165 releases; waiting 524 ms; commit 1254 ms)
2026-11-07T05:31:17Z [load_day 2026-06-28] 2026-06-28 hour 3: 160739 events in 4 files, snapshot 3432044170644195518 (task 4220 ms: download 1365 ms overlapping gunzip 240 ms, parse 846 ms, sort 111 ms, write 1750 ms, index 485 ms: 9 candidates, 69388 repo-hours, 198 releases; waiting 540 ms; commit 987 ms)
2026-11-07T05:31:21Z [load_day 2026-06-28] 2026-06-28 hour 4: 167387 events in 4 files, snapshot 829731391579526419 (task 4323 ms: download 1364 ms overlapping gunzip 222 ms, parse 852 ms, sort 116 ms, write 1709 ms, index 520 ms: 5 candidates, 74315 repo-hours, 75 releases; waiting 526 ms; commit 1002 ms)
2026-11-07T05:31:22Z [load_day 2026-06-28] 2026-06-28 hour 5: 159364 events in 4 files, snapshot 7407841684133503972 (task 3940 ms: download 1697 ms overlapping gunzip 241 ms, parse 856 ms, sort 105 ms, write 1529 ms, index 397 ms: 8 candidates, 64450 repo-hours, 187 releases; waiting 546 ms; commit 930 ms)
2026-11-07T05:31:26Z [load_day 2026-06-28] 2026-06-28 hour 6: 165754 events in 4 files, snapshot 4866328217389133390 (task 3986 ms: download 1927 ms overlapping gunzip 228 ms, parse 829 ms, sort 119 ms, write 1506 ms, index 454 ms: 5 candidates, 67399 repo-hours, 124 releases; waiting 552 ms; commit 1098 ms)
2026-11-07T05:31:27Z [load_day 2026-06-28] 2026-06-28 hour 7: 167788 events in 4 files, snapshot 2742152998702559345 (task 4179 ms: download 1696 ms overlapping gunzip 224 ms, parse 809 ms, sort 107 ms, write 1605 ms, index 457 ms: 6 candidates, 69587 repo-hours, 93 releases; waiting 577 ms; commit 944 ms)
2026-11-07T05:31:30Z [load_day 2026-06-28] 2026-06-28 hour 8: 161348 events in 4 files, snapshot 7409715108205058800 (task 4040 ms: download 1201 ms overlapping gunzip 208 ms, parse 770 ms, sort 104 ms, write 1554 ms, index 485 ms: 6 candidates, 73478 repo-hours, 77 releases; waiting 561 ms; commit 1051 ms)
2026-11-07T05:31:31Z [load_day 2026-06-28] 2026-06-28 hour 9: 168002 events in 4 files, snapshot 568300591160643146 (task 3631 ms: download 826 ms overlapping gunzip 215 ms, parse 792 ms, sort 122 ms, write 1498 ms, index 484 ms: 6 candidates, 72387 repo-hours, 52 releases; waiting 221 ms; commit 1025 ms)
2026-11-07T05:31:35Z [load_day 2026-06-28] 2026-06-28 hour 10: 165483 events in 4 files, snapshot 7501086252765534818 (task 4178 ms: download 1600 ms overlapping gunzip 207 ms, parse 778 ms, sort 106 ms, write 1686 ms, index 525 ms: 5 candidates, 72595 repo-hours, 71 releases; waiting 521 ms; commit 1055 ms)
2026-11-07T05:31:36Z [load_day 2026-06-28] 2026-06-28 hour 11: 162789 events in 4 files, snapshot 5156595182414903805 (task 4006 ms: download 1326 ms overlapping gunzip 204 ms, parse 761 ms, sort 104 ms, write 1607 ms, index 501 ms: 7 candidates, 74800 repo-hours, 61 releases; waiting 535 ms; commit 997 ms)
2026-11-07T05:31:40Z [load_day 2026-06-28] 2026-06-28 hour 12: 164471 events in 4 files, snapshot 5355388882341447564 (task 3663 ms: download 880 ms overlapping gunzip 194 ms, parse 740 ms, sort 107 ms, write 1443 ms, index 520 ms: 7 candidates, 75306 repo-hours, 45 releases; waiting 185 ms; commit 1110 ms)
2026-11-07T05:31:41Z [load_day 2026-06-28] 2026-06-28 hour 13: 162165 events in 4 files, snapshot 6723771067349706265 (task 3839 ms: download 1248 ms overlapping gunzip 198 ms, parse 759 ms, sort 107 ms, write 1470 ms, index 551 ms: 9 candidates, 86331 repo-hours, 21 releases; waiting 523 ms; commit 939 ms)
2026-11-07T05:31:44Z [load_day 2026-06-28] 2026-06-28 hour 14: 161444 events in 4 files, snapshot 9186273132566726641 (task 3781 ms: download 1384 ms overlapping gunzip 220 ms, parse 761 ms, sort 100 ms, write 1407 ms, index 493 ms: 7 candidates, 75176 repo-hours, 34 releases; waiting 535 ms; commit 1027 ms)
2026-11-07T05:31:45Z [load_day 2026-06-28] 2026-06-28 hour 15: 164941 events in 4 files, snapshot 8444574117541355535 (task 3960 ms: download 1144 ms overlapping gunzip 200 ms, parse 764 ms, sort 108 ms, write 1545 ms, index 545 ms: 7 candidates, 73951 repo-hours, 19 releases; waiting 533 ms; commit 1043 ms)
2026-11-07T05:31:49Z [load_day 2026-06-28] 2026-06-28 hour 16: 165772 events in 4 files, snapshot 2567462046778004119 (task 3887 ms: download 1149 ms overlapping gunzip 199 ms, parse 744 ms, sort 104 ms, write 1521 ms, index 547 ms: 12 candidates, 73449 repo-hours, 21 releases; waiting 547 ms; commit 1125 ms)
2026-11-07T05:31:50Z [load_day 2026-06-28] 2026-06-28 hour 17: 164846 events in 4 files, snapshot 1548460240584966446 (task 3891 ms: download 1581 ms overlapping gunzip 197 ms, parse 762 ms, sort 103 ms, write 1448 ms, index 493 ms: 4 candidates, 72455 repo-hours, 22 releases; waiting 534 ms; commit 1055 ms)
2026-11-07T05:31:53Z [load_day 2026-06-28] 2026-06-28 hour 18: 163740 events in 4 files, snapshot 7798039210148568960 (task 4022 ms: download 1610 ms overlapping gunzip 201 ms, parse 759 ms, sort 102 ms, write 1533 ms, index 538 ms: 10 candidates, 71311 repo-hours, 15 releases; waiting 524 ms; commit 997 ms)
2026-11-07T05:31:54Z [load_day 2026-06-28] 2026-06-28 hour 19: 168160 events in 4 files, snapshot 3475282198468472022 (task 3878 ms: download 1827 ms overlapping gunzip 208 ms, parse 763 ms, sort 105 ms, write 1502 ms, index 472 ms: 9 candidates, 71947 repo-hours, 24 releases; waiting 542 ms; commit 970 ms)
2026-11-07T05:31:58Z [load_day 2026-06-28] 2026-06-28 hour 20: 166799 events in 4 files, snapshot 8220061985437302427 (task 3936 ms: download 1429 ms overlapping gunzip 213 ms, parse 793 ms, sort 110 ms, write 1488 ms, index 514 ms: 4 candidates, 70280 repo-hours, 55 releases; waiting 506 ms; commit 882 ms)
2026-11-07T05:31:59Z [load_day 2026-06-28] 2026-06-28 hour 21: 167736 events in 4 files, snapshot 7122015221861774158 (task 3832 ms: download 1205 ms overlapping gunzip 210 ms, parse 780 ms, sort 110 ms, write 1540 ms, index 424 ms: 7 candidates, 64106 repo-hours, 34 releases; waiting 533 ms; commit 929 ms)
2026-11-07T05:32:02Z [load_day 2026-06-28] 2026-06-28 hour 22: 162767 events in 4 files, snapshot 3078603332530871827 (task 4067 ms: download 2139 ms overlapping gunzip 223 ms, parse 811 ms, sort 110 ms, write 1622 ms, index 468 ms: 5 candidates, 65758 repo-hours, 87 releases; waiting 529 ms; commit 1120 ms)
2026-11-07T05:32:03Z [load_day 2026-06-28] 2026-06-28 hour 23: 164631 events in 4 files, snapshot 4272971421613756000 (task 3954 ms: download 1312 ms overlapping gunzip 226 ms, parse 823 ms, sort 119 ms, write 1638 ms, index 437 ms: 5 candidates, 64954 repo-hours, 155 releases; waiting 410 ms; commit 992 ms)
2026-11-07T05:32:10Z [load_day 2026-06-28] 2026-06-28: repo_hour merged from 24 files to 1 (1696097 rows, 6900 ms)
2026-11-07T05:32:12Z [load_day 2026-06-28] 2026-06-28: index committed in 8504 ms (24 + 1 + 24 files)
2026-11-07T05:32:12Z [load_day 2026-06-28] 2026-06-28: 3935819 events in 24 hours
2026-11-07T05:32:12Z [load_day 2026-06-28] attempt 1 succeeded