orcaLog in

Runs · run 711

load_day 2026-03-26, attempt 1 succeeded

Host
4e84322b8c45:176339
Started
2026-11-07T13:26:10Z
Ended
2026-11-07T13:27:46Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/711/load_day/2026-03-26/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T13:26:10Z [load_day 2026-03-26] attempt 1 started
2026-11-07T13:26:21Z [load_day 2026-03-26] 2026-03-26 hour 0: 152659 events in 4 files, snapshot 6891625897088077734 (task 6717 ms: download 2163 ms overlapping gunzip 402 ms, parse 1392 ms, sort 197 ms, write 3294 ms, index 530 ms: 11 candidates, 74291 repo-hours, 720 releases; waiting 511 ms; commit 1231 ms)
2026-11-07T13:26:22Z [load_day 2026-03-26] 2026-03-26 hour 1: 165766 events in 4 files, snapshot 7409764522766314941 (task 7242 ms: download 2023 ms overlapping gunzip 426 ms, parse 1435 ms, sort 200 ms, write 3931 ms, index 589 ms: 11 candidates, 92054 repo-hours, 405 releases; waiting 355 ms; commit 1391 ms)
2026-11-07T13:26:27Z [load_day 2026-03-26] 2026-03-26 hour 2: 165191 events in 4 files, snapshot 6362653519523486462 (task 5400 ms: download 1707 ms overlapping gunzip 354 ms, parse 1105 ms, sort 166 ms, write 2427 ms, index 632 ms: 8 candidates, 97075 repo-hours, 366 releases; waiting 351 ms; commit 1289 ms)
2026-11-07T13:26:31Z [load_day 2026-03-26] 2026-03-26 hour 3: 158166 events in 4 files, snapshot 1785218238221309208 (task 7544 ms: download 2233 ms overlapping gunzip 501 ms, parse 1549 ms, sort 160 ms, write 3860 ms, index 587 ms: 9 candidates, 78681 repo-hours, 648 releases; waiting 581 ms; commit 1618 ms)
2026-11-07T13:26:39Z [load_day 2026-03-26] 2026-03-26 hour 4: 153760 events in 4 files, snapshot 3745842877278303089 (task 11454 ms: download 3696 ms overlapping gunzip 740 ms, parse 2322 ms, sort 235 ms, write 6320 ms, index 479 ms: 2 candidates, 72077 repo-hours, 631 releases; waiting 1122 ms; commit 1297 ms)
2026-11-07T13:26:41Z [load_day 2026-03-26] 2026-03-26 hour 5: 158608 events in 4 files, snapshot 1472333838610290718 (task 7804 ms: download 2898 ms overlapping gunzip 539 ms, parse 1595 ms, sort 174 ms, write 3770 ms, index 587 ms: 6 candidates, 81913 repo-hours, 563 releases; waiting 804 ms; commit 1437 ms)
2026-11-07T13:26:46Z [load_day 2026-03-26] 2026-03-26 hour 6: 159887 events in 4 files, snapshot 3600451956714917297 (task 6158 ms: download 2076 ms overlapping gunzip 438 ms, parse 1354 ms, sort 194 ms, write 2524 ms, index 702 ms: 11 candidates, 83631 repo-hours, 460 releases; waiting 568 ms; commit 1377 ms)
2026-11-07T13:26:48Z [load_day 2026-03-26] 2026-03-26 hour 7: 163333 events in 4 files, snapshot 5274227078195100653 (task 5748 ms: download 1872 ms overlapping gunzip 401 ms, parse 1156 ms, sort 177 ms, write 2497 ms, index 615 ms: 11 candidates, 88350 repo-hours, 315 releases; waiting 609 ms; commit 1458 ms)
2026-11-07T13:26:52Z [load_day 2026-03-26] 2026-03-26 hour 8: 162712 events in 4 files, snapshot 5144181381040274937 (task 4728 ms: download 1349 ms overlapping gunzip 320 ms, parse 1042 ms, sort 148 ms, write 2031 ms, index 611 ms: 9 candidates, 88551 repo-hours, 143 releases; waiting 250 ms; commit 1308 ms)
2026-11-07T13:26:54Z [load_day 2026-03-26] 2026-03-26 hour 9: 161553 events in 4 files, snapshot 3302188239584291097 (task 5390 ms: download 2210 ms overlapping gunzip 304 ms, parse 957 ms, sort 123 ms, write 2215 ms, index 600 ms: 9 candidates, 88122 repo-hours, 163 releases; waiting 812 ms; commit 1438 ms)
2026-11-07T13:26:58Z [load_day 2026-03-26] 2026-03-26 hour 10: 159816 events in 4 files, snapshot 2657650603487236731 (task 4862 ms: download 1472 ms overlapping gunzip 299 ms, parse 973 ms, sort 138 ms, write 1933 ms, index 726 ms: 6 candidates, 88677 repo-hours, 130 releases; waiting 528 ms; commit 1418 ms)
2026-11-07T13:26:59Z [load_day 2026-03-26] 2026-03-26 hour 11: 167191 events in 4 files, snapshot 7579230774215986767 (task 4878 ms: download 1834 ms overlapping gunzip 289 ms, parse 935 ms, sort 128 ms, write 1956 ms, index 662 ms: 12 candidates, 92285 repo-hours, 127 releases; waiting 614 ms; commit 1321 ms)
2026-11-07T13:27:03Z [load_day 2026-03-26] 2026-03-26 hour 12: 167579 events in 4 files, snapshot 7711956614503199193 (task 5130 ms: download 1422 ms overlapping gunzip 312 ms, parse 1033 ms, sort 147 ms, write 2153 ms, index 714 ms: 5 candidates, 96429 repo-hours, 123 releases; waiting 539 ms; commit 1346 ms)
2026-11-07T13:27:05Z [load_day 2026-03-26] 2026-03-26 hour 13: 161730 events in 4 files, snapshot 2566567355894892909 (task 4659 ms: download 1916 ms overlapping gunzip 278 ms, parse 1000 ms, sort 137 ms, write 1760 ms, index 677 ms: 12 candidates, 99429 repo-hours, 51 releases; waiting 537 ms; commit 1293 ms)
2026-11-07T13:27:08Z [load_day 2026-03-26] 2026-03-26 hour 14: 151607 events in 4 files, snapshot 8963970400252113011 (task 4526 ms: download 1967 ms overlapping gunzip 273 ms, parse 868 ms, sort 126 ms, write 1635 ms, index 716 ms: 8 candidates, 91525 repo-hours, 85 releases; waiting 555 ms; commit 1169 ms)
2026-11-07T13:27:10Z [load_day 2026-03-26] 2026-03-26 hour 15: 152669 events in 4 files, snapshot 80857531444846920 (task 4506 ms: download 1640 ms overlapping gunzip 253 ms, parse 852 ms, sort 120 ms, write 1651 ms, index 620 ms: 9 candidates, 88788 repo-hours, 69 releases; waiting 615 ms; commit 1186 ms)
2026-11-07T13:27:14Z [load_day 2026-03-26] 2026-03-26 hour 16: 160331 events in 4 files, snapshot 8976429266056484059 (task 4970 ms: download 1540 ms overlapping gunzip 297 ms, parse 962 ms, sort 161 ms, write 1859 ms, index 670 ms: 14 candidates, 91454 repo-hours, 65 releases; waiting 635 ms; commit 1297 ms)
2026-11-07T13:27:16Z [load_day 2026-03-26] 2026-03-26 hour 17: 160432 events in 4 files, snapshot 8809891958870419528 (task 5132 ms: download 1655 ms overlapping gunzip 283 ms, parse 923 ms, sort 141 ms, write 1916 ms, index 650 ms: 11 candidates, 91065 repo-hours, 67 releases; waiting 985 ms; commit 1386 ms)
2026-11-07T13:27:20Z [load_day 2026-03-26] 2026-03-26 hour 18: 167286 events in 4 files, snapshot 7970156111756619682 (task 5106 ms: download 1958 ms overlapping gunzip 327 ms, parse 1024 ms, sort 151 ms, write 2080 ms, index 624 ms: 12 candidates, 91373 repo-hours, 138 releases; waiting 579 ms; commit 1395 ms)
2026-11-07T13:27:22Z [load_day 2026-03-26] 2026-03-26 hour 19: 163772 events in 4 files, snapshot 8777422652597086157 (task 4993 ms: download 1899 ms overlapping gunzip 339 ms, parse 1065 ms, sort 127 ms, write 2053 ms, index 579 ms: 8 candidates, 87327 repo-hours, 174 releases; waiting 538 ms; commit 1395 ms)
2026-11-07T13:27:26Z [load_day 2026-03-26] 2026-03-26 hour 20: 157971 events in 4 files, snapshot 7591424760014411433 (task 5153 ms: download 2436 ms overlapping gunzip 344 ms, parse 1133 ms, sort 130 ms, write 1969 ms, index 643 ms: 10 candidates, 83895 repo-hours, 212 releases; waiting 536 ms; commit 1352 ms)
2026-11-07T13:27:28Z [load_day 2026-03-26] 2026-03-26 hour 21: 162024 events in 4 files, snapshot 562127090697079277 (task 5418 ms: download 1787 ms overlapping gunzip 379 ms, parse 1196 ms, sort 149 ms, write 2243 ms, index 596 ms: 11 candidates, 82828 repo-hours, 358 releases; waiting 558 ms; commit 1383 ms)
2026-11-07T13:27:33Z [load_day 2026-03-26] 2026-03-26 hour 22: 161631 events in 4 files, snapshot 1833501206223098025 (task 6111 ms: download 2157 ms overlapping gunzip 461 ms, parse 1505 ms, sort 170 ms, write 2586 ms, index 556 ms: 17 candidates, 81121 repo-hours, 511 releases; waiting 541 ms; commit 1346 ms)
2026-11-07T13:27:35Z [load_day 2026-03-26] 2026-03-26 hour 23: 158239 events in 4 files, snapshot 1851966143653800204 (task 6473 ms: download 1936 ms overlapping gunzip 487 ms, parse 1631 ms, sort 170 ms, write 2881 ms, index 520 ms: 11 candidates, 77031 repo-hours, 780 releases; waiting 512 ms; commit 1326 ms)
2026-11-07T13:27:44Z [load_day 2026-03-26] 2026-03-26: repo_hour merged from 24 files to 1 (2087972 rows, 8836 ms)
2026-11-07T13:27:46Z [load_day 2026-03-26] 2026-03-26: index committed in 10638 ms (24 + 1 + 24 files)
2026-11-07T13:27:46Z [load_day 2026-03-26] 2026-03-26: 3853913 events in 24 hours
2026-11-07T13:27:46Z [load_day 2026-03-26] attempt 1 succeeded