orcaLog in

Runs · run 197

load_day 2026-09-13, attempt 1 succeeded

Host
4e84322b8c45:33981
Started
2026-11-07T04:03:31Z
Ended
2026-11-07T04:05:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/197/load_day/2026-09-13/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:03:31Z [load_day 2026-09-13] attempt 1 started
2026-11-07T04:03:40Z [load_day 2026-09-13] 2026-09-13 hour 0: 76994 events in 2 files, snapshot 260965500349070307 (task 6633 ms: download 2198 ms overlapping gunzip 380 ms, parse 1215 ms, sort 246 ms, write 3452 ms, index 279 ms: 8 candidates, 42157 repo-hours, 883 releases; waiting 782 ms; commit 638 ms)
2026-11-07T04:03:41Z [load_day 2026-09-13] 2026-09-13 hour 1: 94793 events in 2 files, snapshot 3470280879257072049 (task 6589 ms: download 1903 ms overlapping gunzip 411 ms, parse 1315 ms, sort 139 ms, write 3624 ms, index 307 ms: 8 candidates, 51497 repo-hours, 1164 releases; waiting 548 ms; commit 1550 ms)
2026-11-07T04:03:48Z [load_day 2026-09-13] 2026-09-13 hour 2: 108897 events in 3 files, snapshot 935411931031084093 (task 7397 ms: download 2412 ms overlapping gunzip 442 ms, parse 1300 ms, sort 163 ms, write 4183 ms, index 311 ms: 3 candidates, 49844 repo-hours, 973 releases; waiting 666 ms; commit 826 ms)
2026-11-07T04:03:49Z [load_day 2026-09-13] 2026-09-13 hour 3: 111896 events in 3 files, snapshot 3710873193681766712 (task 7055 ms: download 2466 ms overlapping gunzip 415 ms, parse 1212 ms, sort 102 ms, write 4013 ms, index 307 ms: 5 candidates, 52332 repo-hours, 1028 releases; waiting 679 ms; commit 592 ms)
2026-11-07T04:03:56Z [load_day 2026-09-13] 2026-09-13 hour 4: 104462 events in 3 files, snapshot 8436174601972517860 (task 7270 ms: download 2145 ms overlapping gunzip 458 ms, parse 1409 ms, sort 117 ms, write 4048 ms, index 381 ms: 5 candidates, 55253 repo-hours, 1040 releases; waiting 556 ms; commit 809 ms)
2026-11-07T04:03:57Z [load_day 2026-09-13] 2026-09-13 hour 5: 109547 events in 3 files, snapshot 484767511235832844 (task 6893 ms: download 1631 ms overlapping gunzip 424 ms, parse 1330 ms, sort 199 ms, write 4006 ms, index 312 ms: 8 candidates, 54111 repo-hours, 1130 releases; waiting 263 ms; commit 612 ms)
2026-11-07T04:04:03Z [load_day 2026-09-13] 2026-09-13 hour 6: 110607 events in 3 files, snapshot 3289621466972147640 (task 6436 ms: download 1853 ms overlapping gunzip 475 ms, parse 1381 ms, sort 114 ms, write 3453 ms, index 316 ms: 1 candidates, 48274 repo-hours, 990 releases; waiting 425 ms; commit 648 ms)
2026-11-07T04:04:04Z [load_day 2026-09-13] 2026-09-13 hour 7: 111746 events in 3 files, snapshot 5410050152525967615 (task 6350 ms: download 1978 ms overlapping gunzip 498 ms, parse 1565 ms, sort 104 ms, write 3021 ms, index 294 ms: 4 candidates, 48532 repo-hours, 1002 releases; waiting 555 ms; commit 841 ms)
2026-11-07T04:04:11Z [load_day 2026-09-13] 2026-09-13 hour 8: 105393 events in 3 files, snapshot 9166432639805677466 (task 7674 ms: download 2611 ms overlapping gunzip 521 ms, parse 1578 ms, sort 185 ms, write 3997 ms, index 349 ms: 6 candidates, 47545 repo-hours, 1380 releases; waiting 737 ms; commit 737 ms)
2026-11-07T04:04:13Z [load_day 2026-09-13] 2026-09-13 hour 9: 99611 events in 2 files, snapshot 5819436477956676094 (task 8209 ms: download 2137 ms overlapping gunzip 656 ms, parse 2089 ms, sort 176 ms, write 4097 ms, index 317 ms: 7 candidates, 51831 repo-hours, 1919 releases; waiting 369 ms; commit 822 ms)
2026-11-07T04:04:20Z [load_day 2026-09-13] 2026-09-13 hour 10: 115065 events in 3 files, snapshot 601575563160065470 (task 7993 ms: download 2820 ms overlapping gunzip 569 ms, parse 1683 ms, sort 119 ms, write 4315 ms, index 430 ms: 5 candidates, 60434 repo-hours, 1901 releases; waiting 575 ms; commit 692 ms)
2026-11-07T04:04:20Z [load_day 2026-09-13] 2026-09-13 hour 11: 116596 events in 3 files, snapshot 3783805394907748353 (task 7372 ms: download 2166 ms overlapping gunzip 553 ms, parse 1767 ms, sort 119 ms, write 3712 ms, index 378 ms: 7 candidates, 62267 repo-hours, 1707 releases; waiting 546 ms; commit 547 ms)
2026-11-07T04:04:30Z [load_day 2026-09-13] 2026-09-13 hour 12: 115033 events in 3 files, snapshot 8200301499593286498 (task 8348 ms: download 2493 ms overlapping gunzip 510 ms, parse 1527 ms, sort 152 ms, write 4761 ms, index 380 ms: 5 candidates, 60593 repo-hours, 1632 releases; waiting 670 ms; commit 1901 ms)
2026-11-07T04:04:31Z [load_day 2026-09-13] 2026-09-13 hour 13: 115069 events in 3 files, snapshot 7069007625198929782 (task 7623 ms: download 2167 ms overlapping gunzip 574 ms, parse 1717 ms, sort 115 ms, write 3925 ms, index 404 ms: 5 candidates, 63889 repo-hours, 1471 releases; waiting 548 ms; commit 739 ms)
2026-11-07T04:04:37Z [load_day 2026-09-13] 2026-09-13 hour 14: 118548 events in 3 files, snapshot 3214843101114054750 (task 6895 ms: download 2060 ms overlapping gunzip 486 ms, parse 1419 ms, sort 163 ms, write 3610 ms, index 460 ms: 10 candidates, 64162 repo-hours, 1193 releases; waiting 447 ms; commit 808 ms)
2026-11-07T04:04:38Z [load_day 2026-09-13] 2026-09-13 hour 15: 128527 events in 3 files, snapshot 4486336019455418985 (task 6482 ms: download 2202 ms overlapping gunzip 513 ms, parse 1528 ms, sort 149 ms, write 2814 ms, index 365 ms: 6 candidates, 61034 repo-hours, 927 releases; waiting 495 ms; commit 662 ms)
2026-11-07T04:04:44Z [load_day 2026-09-13] 2026-09-13 hour 16: 134872 events in 3 files, snapshot 2495467881830195888 (task 6250 ms: download 2363 ms overlapping gunzip 340 ms, parse 1010 ms, sort 141 ms, write 3355 ms, index 317 ms: 2 candidates, 48892 repo-hours, 713 releases; waiting 718 ms; commit 603 ms)
2026-11-07T04:04:45Z [load_day 2026-09-13] 2026-09-13 hour 17: 134709 events in 3 files, snapshot 1942313713462909411 (task 4539 ms: download 1579 ms overlapping gunzip 290 ms, parse 910 ms, sort 97 ms, write 2127 ms, index 272 ms: 7 candidates, 40337 repo-hours, 438 releases; waiting 558 ms; commit 665 ms)
2026-11-07T04:04:49Z [load_day 2026-09-13] 2026-09-13 hour 18: 137844 events in 3 files, snapshot 2931705947074525932 (task 4632 ms: download 1884 ms overlapping gunzip 315 ms, parse 1018 ms, sort 112 ms, write 2003 ms, index 305 ms: 7 candidates, 38596 repo-hours, 394 releases; waiting 561 ms; commit 755 ms)
2026-11-07T04:04:50Z [load_day 2026-09-13] 2026-09-13 hour 19: 138529 events in 3 files, snapshot 6117320787714541078 (task 4469 ms: download 1578 ms overlapping gunzip 276 ms, parse 891 ms, sort 98 ms, write 2096 ms, index 239 ms: 3 candidates, 36781 repo-hours, 324 releases; waiting 564 ms; commit 708 ms)
2026-11-07T04:04:54Z [load_day 2026-09-13] 2026-09-13 hour 20: 140425 events in 3 files, snapshot 1289405029200057857 (task 3939 ms: download 1395 ms overlapping gunzip 218 ms, parse 752 ms, sort 98 ms, write 1773 ms, index 258 ms: 5 candidates, 35306 repo-hours, 156 releases; waiting 541 ms; commit 692 ms)
2026-11-07T04:04:54Z [load_day 2026-09-13] 2026-09-13 hour 21: 138117 events in 3 files, snapshot 4679000015306116271 (task 3725 ms: download 2042 ms overlapping gunzip 199 ms, parse 681 ms, sort 92 ms, write 1590 ms, index 235 ms: 3 candidates, 34697 repo-hours, 130 releases; waiting 575 ms; commit 677 ms)
2026-11-07T04:05:00Z [load_day 2026-09-13] 2026-09-13 hour 22: 136914 events in 3 files, snapshot 7656035863141106734 (task 3679 ms: download 1261 ms overlapping gunzip 230 ms, parse 805 ms, sort 97 ms, write 1533 ms, index 221 ms: 1 candidates, 31932 repo-hours, 125 releases; waiting 522 ms; commit 2631 ms)
2026-11-07T04:05:03Z [load_day 2026-09-13] 2026-09-13 hour 23: 129190 events in 3 files, snapshot 4038000576155668865 (task 3181 ms: download 1109 ms overlapping gunzip 196 ms, parse 672 ms, sort 83 ms, write 1355 ms, index 194 ms: 5 candidates, 30973 repo-hours, 106 releases; waiting 387 ms; commit 3859 ms)
2026-11-07T04:05:09Z [load_day 2026-09-13] 2026-09-13: repo_hour merged from 24 files to 1 (1171269 rows, 5447 ms)
2026-11-07T04:05:10Z [load_day 2026-09-13] 2026-09-13: index committed in 6679 ms (24 + 1 + 24 files)
2026-11-07T04:05:10Z [load_day 2026-09-13] 2026-09-13: 2833384 events in 24 hours
2026-11-07T04:05:10Z [load_day 2026-09-13] attempt 1 succeeded