orcaLog in

Runs · run 185

load_day 2026-09-17, attempt 1 succeeded

Host
4e84322b8c45:31965
Started
2026-11-07T03:58:30Z
Ended
2026-11-07T03:59:41Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/185/load_day/2026-09-17/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:58:30Z [load_day 2026-09-17] attempt 1 started
2026-11-07T03:58:38Z [load_day 2026-09-17] 2026-09-17 hour 0: 82343 events in 2 files, snapshot 4241211149688274235 (task 5756 ms: download 2255 ms overlapping gunzip 411 ms, parse 1248 ms, sort 143 ms, write 2548 ms, index 266 ms: 6 candidates, 38935 repo-hours, 831 releases; waiting 790 ms; commit 669 ms)
2026-11-07T03:58:39Z [load_day 2026-09-17] 2026-09-17 hour 1: 80979 events in 2 files, snapshot 1447792489263200666 (task 5020 ms: download 1707 ms overlapping gunzip 288 ms, parse 894 ms, sort 95 ms, write 2519 ms, index 294 ms: 8 candidates, 38469 repo-hours, 628 releases; waiting 585 ms; commit 533 ms)
2026-11-07T03:58:43Z [load_day 2026-09-17] 2026-09-17 hour 2: 82016 events in 2 files, snapshot 209247470769949006 (task 4572 ms: download 1805 ms overlapping gunzip 281 ms, parse 812 ms, sort 70 ms, write 2134 ms, index 329 ms: 3 candidates, 42798 repo-hours, 515 releases; waiting 609 ms; commit 782 ms)
2026-11-07T03:58:44Z [load_day 2026-09-17] 2026-09-17 hour 3: 86476 events in 2 files, snapshot 6065444294099557034 (task 4618 ms: download 1722 ms overlapping gunzip 360 ms, parse 979 ms, sort 91 ms, write 2040 ms, index 267 ms: 6 candidates, 43554 repo-hours, 579 releases; waiting 585 ms; commit 661 ms)
2026-11-07T03:58:49Z [load_day 2026-09-17] 2026-09-17 hour 4: 88667 events in 2 files, snapshot 4164824495565439003 (task 4935 ms: download 2119 ms overlapping gunzip 290 ms, parse 840 ms, sort 85 ms, write 2305 ms, index 321 ms: 6 candidates, 44409 repo-hours, 595 releases; waiting 781 ms; commit 663 ms)
2026-11-07T03:58:49Z [load_day 2026-09-17] 2026-09-17 hour 5: 89456 events in 2 files, snapshot 5595098143751384964 (task 4169 ms: download 1597 ms overlapping gunzip 300 ms, parse 881 ms, sort 116 ms, write 1735 ms, index 284 ms: 5 candidates, 42390 repo-hours, 464 releases; waiting 550 ms; commit 647 ms)
2026-11-07T03:58:54Z [load_day 2026-09-17] 2026-09-17 hour 6: 92357 events in 2 files, snapshot 7974255399839678403 (task 4397 ms: download 1742 ms overlapping gunzip 293 ms, parse 809 ms, sort 74 ms, write 1878 ms, index 389 ms: 2 candidates, 45409 repo-hours, 437 releases; waiting 633 ms; commit 731 ms)
2026-11-07T03:58:55Z [load_day 2026-09-17] 2026-09-17 hour 7: 89150 events in 2 files, snapshot 8220654759357646246 (task 4253 ms: download 1415 ms overlapping gunzip 314 ms, parse 955 ms, sort 95 ms, write 1666 ms, index 316 ms: 4 candidates, 48839 repo-hours, 390 releases; waiting 540 ms; commit 676 ms)
2026-11-07T03:58:58Z [load_day 2026-09-17] 2026-09-17 hour 8: 88862 events in 2 files, snapshot 2413444421038027952 (task 3963 ms: download 1917 ms overlapping gunzip 212 ms, parse 656 ms, sort 63 ms, write 1499 ms, index 325 ms: 5 candidates, 48232 repo-hours, 293 releases; waiting 910 ms; commit 640 ms)
2026-11-07T03:58:59Z [load_day 2026-09-17] 2026-09-17 hour 9: 86447 events in 2 files, snapshot 5647541872089420422 (task 4034 ms: download 1395 ms overlapping gunzip 259 ms, parse 788 ms, sort 68 ms, write 1699 ms, index 351 ms: 6 candidates, 48689 repo-hours, 443 releases; waiting 562 ms; commit 624 ms)
2026-11-07T03:59:04Z [load_day 2026-09-17] 2026-09-17 hour 10: 79717 events in 2 files, snapshot 98356600628297589 (task 4290 ms: download 1724 ms overlapping gunzip 237 ms, parse 727 ms, sort 63 ms, write 1882 ms, index 378 ms: 6 candidates, 46539 repo-hours, 404 releases; waiting 598 ms; commit 774 ms)
2026-11-07T03:59:04Z [load_day 2026-09-17] 2026-09-17 hour 11: 82985 events in 2 files, snapshot 8048702913346519865 (task 4086 ms: download 1601 ms overlapping gunzip 290 ms, parse 799 ms, sort 66 ms, write 1772 ms, index 316 ms: 3 candidates, 47340 repo-hours, 417 releases; waiting 544 ms; commit 724 ms)
2026-11-07T03:59:08Z [load_day 2026-09-17] 2026-09-17 hour 12: 75457 events in 2 files, snapshot 8969227839755183393 (task 4003 ms: download 1688 ms overlapping gunzip 213 ms, parse 640 ms, sort 83 ms, write 1622 ms, index 353 ms: 6 candidates, 47682 repo-hours, 341 releases; waiting 783 ms; commit 593 ms)
2026-11-07T03:59:09Z [load_day 2026-09-17] 2026-09-17 hour 13: 72486 events in 2 files, snapshot 6009364689799423020 (task 3754 ms: download 1566 ms overlapping gunzip 236 ms, parse 651 ms, sort 56 ms, write 1510 ms, index 283 ms: 7 candidates, 45588 repo-hours, 341 releases; waiting 704 ms; commit 645 ms)
2026-11-07T03:59:12Z [load_day 2026-09-17] 2026-09-17 hour 14: 62901 events in 2 files, snapshot 6133805964712954457 (task 3935 ms: download 1436 ms overlapping gunzip 222 ms, parse 661 ms, sort 75 ms, write 1772 ms, index 277 ms: 2 candidates, 40781 repo-hours, 436 releases; waiting 628 ms; commit 709 ms)
2026-11-07T03:59:13Z [load_day 2026-09-17] 2026-09-17 hour 15: 61147 events in 2 files, snapshot 1323355207868244315 (task 3766 ms: download 1372 ms overlapping gunzip 270 ms, parse 752 ms, sort 76 ms, write 1578 ms, index 237 ms: 2 candidates, 36763 repo-hours, 400 releases; waiting 565 ms; commit 614 ms)
2026-11-07T03:59:17Z [load_day 2026-09-17] 2026-09-17 hour 16: 55608 events in 2 files, snapshot 8382292450302892376 (task 3888 ms: download 1365 ms overlapping gunzip 203 ms, parse 595 ms, sort 50 ms, write 1822 ms, index 235 ms: 2 candidates, 35326 repo-hours, 399 releases; waiting 661 ms; commit 732 ms)
2026-11-07T03:59:18Z [load_day 2026-09-17] 2026-09-17 hour 17: 54967 events in 2 files, snapshot 7092057875648558431 (task 3611 ms: download 1444 ms overlapping gunzip 242 ms, parse 700 ms, sort 53 ms, write 1504 ms, index 236 ms: 1 candidates, 33547 repo-hours, 402 releases; waiting 575 ms; commit 819 ms)
2026-11-07T03:59:21Z [load_day 2026-09-17] 2026-09-17 hour 18: 61241 events in 2 files, snapshot 1542275091033326897 (task 4132 ms: download 1551 ms overlapping gunzip 239 ms, parse 712 ms, sort 88 ms, write 1845 ms, index 219 ms: 4 candidates, 34059 repo-hours, 447 releases; waiting 786 ms; commit 657 ms)
2026-11-07T03:59:22Z [load_day 2026-09-17] 2026-09-17 hour 19: 61214 events in 2 files, snapshot 5988719421842547379 (task 4155 ms: download 1903 ms overlapping gunzip 256 ms, parse 738 ms, sort 52 ms, write 1589 ms, index 207 ms: 2 candidates, 33236 repo-hours, 364 releases; waiting 949 ms; commit 715 ms)
2026-11-07T03:59:26Z [load_day 2026-09-17] 2026-09-17 hour 20: 62725 events in 2 files, snapshot 4993031414327266042 (task 4262 ms: download 1548 ms overlapping gunzip 248 ms, parse 715 ms, sort 65 ms, write 1927 ms, index 314 ms: 2 candidates, 33805 repo-hours, 432 releases; waiting 669 ms; commit 619 ms)
2026-11-07T03:59:28Z [load_day 2026-09-17] 2026-09-17 hour 21: 62044 events in 2 files, snapshot 5529184128430884272 (task 4816 ms: download 1715 ms overlapping gunzip 350 ms, parse 1055 ms, sort 95 ms, write 2191 ms, index 223 ms: 6 candidates, 33942 repo-hours, 583 releases; waiting 566 ms; commit 757 ms)
2026-11-07T03:59:31Z [load_day 2026-09-17] 2026-09-17 hour 22: 67711 events in 2 files, snapshot 8486859697866960720 (task 4479 ms: download 1512 ms overlapping gunzip 299 ms, parse 874 ms, sort 102 ms, write 2108 ms, index 266 ms: 6 candidates, 35571 repo-hours, 627 releases; waiting 566 ms; commit 757 ms)
2026-11-07T03:59:34Z [load_day 2026-09-17] 2026-09-17 hour 23: 73028 events in 2 files, snapshot 2277626042005009745 (task 5530 ms: download 2333 ms overlapping gunzip 326 ms, parse 985 ms, sort 113 ms, write 2385 ms, index 287 ms: 6 candidates, 36780 repo-hours, 751 releases; waiting 1095 ms; commit 666 ms)
2026-11-07T03:59:39Z [load_day 2026-09-17] 2026-09-17: repo_hour merged from 24 files to 1 (982683 rows, 4754 ms)
2026-11-07T03:59:41Z [load_day 2026-09-17] 2026-09-17: index committed in 6645 ms (24 + 1 + 24 files)
2026-11-07T03:59:41Z [load_day 2026-09-17] 2026-09-17: 1799984 events in 24 hours
2026-11-07T03:59:41Z [load_day 2026-09-17] attempt 1 succeeded