orcaLog in

Runs · run 245

load_day 2026-08-28, attempt 1 succeeded

Host
4e84322b8c45:40671
Started
2026-11-07T04:22:53Z
Ended
2026-11-07T04:23:32Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/245/load_day/2026-08-28/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:22:53Z [load_day 2026-08-28] attempt 1 started
2026-11-07T04:22:58Z [load_day 2026-08-28] 2026-08-28 hour 0: 25784 events in 1 files, snapshot 8725842090809963505 (task 1700 ms: download 745 ms overlapping gunzip 49 ms, parse 184 ms, sort 14 ms, write 390 ms, index 163 ms: 0 candidates, 8862 repo-hours, 31 releases; waiting 527 ms; commit 543 ms)
2026-11-07T04:22:59Z [load_day 2026-08-28] 2026-08-28 hour 1: 40226 events in 1 files, snapshot 326377122963112486 (task 1857 ms: download 774 ms overlapping gunzip 70 ms, parse 276 ms, sort 27 ms, write 533 ms, index 121 ms: 2 candidates, 11480 repo-hours, 24 releases; waiting 513 ms; commit 694 ms)
2026-11-07T04:23:01Z [load_day 2026-08-28] 2026-08-28 hour 2: 55217 events in 2 files, snapshot 1450671903831111467 (task 2056 ms: download 828 ms overlapping gunzip 83 ms, parse 336 ms, sort 50 ms, write 630 ms, index 95 ms: 0 candidates, 14211 repo-hours, 34 releases; waiting 531 ms; commit 805 ms)
2026-11-07T04:23:01Z [load_day 2026-08-28] 2026-08-28 hour 3: 81113 events in 2 files, snapshot 1717544330039701524 (task 1975 ms: download 550 ms overlapping gunzip 98 ms, parse 379 ms, sort 54 ms, write 820 ms, index 110 ms: 1 candidates, 15046 repo-hours, 29 releases; waiting 191 ms; commit 770 ms)
2026-11-07T04:23:03Z [load_day 2026-08-28] 2026-08-28 hour 4: 72354 events in 2 files, snapshot 4232033450860698199 (task 2308 ms: download 878 ms overlapping gunzip 112 ms, parse 409 ms, sort 47 ms, write 799 ms, index 121 ms: 4 candidates, 14681 repo-hours, 52 releases; waiting 521 ms; commit 703 ms)
2026-11-07T04:23:04Z [load_day 2026-08-28] 2026-08-28 hour 5: 71256 events in 2 files, snapshot 9149268637285572161 (task 2236 ms: download 871 ms overlapping gunzip 99 ms, parse 374 ms, sort 49 ms, write 779 ms, index 112 ms: 4 candidates, 15244 repo-hours, 36 releases; waiting 520 ms; commit 694 ms)
2026-11-07T04:23:06Z [load_day 2026-08-28] 2026-08-28 hour 6: 65360 events in 2 files, snapshot 8311138433272677261 (task 2147 ms: download 893 ms overlapping gunzip 88 ms, parse 342 ms, sort 38 ms, write 707 ms, index 115 ms: 1 candidates, 15329 repo-hours, 29 releases; waiting 541 ms; commit 715 ms)
2026-11-07T04:23:07Z [load_day 2026-08-28] 2026-08-28 hour 7: 64525 events in 2 files, snapshot 6242184921471055036 (task 2182 ms: download 864 ms overlapping gunzip 100 ms, parse 369 ms, sort 43 ms, write 715 ms, index 127 ms: 1 candidates, 15495 repo-hours, 28 releases; waiting 532 ms; commit 750 ms)
2026-11-07T04:23:09Z [load_day 2026-08-28] 2026-08-28 hour 8: 56898 events in 2 files, snapshot 8693985134923262478 (task 1919 ms: download 842 ms overlapping gunzip 76 ms, parse 304 ms, sort 35 ms, write 572 ms, index 108 ms: 1 candidates, 14470 repo-hours, 38 releases; waiting 533 ms; commit 866 ms)
2026-11-07T04:23:10Z [load_day 2026-08-28] 2026-08-28 hour 9: 52623 events in 2 files, snapshot 3173134369611975609 (task 1852 ms: download 817 ms overlapping gunzip 77 ms, parse 294 ms, sort 33 ms, write 550 ms, index 111 ms: 1 candidates, 13569 repo-hours, 33 releases; waiting 520 ms; commit 751 ms)
2026-11-07T04:23:11Z [load_day 2026-08-28] 2026-08-28 hour 10: 52607 events in 2 files, snapshot 5165248010060807455 (task 1904 ms: download 817 ms overlapping gunzip 82 ms, parse 312 ms, sort 36 ms, write 519 ms, index 103 ms: 2 candidates, 14134 repo-hours, 46 releases; waiting 517 ms; commit 802 ms)
2026-11-07T04:23:12Z [load_day 2026-08-28] 2026-08-28 hour 11: 55785 events in 2 files, snapshot 7049741336552315234 (task 1951 ms: download 829 ms overlapping gunzip 80 ms, parse 299 ms, sort 39 ms, write 611 ms, index 107 ms: 1 candidates, 14526 repo-hours, 35 releases; waiting 526 ms; commit 789 ms)
2026-11-07T04:23:14Z [load_day 2026-08-28] 2026-08-28 hour 12: 54433 events in 2 files, snapshot 863239991298665068 (task 1919 ms: download 833 ms overlapping gunzip 75 ms, parse 290 ms, sort 34 ms, write 577 ms, index 122 ms: 3 candidates, 14807 repo-hours, 36 releases; waiting 537 ms; commit 719 ms)
2026-11-07T04:23:16Z [load_day 2026-08-28] 2026-08-28 hour 13: 57902 events in 2 files, snapshot 4571046180737111109 (task 1911 ms: download 835 ms overlapping gunzip 80 ms, parse 309 ms, sort 35 ms, write 595 ms, index 108 ms: 1 candidates, 14658 repo-hours, 32 releases; waiting 522 ms; commit 2294 ms)
2026-11-07T04:23:17Z [load_day 2026-08-28] 2026-08-28 hour 14: 54232 events in 2 files, snapshot 5417738927624197633 (task 1834 ms: download 815 ms overlapping gunzip 77 ms, parse 293 ms, sort 32 ms, write 525 ms, index 103 ms: 2 candidates, 14238 repo-hours, 38 releases; waiting 533 ms; commit 844 ms)
2026-11-07T04:23:18Z [load_day 2026-08-28] 2026-08-28 hour 15: 48008 events in 1 files, snapshot 1301873284323342763 (task 1562 ms: download 585 ms overlapping gunzip 70 ms, parse 268 ms, sort 30 ms, write 455 ms, index 118 ms: 2 candidates, 13737 repo-hours, 35 releases; waiting 315 ms; commit 778 ms)
2026-11-07T04:23:19Z [load_day 2026-08-28] 2026-08-28 hour 16: 46968 events in 1 files, snapshot 4750515421373617003 (task 1749 ms: download 801 ms overlapping gunzip 69 ms, parse 265 ms, sort 28 ms, write 445 ms, index 90 ms: 0 candidates, 13514 repo-hours, 27 releases; waiting 530 ms; commit 735 ms)
2026-11-07T04:23:22Z [load_day 2026-08-28] 2026-08-28 hour 17: 48262 events in 1 files, snapshot 2759201235944196236 (task 1745 ms: download 833 ms overlapping gunzip 77 ms, parse 292 ms, sort 33 ms, write 447 ms, index 100 ms: 2 candidates, 13434 repo-hours, 36 releases; waiting 523 ms; commit 2372 ms)
2026-11-07T04:23:23Z [load_day 2026-08-28] 2026-08-28 hour 18: 49878 events in 1 files, snapshot 1728989369727174875 (task 1777 ms: download 805 ms overlapping gunzip 73 ms, parse 272 ms, sort 32 ms, write 453 ms, index 88 ms: 0 candidates, 13365 repo-hours, 40 releases; waiting 543 ms; commit 696 ms)
2026-11-07T04:23:24Z [load_day 2026-08-28] 2026-08-28 hour 19: 48163 events in 1 files, snapshot 70264463113704250 (task 1789 ms: download 810 ms overlapping gunzip 79 ms, parse 298 ms, sort 30 ms, write 458 ms, index 86 ms: 0 candidates, 13067 repo-hours, 43 releases; waiting 522 ms; commit 662 ms)
2026-11-07T04:23:25Z [load_day 2026-08-28] 2026-08-28 hour 20: 46968 events in 1 files, snapshot 3627871204756155017 (task 1759 ms: download 798 ms overlapping gunzip 71 ms, parse 265 ms, sort 29 ms, write 461 ms, index 113 ms: 0 candidates, 12637 repo-hours, 41 releases; waiting 530 ms; commit 596 ms)
2026-11-07T04:23:27Z [load_day 2026-08-28] 2026-08-28 hour 21: 44732 events in 1 files, snapshot 3141867235595467009 (task 1853 ms: download 813 ms overlapping gunzip 83 ms, parse 295 ms, sort 29 ms, write 464 ms, index 146 ms: 1 candidates, 13866 repo-hours, 55 releases; waiting 526 ms; commit 816 ms)
2026-11-07T04:23:28Z [load_day 2026-08-28] 2026-08-28 hour 22: 43528 events in 1 files, snapshot 3441634708397869016 (task 1832 ms: download 823 ms overlapping gunzip 74 ms, parse 265 ms, sort 28 ms, write 495 ms, index 95 ms: 1 candidates, 12642 repo-hours, 51 releases; waiting 549 ms; commit 843 ms)
2026-11-07T04:23:29Z [load_day 2026-08-28] 2026-08-28 hour 23: 40376 events in 1 files, snapshot 7850876254504823544 (task 1820 ms: download 799 ms overlapping gunzip 78 ms, parse 277 ms, sort 25 ms, write 449 ms, index 89 ms: 2 candidates, 11445 repo-hours, 51 releases; waiting 541 ms; commit 711 ms)
2026-11-07T04:23:31Z [load_day 2026-08-28] 2026-08-28: repo_hour merged from 24 files to 1 (328457 rows, 2059 ms)
2026-11-07T04:23:32Z [load_day 2026-08-28] 2026-08-28: index committed in 3507 ms (18 + 1 + 24 files)
2026-11-07T04:23:32Z [load_day 2026-08-28] 2026-08-28: 1277198 events in 24 hours
2026-11-07T04:23:32Z [load_day 2026-08-28] attempt 1 succeeded