orcaLog in

Runs · run 416

load_day 2026-07-02, attempt 1 succeeded

Host
4e84322b8c45:84414
Started
2026-11-07T05:21:40Z
Ended
2026-11-07T05:22:51Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/416/load_day/2026-07-02/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:21:40Z [load_day 2026-07-02] attempt 1 started
2026-11-07T05:21:48Z [load_day 2026-07-02] 2026-07-02 hour 0: 157121 events in 4 files, snapshot 7115092882281034468 (task 4819 ms: download 1874 ms overlapping gunzip 279 ms, parse 986 ms, sort 125 ms, write 2140 ms, index 472 ms: 4 candidates, 70218 repo-hours, 368 releases; waiting 499 ms; commit 1065 ms)
2026-11-07T05:21:49Z [load_day 2026-07-02] 2026-07-02 hour 1: 160562 events in 4 files, snapshot 3067505043998232126 (task 4779 ms: download 1579 ms overlapping gunzip 303 ms, parse 1105 ms, sort 147 ms, write 1917 ms, index 455 ms: 6 candidates, 72159 repo-hours, 275 releases; waiting 532 ms; commit 1375 ms)
2026-11-07T05:21:53Z [load_day 2026-07-02] 2026-07-02 hour 2: 161784 events in 4 files, snapshot 4327386231154974659 (task 4407 ms: download 1261 ms overlapping gunzip 237 ms, parse 859 ms, sort 115 ms, write 1797 ms, index 530 ms: 5 candidates, 86292 repo-hours, 157 releases; waiting 528 ms; commit 1007 ms)
2026-11-07T05:21:54Z [load_day 2026-07-02] 2026-07-02 hour 3: 160390 events in 4 files, snapshot 2147392266908051968 (task 4149 ms: download 1534 ms overlapping gunzip 251 ms, parse 887 ms, sort 104 ms, write 1560 ms, index 540 ms: 3 candidates, 80847 repo-hours, 170 releases; waiting 535 ms; commit 912 ms)
2026-11-07T05:21:58Z [load_day 2026-07-02] 2026-07-02 hour 4: 164444 events in 4 files, snapshot 749080256622368552 (task 4293 ms: download 1219 ms overlapping gunzip 235 ms, parse 863 ms, sort 116 ms, write 1704 ms, index 499 ms: 5 candidates, 74936 repo-hours, 113 releases; waiting 551 ms; commit 854 ms)
2026-11-07T05:21:59Z [load_day 2026-07-02] 2026-07-02 hour 5: 167364 events in 4 files, snapshot 4065026817351195201 (task 4397 ms: download 1530 ms overlapping gunzip 238 ms, parse 843 ms, sort 110 ms, write 1890 ms, index 505 ms: 13 candidates, 72646 repo-hours, 148 releases; waiting 518 ms; commit 983 ms)
2026-11-07T05:22:03Z [load_day 2026-07-02] 2026-07-02 hour 6: 161657 events in 4 files, snapshot 5685006076116455169 (task 4279 ms: download 1219 ms overlapping gunzip 214 ms, parse 803 ms, sort 107 ms, write 1815 ms, index 506 ms: 3 candidates, 72592 repo-hours, 78 releases; waiting 536 ms; commit 955 ms)
2026-11-07T05:22:04Z [load_day 2026-07-02] 2026-07-02 hour 7: 160942 events in 4 files, snapshot 6341146480341928817 (task 4128 ms: download 1648 ms overlapping gunzip 245 ms, parse 878 ms, sort 112 ms, write 1562 ms, index 499 ms: 4 candidates, 75900 repo-hours, 122 releases; waiting 544 ms; commit 1027 ms)
2026-11-07T05:22:08Z [load_day 2026-07-02] 2026-07-02 hour 8: 160053 events in 4 files, snapshot 3864726572935783680 (task 4134 ms: download 1472 ms overlapping gunzip 229 ms, parse 822 ms, sort 119 ms, write 1657 ms, index 507 ms: 5 candidates, 79282 repo-hours, 85 releases; waiting 532 ms; commit 1176 ms)
2026-11-07T05:22:09Z [load_day 2026-07-02] 2026-07-02 hour 9: 159122 events in 4 files, snapshot 6250242260832657851 (task 3970 ms: download 1502 ms overlapping gunzip 215 ms, parse 776 ms, sort 102 ms, write 1441 ms, index 549 ms: 8 candidates, 77064 repo-hours, 89 releases; waiting 541 ms; commit 1060 ms)
2026-11-07T05:22:13Z [load_day 2026-07-02] 2026-07-02 hour 10: 162823 events in 4 files, snapshot 2524966206516916988 (task 4071 ms: download 1380 ms overlapping gunzip 219 ms, parse 790 ms, sort 101 ms, write 1614 ms, index 514 ms: 6 candidates, 79042 repo-hours, 72 releases; waiting 560 ms; commit 916 ms)
2026-11-07T05:22:14Z [load_day 2026-07-02] 2026-07-02 hour 11: 160837 events in 4 files, snapshot 8974531181808128530 (task 3913 ms: download 1261 ms overlapping gunzip 230 ms, parse 776 ms, sort 96 ms, write 1466 ms, index 511 ms: 5 candidates, 76085 repo-hours, 63 releases; waiting 530 ms; commit 1104 ms)
2026-11-07T05:22:17Z [load_day 2026-07-02] 2026-07-02 hour 12: 163188 events in 4 files, snapshot 6188417201196223790 (task 3689 ms: download 868 ms overlapping gunzip 214 ms, parse 776 ms, sort 101 ms, write 1694 ms, index 508 ms: 5 candidates, 79117 repo-hours, 133 releases; waiting 186 ms; commit 1012 ms)
2026-11-07T05:22:19Z [load_day 2026-07-02] 2026-07-02 hour 13: 158525 events in 4 files, snapshot 7795541925357049157 (task 4035 ms: download 1350 ms overlapping gunzip 261 ms, parse 909 ms, sort 103 ms, write 1685 ms, index 525 ms: 4 candidates, 81977 repo-hours, 151 releases; waiting 254 ms; commit 1314 ms)
2026-11-07T05:22:22Z [load_day 2026-07-02] 2026-07-02 hour 14: 157871 events in 4 files, snapshot 5484785428208586955 (task 3984 ms: download 1132 ms overlapping gunzip 231 ms, parse 894 ms, sort 121 ms, write 1625 ms, index 538 ms: 5 candidates, 84763 repo-hours, 181 releases; waiting 293 ms; commit 1083 ms)
2026-11-07T05:22:23Z [load_day 2026-07-02] 2026-07-02 hour 15: 161395 events in 4 files, snapshot 3576166353975717059 (task 3668 ms: download 914 ms overlapping gunzip 213 ms, parse 752 ms, sort 101 ms, write 1541 ms, index 539 ms: 3 candidates, 82029 repo-hours, 113 releases; waiting 218 ms; commit 927 ms)
2026-11-07T05:22:26Z [load_day 2026-07-02] 2026-07-02 hour 16: 160672 events in 4 files, snapshot 6288152747382418692 (task 3879 ms: download 1169 ms overlapping gunzip 220 ms, parse 784 ms, sort 118 ms, write 1485 ms, index 529 ms: 6 candidates, 77106 repo-hours, 67 releases; waiting 527 ms; commit 1039 ms)
2026-11-07T05:22:27Z [load_day 2026-07-02] 2026-07-02 hour 17: 156897 events in 4 files, snapshot 525405927879050167 (task 3407 ms: download 789 ms overlapping gunzip 197 ms, parse 769 ms, sort 114 ms, write 1367 ms, index 462 ms: 4 candidates, 72213 repo-hours, 52 releases; waiting 178 ms; commit 948 ms)
2026-11-07T05:22:31Z [load_day 2026-07-02] 2026-07-02 hour 18: 164089 events in 4 files, snapshot 2110614967671908727 (task 4108 ms: download 1328 ms overlapping gunzip 207 ms, parse 771 ms, sort 114 ms, write 1686 ms, index 517 ms: 4 candidates, 74186 repo-hours, 26 releases; waiting 522 ms; commit 1058 ms)
2026-11-07T05:22:32Z [load_day 2026-07-02] 2026-07-02 hour 19: 164186 events in 4 files, snapshot 6949587853472088170 (task 3933 ms: download 1177 ms overlapping gunzip 204 ms, parse 740 ms, sort 102 ms, write 1634 ms, index 517 ms: 7 candidates, 77844 repo-hours, 32 releases; waiting 520 ms; commit 1030 ms)
2026-11-07T05:22:36Z [load_day 2026-07-02] 2026-07-02 hour 20: 162435 events in 4 files, snapshot 1175729485725201982 (task 3782 ms: download 1411 ms overlapping gunzip 201 ms, parse 729 ms, sort 103 ms, write 1556 ms, index 534 ms: 7 candidates, 73246 repo-hours, 40 releases; waiting 70 ms; commit 1122 ms)
2026-11-07T05:22:37Z [load_day 2026-07-02] 2026-07-02 hour 21: 167827 events in 4 files, snapshot 9211692421243446025 (task 3803 ms: download 1420 ms overlapping gunzip 217 ms, parse 796 ms, sort 104 ms, write 1438 ms, index 463 ms: 6 candidates, 70464 repo-hours, 55 releases; waiting 563 ms; commit 956 ms)
2026-11-07T05:22:41Z [load_day 2026-07-02] 2026-07-02 hour 22: 160890 events in 4 files, snapshot 6094249148492693861 (task 4236 ms: download 1951 ms overlapping gunzip 237 ms, parse 858 ms, sort 125 ms, write 1705 ms, index 459 ms: 2 candidates, 67983 repo-hours, 126 releases; waiting 525 ms; commit 1057 ms)
2026-11-07T05:22:42Z [load_day 2026-07-02] 2026-07-02 hour 23: 162198 events in 4 files, snapshot 8048961438601036802 (task 3959 ms: download 1470 ms overlapping gunzip 229 ms, parse 864 ms, sort 102 ms, write 1447 ms, index 466 ms: 3 candidates, 67741 repo-hours, 97 releases; waiting 525 ms; commit 991 ms)
2026-11-07T05:22:49Z [load_day 2026-07-02] 2026-07-02: repo_hour merged from 24 files to 1 (1825732 rows, 7316 ms)
2026-11-07T05:22:51Z [load_day 2026-07-02] 2026-07-02: index committed in 9161 ms (24 + 1 + 24 files)
2026-11-07T05:22:51Z [load_day 2026-07-02] 2026-07-02: 3877272 events in 24 hours
2026-11-07T05:22:51Z [load_day 2026-07-02] attempt 1 succeeded