orcaLog in

Runs · run 1348

load_day 2023-07-31, attempt 1 succeeded

Host
3c2b29713ce8:178338
Started
2026-11-07T23:26:52Z
Ended
2026-11-07T23:31:11Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1348/load_day/2023-07-31/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:26:52Z [load_day 2023-07-31] attempt 1 started
2026-11-07T23:26:54Z [load_day 2023-07-31] 2023-07-31: 2 hours in flight, about 1200 MB
2026-11-07T23:27:11Z [load_day 2023-07-31] 2023-07-31 hour 0: 129767 events in 3 files, snapshot 7349734934194062475 (task 13056 ms: download 6142 ms overlapping gunzip 704 ms, parse 3031 ms, sort 156 ms, write 7500 ms, index 779 ms: 9 candidates, 66599 repo-hours, 770 releases; waiting 630 ms; commit 2101 ms)
2026-11-07T23:27:15Z [load_day 2023-07-31] 2023-07-31 hour 1: 148084 events in 3 files, snapshot 8188477076788926560 (task 15443 ms: download 6886 ms overlapping gunzip 1034 ms, parse 4437 ms, sort 186 ms, write 8350 ms, index 571 ms: 5 candidates, 80954 repo-hours, 788 releases; waiting 510 ms; commit 4098 ms)
2026-11-07T23:27:26Z [load_day 2023-07-31] 2023-07-31 hour 2: 126994 events in 3 files, snapshot 8725708757626302209 (task 13654 ms: download 6480 ms overlapping gunzip 748 ms, parse 3043 ms, sort 150 ms, write 8045 ms, index 827 ms: 4 candidates, 56305 repo-hours, 663 releases; waiting 492 ms; commit 2366 ms)
2026-11-07T23:27:28Z [load_day 2023-07-31] 2023-07-31 hour 3: 126959 events in 3 files, snapshot 5890162745935957680 (task 12743 ms: download 5744 ms overlapping gunzip 915 ms, parse 3852 ms, sort 130 ms, write 6850 ms, index 462 ms: 3 candidates, 52706 repo-hours, 796 releases; waiting 217 ms; commit 2245 ms)
2026-11-07T23:27:40Z [load_day 2023-07-31] 2023-07-31 hour 4: 128435 events in 3 files, snapshot 4110445044147063384 (task 12915 ms: download 5876 ms overlapping gunzip 865 ms, parse 3463 ms, sort 92 ms, write 7323 ms, index 344 ms: 6 candidates, 50253 repo-hours, 606 releases; waiting 520 ms; commit 2635 ms)
2026-11-07T23:27:44Z [load_day 2023-07-31] 2023-07-31 hour 5: 135318 events in 3 files, snapshot 8194565902002039392 (task 15070 ms: download 6135 ms overlapping gunzip 851 ms, parse 3460 ms, sort 124 ms, write 9147 ms, index 678 ms: 3 candidates, 55737 repo-hours, 715 releases; waiting 490 ms; commit 2295 ms)
2026-11-07T23:27:59Z [load_day 2023-07-31] 2023-07-31 hour 6: 157473 events in 4 files, snapshot 6756244677903507151 (task 18102 ms: download 11603 ms overlapping gunzip 1439 ms, parse 5864 ms, sort 163 ms, write 9423 ms, index 543 ms: 6 candidates, 71656 repo-hours, 881 releases; waiting 365 ms; commit 2264 ms)
2026-11-07T23:28:05Z [load_day 2023-07-31] 2023-07-31 hour 7: 174650 events in 4 files, snapshot 2452614768352216745 (task 19628 ms: download 12018 ms overlapping gunzip 1311 ms, parse 5122 ms, sort 119 ms, write 12030 ms, index 504 ms: 4 candidates, 76124 repo-hours, 893 releases; waiting 247 ms; commit 2428 ms)
2026-11-07T23:28:22Z [load_day 2023-07-31] 2023-07-31 hour 8: 180190 events in 4 files, snapshot 4442133568357174301 (task 21508 ms: download 12986 ms overlapping gunzip 1247 ms, parse 5213 ms, sort 189 ms, write 13583 ms, index 640 ms: 4 candidates, 78964 repo-hours, 972 releases; waiting 362 ms; commit 3347 ms)
2026-11-07T23:28:29Z [load_day 2023-07-31] 2023-07-31 hour 9: 186339 events in 4 files, snapshot 8497701453739666230 (task 22355 ms: download 16982 ms overlapping gunzip 1804 ms, parse 6773 ms, sort 215 ms, write 12016 ms, index 722 ms: 5 candidates, 80008 repo-hours, 1195 releases; waiting 515 ms; commit 2529 ms)
2026-11-07T23:28:42Z [load_day 2023-07-31] 2023-07-31 hour 10: 180789 events in 4 files, snapshot 8575900869089760542 (task 20396 ms: download 12038 ms overlapping gunzip 1362 ms, parse 5520 ms, sort 153 ms, write 11929 ms, index 617 ms: 10 candidates, 76979 repo-hours, 1065 releases; waiting 526 ms; commit 2035 ms)
2026-11-07T23:28:50Z [load_day 2023-07-31] 2023-07-31 hour 11: 181165 events in 4 files, snapshot 4027599268206346770 (task 20524 ms: download 12774 ms overlapping gunzip 1287 ms, parse 5202 ms, sort 139 ms, write 11956 ms, index 586 ms: 1 candidates, 75342 repo-hours, 959 releases; waiting 898 ms; commit 2505 ms)
2026-11-07T23:29:08Z [load_day 2023-07-31] 2023-07-31 hour 12: 224722 events in 5 files, snapshot 5382300343467484394 (task 23386 ms: download 14701 ms overlapping gunzip 1254 ms, parse 5094 ms, sort 177 ms, write 14757 ms, index 848 ms: 3 candidates, 108564 repo-hours, 1054 releases; waiting 801 ms; commit 3286 ms)
2026-11-07T23:29:13Z [load_day 2023-07-31] 2023-07-31 hour 13: 204650 events in 5 files, snapshot 7034272305004360336 (task 21696 ms: download 15877 ms overlapping gunzip 1386 ms, parse 5728 ms, sort 126 ms, write 13015 ms, index 650 ms: 7 candidates, 100566 repo-hours, 1147 releases; waiting 477 ms; commit 2279 ms)
2026-11-07T23:29:33Z [load_day 2023-07-31] 2023-07-31 hour 14: 189825 events in 4 files, snapshot 7897602844957457082 (task 25397 ms: download 15953 ms overlapping gunzip 1248 ms, parse 5028 ms, sort 132 ms, write 17204 ms, index 659 ms: 6 candidates, 87001 repo-hours, 1046 releases; waiting 773 ms; commit 2066 ms)
2026-11-07T23:29:35Z [load_day 2023-07-31] 2023-07-31 hour 15: 172499 events in 4 files, snapshot 4419372576923979423 (task 17823 ms: download 9809 ms overlapping gunzip 1119 ms, parse 4584 ms, sort 114 ms, write 9952 ms, index 1257 ms: 11 candidates, 80318 repo-hours, 1751 releases; waiting 485 ms; commit 2316 ms)
2026-11-07T23:29:54Z [load_day 2023-07-31] 2023-07-31 hour 16: 172381 events in 4 files, snapshot 5847620564226983969 (task 20426 ms: download 12376 ms overlapping gunzip 1245 ms, parse 4823 ms, sort 123 ms, write 12631 ms, index 638 ms: 4 candidates, 78205 repo-hours, 984 releases; waiting 653 ms; commit 2461 ms)
2026-11-07T23:29:57Z [load_day 2023-07-31] 2023-07-31 hour 17: 173682 events in 4 files, snapshot 2122647626509103167 (task 19482 ms: download 11179 ms overlapping gunzip 1247 ms, parse 5239 ms, sort 173 ms, write 11414 ms, index 564 ms: 5 candidates, 75554 repo-hours, 953 releases; waiting 498 ms; commit 2346 ms)
2026-11-07T23:30:18Z [load_day 2023-07-31] 2023-07-31 hour 18: 179193 events in 4 files, snapshot 480135344537924892 (task 21469 ms: download 13593 ms overlapping gunzip 1403 ms, parse 5520 ms, sort 175 ms, write 12946 ms, index 619 ms: 4 candidates, 80217 repo-hours, 1086 releases; waiting 515 ms; commit 3784 ms)
2026-11-07T23:30:23Z [load_day 2023-07-31] 2023-07-31 hour 19: 173723 events in 4 files, snapshot 7800339800438700200 (task 19946 ms: download 12480 ms overlapping gunzip 1424 ms, parse 5539 ms, sort 124 ms, write 11397 ms, index 684 ms: 9 candidates, 71536 repo-hours, 1164 releases; waiting 501 ms; commit 5040 ms)
2026-11-07T23:30:40Z [load_day 2023-07-31] 2023-07-31 hour 20: 173740 events in 4 files, snapshot 3804065846902653282 (task 21220 ms: download 13908 ms overlapping gunzip 1516 ms, parse 6125 ms, sort 184 ms, write 12089 ms, index 521 ms: 2 candidates, 71073 repo-hours, 1019 releases; waiting 479 ms; commit 3195 ms)
2026-11-07T23:30:42Z [load_day 2023-07-31] 2023-07-31 hour 21: 160033 events in 4 files, snapshot 7213993342182963775 (task 19636 ms: download 13149 ms overlapping gunzip 1226 ms, parse 5162 ms, sort 184 ms, write 11729 ms, index 564 ms: 2 candidates, 63188 repo-hours, 922 releases; waiting 537 ms; commit 2465 ms)
2026-11-07T23:30:59Z [load_day 2023-07-31] 2023-07-31 hour 22: 143107 events in 3 files, snapshot 2596536305329993616 (task 18595 ms: download 12763 ms overlapping gunzip 1426 ms, parse 5601 ms, sort 121 ms, write 10187 ms, index 487 ms: 7 candidates, 56152 repo-hours, 847 releases; waiting 472 ms; commit 2253 ms)
2026-11-07T23:31:01Z [load_day 2023-07-31] 2023-07-31 hour 23: 135659 events in 3 files, snapshot 4034197576759417823 (task 17571 ms: download 9224 ms overlapping gunzip 1165 ms, parse 4495 ms, sort 140 ms, write 10371 ms, index 405 ms: 3 candidates, 53150 repo-hours, 748 releases; waiting 618 ms; commit 2091 ms)
2026-11-07T23:31:09Z [load_day 2023-07-31] 2023-07-31: repo_hour merged from 24 files to 1 (1747151 rows, 8265 ms)
2026-11-07T23:31:11Z [load_day 2023-07-31] 2023-07-31: index committed in 10413 ms (24 + 1 + 24 files)
2026-11-07T23:31:11Z [load_day 2023-07-31] 2023-07-31: 3959377 events in 24 hours
2026-11-07T23:31:11Z [load_day 2023-07-31] attempt 1 succeeded