orcaLog in

Runs · run 1375

load_day 2023-08-09, attempt 1 succeeded

Host
3c2b29713ce8:210352
Started
2026-11-07T23:44:24Z
Ended
2026-11-07T23:48:20Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1375/load_day/2023-08-09/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:44:24Z [load_day 2023-08-09] attempt 1 started
2026-11-07T23:44:25Z [load_day 2023-08-09] 2023-08-09: 2 hours in flight, about 1200 MB
2026-11-07T23:44:45Z [load_day 2023-08-09] 2023-08-09 hour 0: 156803 events in 4 files, snapshot 2836881465934898201 (task 15342 ms: download 6672 ms overlapping gunzip 889 ms, parse 4013 ms, sort 168 ms, write 8928 ms, index 537 ms: 3 candidates, 80101 repo-hours, 847 releases; waiting 498 ms; commit 2308 ms)
2026-11-07T23:44:47Z [load_day 2023-08-09] 2023-08-09 hour 1: 161098 events in 4 files, snapshot 6052923013229585190 (task 15050 ms: download 6066 ms overlapping gunzip 824 ms, parse 3920 ms, sort 121 ms, write 8664 ms, index 753 ms: 5 candidates, 90308 repo-hours, 799 releases; waiting 483 ms; commit 2624 ms)
2026-11-07T23:45:00Z [load_day 2023-08-09] 2023-08-09 hour 2: 141597 events in 3 files, snapshot 122921391960588847 (task 12932 ms: download 5711 ms overlapping gunzip 820 ms, parse 3650 ms, sort 95 ms, write 6984 ms, index 531 ms: 4 candidates, 63577 repo-hours, 791 releases; waiting 452 ms; commit 3226 ms)
2026-11-07T23:45:05Z [load_day 2023-08-09] 2023-08-09 hour 3: 135962 events in 3 files, snapshot 5715991552688743988 (task 16149 ms: download 11161 ms overlapping gunzip 750 ms, parse 3315 ms, sort 112 ms, write 7323 ms, index 632 ms: 3 candidates, 59026 repo-hours, 874 releases; waiting 3670 ms; commit 2531 ms)
2026-11-07T23:45:13Z [load_day 2023-08-09] 2023-08-09 hour 4: 131780 events in 3 files, snapshot 1726597699255826763 (task 12988 ms: download 6229 ms overlapping gunzip 842 ms, parse 3587 ms, sort 176 ms, write 7166 ms, index 402 ms: 4 candidates, 54303 repo-hours, 625 releases; waiting 480 ms; commit 2317 ms)
2026-11-07T23:45:19Z [load_day 2023-08-09] 2023-08-09 hour 5: 142071 events in 3 files, snapshot 8763182759241286077 (task 13038 ms: download 6578 ms overlapping gunzip 726 ms, parse 3119 ms, sort 125 ms, write 6679 ms, index 404 ms: 3 candidates, 60735 repo-hours, 756 releases; waiting 1629 ms; commit 2201 ms)
2026-11-07T23:45:27Z [load_day 2023-08-09] 2023-08-09 hour 6: 170906 events in 4 files, snapshot 880175681290125546 (task 13375 ms: download 7488 ms overlapping gunzip 776 ms, parse 3418 ms, sort 100 ms, write 7751 ms, index 507 ms: 4 candidates, 75779 repo-hours, 884 releases; waiting 507 ms; commit 1928 ms)
2026-11-07T23:45:34Z [load_day 2023-08-09] 2023-08-09 hour 7: 153575 events in 4 files, snapshot 3843768489463415947 (task 13707 ms: download 5890 ms overlapping gunzip 862 ms, parse 3668 ms, sort 106 ms, write 7808 ms, index 470 ms: 5 candidates, 69757 repo-hours, 818 releases; waiting 515 ms; commit 3120 ms)
2026-11-07T23:45:47Z [load_day 2023-08-09] 2023-08-09 hour 8: 170947 events in 4 files, snapshot 7999058510680578174 (task 19062 ms: download 11567 ms overlapping gunzip 1069 ms, parse 4484 ms, sort 112 ms, write 11612 ms, index 539 ms: 9 candidates, 76528 repo-hours, 996 releases; waiting 920 ms; commit 2293 ms)
2026-11-07T23:45:55Z [load_day 2023-08-09] 2023-08-09 hour 9: 182576 events in 4 files, snapshot 2832583112606103970 (task 19975 ms: download 11712 ms overlapping gunzip 1288 ms, parse 5938 ms, sort 121 ms, write 11025 ms, index 773 ms: 7 candidates, 80010 repo-hours, 1255 releases; waiting 472 ms; commit 2809 ms)
2026-11-07T23:46:09Z [load_day 2023-08-09] 2023-08-09 hour 10: 179344 events in 4 files, snapshot 969217030850379527 (task 20870 ms: download 12004 ms overlapping gunzip 1128 ms, parse 4886 ms, sort 127 ms, write 12604 ms, index 943 ms: 5 candidates, 79111 repo-hours, 1081 releases; waiting 848 ms; commit 2423 ms)
2026-11-07T23:46:16Z [load_day 2023-08-09] 2023-08-09 hour 11: 182569 events in 4 files, snapshot 7265523129116370174 (task 19726 ms: download 11397 ms overlapping gunzip 1261 ms, parse 5514 ms, sort 229 ms, write 11667 ms, index 566 ms: 4 candidates, 76635 repo-hours, 1028 releases; waiting 188 ms; commit 2460 ms)
2026-11-07T23:46:31Z [load_day 2023-08-09] 2023-08-09 hour 12: 219805 events in 5 files, snapshot 2189666193093729389 (task 21007 ms: download 11426 ms overlapping gunzip 1084 ms, parse 5075 ms, sort 134 ms, write 12920 ms, index 836 ms: 6 candidates, 107269 repo-hours, 1047 releases; waiting 713 ms; commit 2417 ms)
2026-11-07T23:46:39Z [load_day 2023-08-09] 2023-08-09 hour 13: 198172 events in 4 files, snapshot 44195535144905098 (task 21708 ms: download 11666 ms overlapping gunzip 1316 ms, parse 5906 ms, sort 235 ms, write 12443 ms, index 939 ms: 7 candidates, 98430 repo-hours, 1005 releases; waiting 493 ms; commit 2724 ms)
2026-11-07T23:46:54Z [load_day 2023-08-09] 2023-08-09 hour 14: 185168 events in 4 files, snapshot 1130263928104016756 (task 20972 ms: download 12168 ms overlapping gunzip 1213 ms, parse 5615 ms, sort 130 ms, write 12459 ms, index 804 ms: 4 candidates, 86124 repo-hours, 1036 releases; waiting 442 ms; commit 2450 ms)
2026-11-07T23:46:59Z [load_day 2023-08-09] 2023-08-09 hour 15: 159764 events in 4 files, snapshot 3621586240592684879 (task 18538 ms: download 11429 ms overlapping gunzip 1083 ms, parse 4504 ms, sort 155 ms, write 11310 ms, index 685 ms: 4 candidates, 77909 repo-hours, 958 releases; waiting 509 ms; commit 3346 ms)
2026-11-07T23:47:12Z [load_day 2023-08-09] 2023-08-09 hour 16: 144686 events in 3 files, snapshot 8200896365591797431 (task 17215 ms: download 7286 ms overlapping gunzip 907 ms, parse 3672 ms, sort 86 ms, write 10891 ms, index 718 ms: 5 candidates, 71279 repo-hours, 737 releases; waiting 602 ms; commit 2536 ms)
2026-11-07T23:47:19Z [load_day 2023-08-09] 2023-08-09 hour 17: 166597 events in 4 files, snapshot 22589608598439621 (task 18689 ms: download 11036 ms overlapping gunzip 1084 ms, parse 4798 ms, sort 122 ms, write 11372 ms, index 532 ms: 5 candidates, 73953 repo-hours, 912 releases; waiting 477 ms; commit 3693 ms)
2026-11-07T23:47:32Z [load_day 2023-08-09] 2023-08-09 hour 18: 172257 events in 4 files, snapshot 8332388896691219387 (task 18473 ms: download 10614 ms overlapping gunzip 1042 ms, parse 4719 ms, sort 112 ms, write 11023 ms, index 723 ms: 4 candidates, 79263 repo-hours, 988 releases; waiting 542 ms; commit 2250 ms)
2026-11-07T23:47:37Z [load_day 2023-08-09] 2023-08-09 hour 19: 165526 events in 4 files, snapshot 5530179025108528426 (task 17460 ms: download 10472 ms overlapping gunzip 1073 ms, parse 4940 ms, sort 118 ms, write 9841 ms, index 693 ms: 5 candidates, 69932 repo-hours, 980 releases; waiting 483 ms; commit 2865 ms)
2026-11-07T23:47:52Z [load_day 2023-08-09] 2023-08-09 hour 20: 167714 events in 4 files, snapshot 106073013746024444 (task 17882 ms: download 10725 ms overlapping gunzip 985 ms, parse 4527 ms, sort 129 ms, write 10639 ms, index 724 ms: 5 candidates, 70319 repo-hours, 974 releases; waiting 580 ms; commit 3035 ms)
2026-11-07T23:47:55Z [load_day 2023-08-09] 2023-08-09 hour 21: 152650 events in 4 files, snapshot 2636288472433101125 (task 17198 ms: download 7522 ms overlapping gunzip 984 ms, parse 4220 ms, sort 193 ms, write 10497 ms, index 571 ms: 5 candidates, 62334 repo-hours, 1168 releases; waiting 507 ms; commit 2242 ms)
2026-11-07T23:48:07Z [load_day 2023-08-09] 2023-08-09 hour 22: 138524 events in 3 files, snapshot 6759955880603572691 (task 14561 ms: download 5903 ms overlapping gunzip 1022 ms, parse 4158 ms, sort 126 ms, write 8298 ms, index 397 ms: 4 candidates, 55792 repo-hours, 839 releases; waiting 211 ms; commit 2419 ms)
2026-11-07T23:48:10Z [load_day 2023-08-09] 2023-08-09 hour 23: 130345 events in 3 files, snapshot 1659760868762006548 (task 13379 ms: download 6175 ms overlapping gunzip 824 ms, parse 3399 ms, sort 116 ms, write 7837 ms, index 412 ms: 4 candidates, 52992 repo-hours, 689 releases; waiting 479 ms; commit 3075 ms)
2026-11-07T23:48:18Z [load_day 2023-08-09] 2023-08-09: repo_hour merged from 24 files to 1 (1771466 rows, 7819 ms)
2026-11-07T23:48:20Z [load_day 2023-08-09] 2023-08-09: index committed in 9792 ms (24 + 1 + 24 files)
2026-11-07T23:48:20Z [load_day 2023-08-09] 2023-08-09: 3910436 events in 24 hours
2026-11-07T23:48:20Z [load_day 2023-08-09] attempt 1 succeeded