orcaLog in

Runs · run 1354

load_day 2023-08-02, attempt 1 succeeded

Host
3c2b29713ce8:186182
Started
2026-11-07T23:31:12Z
Ended
2026-11-07T23:35:20Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1354/load_day/2023-08-02/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:31:12Z [load_day 2023-08-02] attempt 1 started
2026-11-07T23:31:14Z [load_day 2023-08-02] 2023-08-02: 2 hours in flight, about 1200 MB
2026-11-07T23:31:36Z [load_day 2023-08-02] 2023-08-02 hour 0: 158493 events in 4 files, snapshot 5503517773340072731 (task 18806 ms: download 12944 ms overlapping gunzip 1416 ms, parse 5616 ms, sort 170 ms, write 9919 ms, index 560 ms: 6 candidates, 80269 repo-hours, 984 releases; waiting 798 ms; commit 2103 ms)
2026-11-07T23:31:39Z [load_day 2023-08-02] 2023-08-02 hour 1: 162783 events in 4 files, snapshot 5665886123530326782 (task 17870 ms: download 7671 ms overlapping gunzip 1260 ms, parse 5093 ms, sort 177 ms, write 9600 ms, index 706 ms: 7 candidates, 88904 repo-hours, 829 releases; waiting 510 ms; commit 2765 ms)
2026-11-07T23:31:57Z [load_day 2023-08-02] 2023-08-02 hour 2: 146794 events in 3 files, snapshot 1382786585594047570 (task 17190 ms: download 12297 ms overlapping gunzip 1268 ms, parse 4662 ms, sort 172 ms, write 8908 ms, index 460 ms: 2 candidates, 62203 repo-hours, 652 releases; waiting 1393 ms; commit 4197 ms)
2026-11-07T23:31:59Z [load_day 2023-08-02] 2023-08-02 hour 3: 136185 events in 3 files, snapshot 727563422417542366 (task 13727 ms: download 5755 ms overlapping gunzip 940 ms, parse 3809 ms, sort 124 ms, write 7626 ms, index 490 ms: 5 candidates, 57889 repo-hours, 823 releases; waiting 422 ms; commit 2342 ms)
2026-11-07T23:32:10Z [load_day 2023-08-02] 2023-08-02 hour 4: 131434 events in 3 files, snapshot 7634103748347494296 (task 13841 ms: download 7135 ms overlapping gunzip 999 ms, parse 3790 ms, sort 163 ms, write 7667 ms, index 410 ms: 2 candidates, 53735 repo-hours, 546 releases; waiting 492 ms; commit 2178 ms)
2026-11-07T23:32:14Z [load_day 2023-08-02] 2023-08-02 hour 5: 133628 events in 3 files, snapshot 4720617330594494456 (task 13407 ms: download 6109 ms overlapping gunzip 751 ms, parse 3026 ms, sort 90 ms, write 8086 ms, index 601 ms: 0 candidates, 58440 repo-hours, 705 releases; waiting 552 ms; commit 2516 ms)
2026-11-07T23:32:29Z [load_day 2023-08-02] 2023-08-02 hour 6: 168110 events in 4 files, snapshot 2763359903631572987 (task 18664 ms: download 11682 ms overlapping gunzip 1240 ms, parse 4683 ms, sort 139 ms, write 11185 ms, index 613 ms: 3 candidates, 74078 repo-hours, 882 releases; waiting 507 ms; commit 2440 ms)
2026-11-07T23:32:35Z [load_day 2023-08-02] 2023-08-02 hour 7: 167009 events in 4 files, snapshot 8859750858643820670 (task 18963 ms: download 12217 ms overlapping gunzip 1226 ms, parse 5183 ms, sort 130 ms, write 10980 ms, index 608 ms: 4 candidates, 73719 repo-hours, 879 releases; waiting 555 ms; commit 3696 ms)
2026-11-07T23:32:50Z [load_day 2023-08-02] 2023-08-02 hour 8: 165061 events in 4 files, snapshot 6767034441150943377 (task 19741 ms: download 11607 ms overlapping gunzip 1462 ms, parse 6011 ms, sort 132 ms, write 10590 ms, index 677 ms: 5 candidates, 75242 repo-hours, 853 releases; waiting 522 ms; commit 1929 ms)
2026-11-07T23:32:58Z [load_day 2023-08-02] 2023-08-02 hour 9: 172763 events in 4 files, snapshot 8942166121420946300 (task 20882 ms: download 13352 ms overlapping gunzip 1480 ms, parse 5875 ms, sort 167 ms, write 11749 ms, index 699 ms: 2 candidates, 77774 repo-hours, 1024 releases; waiting 619 ms; commit 4691 ms)
2026-11-07T23:33:10Z [load_day 2023-08-02] 2023-08-02 hour 10: 174978 events in 4 files, snapshot 4579345321495157544 (task 18859 ms: download 11364 ms overlapping gunzip 1113 ms, parse 4616 ms, sort 178 ms, write 11751 ms, index 553 ms: 5 candidates, 79805 repo-hours, 959 releases; waiting 346 ms; commit 2643 ms)
2026-11-07T23:33:16Z [load_day 2023-08-02] 2023-08-02 hour 11: 170272 events in 4 files, snapshot 8162823374496603108 (task 19500 ms: download 12591 ms overlapping gunzip 1521 ms, parse 5898 ms, sort 187 ms, write 10531 ms, index 537 ms: 4 candidates, 76333 repo-hours, 959 releases; waiting 473 ms; commit 2171 ms)
2026-11-07T23:33:30Z [load_day 2023-08-02] 2023-08-02 hour 12: 212404 events in 5 files, snapshot 3816250709127321257 (task 19396 ms: download 10350 ms overlapping gunzip 990 ms, parse 4398 ms, sort 163 ms, write 12121 ms, index 701 ms: 8 candidates, 103656 repo-hours, 1122 releases; waiting 685 ms; commit 2174 ms)
2026-11-07T23:33:38Z [load_day 2023-08-02] 2023-08-02 hour 13: 186069 events in 4 files, snapshot 4939692537486136498 (task 19721 ms: download 10939 ms overlapping gunzip 1071 ms, parse 5090 ms, sort 124 ms, write 12013 ms, index 624 ms: 7 candidates, 95106 repo-hours, 1125 releases; waiting 500 ms; commit 3535 ms)
2026-11-07T23:33:49Z [load_day 2023-08-02] 2023-08-02 hour 14: 186808 events in 4 files, snapshot 8645037115503576946 (task 18301 ms: download 10511 ms overlapping gunzip 1089 ms, parse 4691 ms, sort 138 ms, write 10911 ms, index 618 ms: 10 candidates, 86753 repo-hours, 1005 releases; waiting 510 ms; commit 1805 ms)
2026-11-07T23:33:55Z [load_day 2023-08-02] 2023-08-02 hour 15: 176156 events in 4 files, snapshot 2600441758618863076 (task 16371 ms: download 9450 ms overlapping gunzip 945 ms, parse 4109 ms, sort 117 ms, write 10216 ms, index 549 ms: 6 candidates, 81538 repo-hours, 1092 releases; waiting 198 ms; commit 2583 ms)
2026-11-07T23:34:10Z [load_day 2023-08-02] 2023-08-02 hour 16: 167995 events in 4 files, snapshot 330153606970131013 (task 19102 ms: download 11585 ms overlapping gunzip 1283 ms, parse 5532 ms, sort 112 ms, write 10718 ms, index 659 ms: 3 candidates, 77380 repo-hours, 929 releases; waiting 527 ms; commit 2778 ms)
2026-11-07T23:34:17Z [load_day 2023-08-02] 2023-08-02 hour 17: 174947 events in 4 files, snapshot 4058280792722546731 (task 19490 ms: download 13397 ms overlapping gunzip 1442 ms, parse 5720 ms, sort 161 ms, write 10823 ms, index 552 ms: 2 candidates, 75305 repo-hours, 845 releases; waiting 500 ms; commit 4596 ms)
2026-11-07T23:34:29Z [load_day 2023-08-02] 2023-08-02 hour 18: 178131 events in 4 files, snapshot 8102945043071933525 (task 18626 ms: download 10954 ms overlapping gunzip 1180 ms, parse 4770 ms, sort 217 ms, write 11257 ms, index 530 ms: 5 candidates, 79506 repo-hours, 1006 releases; waiting 395 ms; commit 2237 ms)
2026-11-07T23:34:36Z [load_day 2023-08-02] 2023-08-02 hour 19: 163159 events in 4 files, snapshot 7437240131559388654 (task 19092 ms: download 12085 ms overlapping gunzip 1389 ms, parse 5419 ms, sort 120 ms, write 10627 ms, index 699 ms: 5 candidates, 68461 repo-hours, 952 releases; waiting 512 ms; commit 3275 ms)
2026-11-07T23:34:51Z [load_day 2023-08-02] 2023-08-02 hour 20: 166418 events in 4 files, snapshot 1378810625308167600 (task 18587 ms: download 11896 ms overlapping gunzip 1235 ms, parse 4918 ms, sort 210 ms, write 10838 ms, index 609 ms: 4 candidates, 68910 repo-hours, 975 releases; waiting 500 ms; commit 3661 ms)
2026-11-07T23:34:55Z [load_day 2023-08-02] 2023-08-02 hour 21: 161200 events in 4 files, snapshot 2404791702663343034 (task 18584 ms: download 11810 ms overlapping gunzip 1179 ms, parse 4629 ms, sort 157 ms, write 11407 ms, index 431 ms: 3 candidates, 62258 repo-hours, 963 releases; waiting 475 ms; commit 2449 ms)
2026-11-07T23:35:06Z [load_day 2023-08-02] 2023-08-02 hour 22: 137435 events in 3 files, snapshot 8351288660075673132 (task 16073 ms: download 7708 ms overlapping gunzip 1032 ms, parse 4492 ms, sort 147 ms, write 9121 ms, index 471 ms: 2 candidates, 55155 repo-hours, 818 releases; waiting 503 ms; commit 2294 ms)
2026-11-07T23:35:10Z [load_day 2023-08-02] 2023-08-02 hour 23: 128689 events in 3 files, snapshot 5546314311705570047 (task 14086 ms: download 6829 ms overlapping gunzip 878 ms, parse 3613 ms, sort 117 ms, write 8320 ms, index 371 ms: 5 candidates, 51948 repo-hours, 718 releases; waiting 496 ms; commit 2839 ms)
2026-11-07T23:35:18Z [load_day 2023-08-02] 2023-08-02: repo_hour merged from 24 files to 1 (1764367 rows, 7853 ms)
2026-11-07T23:35:20Z [load_day 2023-08-02] 2023-08-02: index committed in 10049 ms (23 + 1 + 24 files)
2026-11-07T23:35:20Z [load_day 2023-08-02] 2023-08-02: 3926921 events in 24 hours
2026-11-07T23:35:20Z [load_day 2023-08-02] attempt 1 succeeded