orcaLog in

Runs · run 35

load_day 2023-01-12, attempt 1 succeeded

Host
4e84322b8c45:12121
Started
2026-11-07T03:20:10Z
Ended
2026-11-07T03:22:50Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/35/load_day/2023-01-12/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:20:10Z [load_day 2023-01-12] attempt 1 started
2026-11-07T03:20:23Z [load_day 2023-01-12] 2023-01-12 hour 0: 146090 events in 3 files, snapshot 414281381018700342 (task 10583 ms: download 3492 ms overlapping gunzip 697 ms, parse 3206 ms, sort 314 ms, write 5046 ms, index 443 ms: 4 candidates, 71020 repo-hours, 864 releases; waiting 481 ms; commit 770 ms)
2026-11-07T03:20:25Z [load_day 2023-01-12] 2023-01-12 hour 1: 161590 events in 4 files, snapshot 5760872419963730115 (task 13169 ms: download 4526 ms overlapping gunzip 955 ms, parse 4252 ms, sort 474 ms, write 6142 ms, index 470 ms: 2 candidates, 81947 repo-hours, 822 releases; waiting 476 ms; commit 606 ms)
2026-11-07T03:20:33Z [load_day 2023-01-12] 2023-01-12 hour 2: 130948 events in 3 files, snapshot 3358200870417076258 (task 9249 ms: download 3899 ms overlapping gunzip 701 ms, parse 3155 ms, sort 237 ms, write 3987 ms, index 350 ms: 4 candidates, 61735 repo-hours, 617 releases; waiting 528 ms; commit 692 ms)
2026-11-07T03:20:35Z [load_day 2023-01-12] 2023-01-12 hour 3: 137398 events in 3 files, snapshot 4354177691022603921 (task 9007 ms: download 3784 ms overlapping gunzip 655 ms, parse 2902 ms, sort 161 ms, write 3923 ms, index 338 ms: 4 candidates, 53630 repo-hours, 774 releases; waiting 731 ms; commit 513 ms)
2026-11-07T03:20:42Z [load_day 2023-01-12] 2023-01-12 hour 4: 136135 events in 3 files, snapshot 6291113243001701258 (task 9208 ms: download 2723 ms overlapping gunzip 666 ms, parse 2978 ms, sort 293 ms, write 4033 ms, index 364 ms: 4 candidates, 52534 repo-hours, 589 releases; waiting 530 ms; commit 654 ms)
2026-11-07T03:20:45Z [load_day 2023-01-12] 2023-01-12 hour 5: 140284 events in 3 files, snapshot 2807904221491521896 (task 9231 ms: download 2444 ms overlapping gunzip 756 ms, parse 3270 ms, sort 182 ms, write 3927 ms, index 320 ms: 3 candidates, 55124 repo-hours, 760 releases; waiting 486 ms; commit 710 ms)
2026-11-07T03:20:54Z [load_day 2023-01-12] 2023-01-12 hour 6: 159787 events in 4 files, snapshot 6155809041373429087 (task 10959 ms: download 2838 ms overlapping gunzip 840 ms, parse 3799 ms, sort 389 ms, write 4722 ms, index 417 ms: 6 candidates, 66711 repo-hours, 810 releases; waiting 511 ms; commit 525 ms)
2026-11-07T03:20:57Z [load_day 2023-01-12] 2023-01-12 hour 7: 166319 events in 4 files, snapshot 8470991422119528957 (task 11852 ms: download 4605 ms overlapping gunzip 842 ms, parse 3700 ms, sort 222 ms, write 5078 ms, index 483 ms: 3 candidates, 68155 repo-hours, 718 releases; waiting 1215 ms; commit 843 ms)
2026-11-07T03:21:08Z [load_day 2023-01-12] 2023-01-12 hour 8: 178046 events in 4 files, snapshot 4964535452385478710 (task 13069 ms: download 3956 ms overlapping gunzip 931 ms, parse 4256 ms, sort 316 ms, write 6205 ms, index 533 ms: 4 candidates, 76600 repo-hours, 834 releases; waiting 500 ms; commit 907 ms)
2026-11-07T03:21:11Z [load_day 2023-01-12] 2023-01-12 hour 9: 182686 events in 4 files, snapshot 1105547224130390912 (task 13143 ms: download 3528 ms overlapping gunzip 932 ms, parse 4190 ms, sort 363 ms, write 6484 ms, index 487 ms: 4 candidates, 79420 repo-hours, 981 releases; waiting 343 ms; commit 671 ms)
2026-11-07T03:21:23Z [load_day 2023-01-12] 2023-01-12 hour 10: 186941 events in 4 files, snapshot 4984340088305553265 (task 13691 ms: download 3659 ms overlapping gunzip 1021 ms, parse 4619 ms, sort 343 ms, write 6420 ms, index 485 ms: 2 candidates, 79565 repo-hours, 1081 releases; waiting 472 ms; commit 1402 ms)
2026-11-07T03:21:25Z [load_day 2023-01-12] 2023-01-12 hour 11: 183532 events in 4 files, snapshot 1972230192003344280 (task 13325 ms: download 3190 ms overlapping gunzip 946 ms, parse 4465 ms, sort 325 ms, write 6318 ms, index 496 ms: 2 candidates, 77402 repo-hours, 968 releases; waiting 516 ms; commit 540 ms)
2026-11-07T03:21:37Z [load_day 2023-01-12] 2023-01-12 hour 12: 210205 events in 5 files, snapshot 9075449423037531611 (task 14438 ms: download 3432 ms overlapping gunzip 1037 ms, parse 4795 ms, sort 489 ms, write 6655 ms, index 567 ms: 7 candidates, 102528 repo-hours, 1103 releases; waiting 542 ms; commit 413 ms)
2026-11-07T03:21:40Z [load_day 2023-01-12] 2023-01-12 hour 13: 209675 events in 5 files, snapshot 4083275304718303601 (task 14556 ms: download 3943 ms overlapping gunzip 1008 ms, parse 4660 ms, sort 330 ms, write 7014 ms, index 562 ms: 2 candidates, 100232 repo-hours, 1038 releases; waiting 634 ms; commit 429 ms)
2026-11-07T03:21:53Z [load_day 2023-01-12] 2023-01-12 hour 14: 198213 events in 4 files, snapshot 8769900473019690534 (task 14912 ms: download 5089 ms overlapping gunzip 1066 ms, parse 5066 ms, sort 515 ms, write 6388 ms, index 519 ms: 1 candidates, 88341 repo-hours, 1013 releases; waiting 842 ms; commit 691 ms)
2026-11-07T03:21:55Z [load_day 2023-01-12] 2023-01-12 hour 15: 198373 events in 4 files, snapshot 1221783249493670694 (task 14571 ms: download 4233 ms overlapping gunzip 1136 ms, parse 5134 ms, sort 416 ms, write 6463 ms, index 602 ms: 5 candidates, 90092 repo-hours, 1200 releases; waiting 504 ms; commit 1038 ms)
2026-11-07T03:22:06Z [load_day 2023-01-12] 2023-01-12 hour 16: 181166 events in 4 files, snapshot 7320270680998892180 (task 13118 ms: download 3198 ms overlapping gunzip 921 ms, parse 4239 ms, sort 317 ms, write 6275 ms, index 572 ms: 4 candidates, 83079 repo-hours, 986 releases; waiting 516 ms; commit 820 ms)
2026-11-07T03:22:09Z [load_day 2023-01-12] 2023-01-12 hour 17: 186890 events in 4 files, snapshot 2317117679941063474 (task 13119 ms: download 4144 ms overlapping gunzip 874 ms, parse 4085 ms, sort 305 ms, write 5829 ms, index 502 ms: 3 candidates, 81102 repo-hours, 904 releases; waiting 1194 ms; commit 664 ms)
2026-11-07T03:22:19Z [load_day 2023-01-12] 2023-01-12 hour 18: 182352 events in 4 files, snapshot 7878007501431035666 (task 11826 ms: download 3200 ms overlapping gunzip 833 ms, parse 3884 ms, sort 282 ms, write 5413 ms, index 515 ms: 4 candidates, 80628 repo-hours, 1010 releases; waiting 521 ms; commit 609 ms)
2026-11-07T03:22:21Z [load_day 2023-01-12] 2023-01-12 hour 19: 173626 events in 4 files, snapshot 3568229596075941821 (task 11017 ms: download 2947 ms overlapping gunzip 748 ms, parse 3689 ms, sort 236 ms, write 5099 ms, index 476 ms: 1 candidates, 72222 repo-hours, 1020 releases; waiting 518 ms; commit 792 ms)
2026-11-07T03:22:30Z [load_day 2023-01-12] 2023-01-12 hour 20: 169386 events in 4 files, snapshot 7309225999856551233 (task 10964 ms: download 2977 ms overlapping gunzip 778 ms, parse 3892 ms, sort 268 ms, write 4775 ms, index 436 ms: 4 candidates, 70406 repo-hours, 928 releases; waiting 515 ms; commit 626 ms)
2026-11-07T03:22:32Z [load_day 2023-01-12] 2023-01-12 hour 21: 163943 events in 4 files, snapshot 8668792266793579754 (task 10532 ms: download 3539 ms overlapping gunzip 786 ms, parse 3625 ms, sort 200 ms, write 4742 ms, index 402 ms: 3 candidates, 65020 repo-hours, 969 releases; waiting 492 ms; commit 646 ms)
2026-11-07T03:22:40Z [load_day 2023-01-12] 2023-01-12 hour 22: 151983 events in 4 files, snapshot 3011023994969329706 (task 9520 ms: download 2572 ms overlapping gunzip 671 ms, parse 3277 ms, sort 189 ms, write 4265 ms, index 382 ms: 5 candidates, 60658 repo-hours, 885 releases; waiting 495 ms; commit 517 ms)
2026-11-07T03:22:42Z [load_day 2023-01-12] 2023-01-12 hour 23: 140611 events in 3 files, snapshot 2804463180036645734 (task 9596 ms: download 2998 ms overlapping gunzip 743 ms, parse 3441 ms, sort 243 ms, write 4253 ms, index 329 ms: 4 candidates, 57871 repo-hours, 706 releases; waiting 243 ms; commit 453 ms)
2026-11-07T03:22:49Z [load_day 2023-01-12] 2023-01-12: repo_hour merged from 24 files to 1 (1776022 rows, 7137 ms)
2026-11-07T03:22:50Z [load_day 2023-01-12] 2023-01-12: index committed in 8695 ms (24 + 1 + 24 files)
2026-11-07T03:22:50Z [load_day 2023-01-12] 2023-01-12: 4076179 events in 24 hours
2026-11-07T03:22:50Z [load_day 2023-01-12] attempt 1 succeeded