orcaLog in

Runs · run 29

load_day 2023-01-10, attempt 1 succeeded

Host
4e84322b8c45:10275
Started
2026-11-07T03:14:12Z
Ended
2026-11-07T03:17:03Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/29/load_day/2023-01-10/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:14:12Z [load_day 2023-01-10] attempt 1 started
2026-11-07T03:14:28Z [load_day 2023-01-10] 2023-01-10 hour 0: 163252 events in 4 files, snapshot 5857629808056738905 (task 12980 ms: download 4128 ms overlapping gunzip 1027 ms, parse 4708 ms, sort 345 ms, write 5615 ms, index 441 ms: 6 candidates, 73417 repo-hours, 830 releases; waiting 444 ms; commit 683 ms)
2026-11-07T03:14:28Z [load_day 2023-01-10] 2023-01-10 hour 1: 155394 events in 4 files, snapshot 777519960205815634 (task 11686 ms: download 3152 ms overlapping gunzip 877 ms, parse 3958 ms, sort 315 ms, write 5446 ms, index 443 ms: 5 candidates, 78240 repo-hours, 780 releases; waiting 339 ms; commit 539 ms)
2026-11-07T03:14:39Z [load_day 2023-01-10] 2023-01-10 hour 2: 141346 events in 3 files, snapshot 6432863753748514576 (task 10621 ms: download 2880 ms overlapping gunzip 730 ms, parse 3279 ms, sort 266 ms, write 5167 ms, index 382 ms: 7 candidates, 66338 repo-hours, 726 releases; waiting 507 ms; commit 558 ms)
2026-11-07T03:14:39Z [load_day 2023-01-10] 2023-01-10 hour 3: 147259 events in 3 files, snapshot 3273014828769234956 (task 10299 ms: download 2902 ms overlapping gunzip 696 ms, parse 3118 ms, sort 220 ms, write 4983 ms, index 374 ms: 3 candidates, 56871 repo-hours, 787 releases; waiting 493 ms; commit 610 ms)
2026-11-07T03:14:49Z [load_day 2023-01-10] 2023-01-10 hour 4: 139417 events in 3 files, snapshot 5947598200388654640 (task 9799 ms: download 2816 ms overlapping gunzip 830 ms, parse 3679 ms, sort 417 ms, write 3721 ms, index 319 ms: 3 candidates, 52325 repo-hours, 542 releases; waiting 519 ms; commit 590 ms)
2026-11-07T03:14:50Z [load_day 2023-01-10] 2023-01-10 hour 5: 146229 events in 3 files, snapshot 725466158422801543 (task 9153 ms: download 2674 ms overlapping gunzip 666 ms, parse 3103 ms, sort 257 ms, write 4017 ms, index 324 ms: 2 candidates, 56189 repo-hours, 739 releases; waiting 512 ms; commit 515 ms)
2026-11-07T03:15:00Z [load_day 2023-01-10] 2023-01-10 hour 6: 159801 events in 4 files, snapshot 3095924820987398032 (task 9905 ms: download 2543 ms overlapping gunzip 722 ms, parse 3236 ms, sort 235 ms, write 4522 ms, index 384 ms: 3 candidates, 66476 repo-hours, 809 releases; waiting 500 ms; commit 661 ms)
2026-11-07T03:15:01Z [load_day 2023-01-10] 2023-01-10 hour 7: 175209 events in 4 files, snapshot 8917363952449816758 (task 10900 ms: download 3234 ms overlapping gunzip 832 ms, parse 3856 ms, sort 221 ms, write 4725 ms, index 441 ms: 7 candidates, 69033 repo-hours, 772 releases; waiting 522 ms; commit 576 ms)
2026-11-07T03:15:14Z [load_day 2023-01-10] 2023-01-10 hour 8: 183058 events in 4 files, snapshot 8690485617022942007 (task 13428 ms: download 3932 ms overlapping gunzip 1045 ms, parse 4758 ms, sort 361 ms, write 5855 ms, index 486 ms: 8 candidates, 76404 repo-hours, 872 releases; waiting 498 ms; commit 642 ms)
2026-11-07T03:15:15Z [load_day 2023-01-10] 2023-01-10 hour 9: 190224 events in 4 files, snapshot 8293654684647045863 (task 13085 ms: download 4411 ms overlapping gunzip 1043 ms, parse 4736 ms, sort 311 ms, write 5563 ms, index 458 ms: 4 candidates, 79700 repo-hours, 1096 releases; waiting 532 ms; commit 520 ms)
2026-11-07T03:15:28Z [load_day 2023-01-10] 2023-01-10 hour 10: 190013 events in 4 files, snapshot 5102438439417115442 (task 14030 ms: download 5720 ms overlapping gunzip 1085 ms, parse 4848 ms, sort 317 ms, write 5893 ms, index 517 ms: 3 candidates, 79624 repo-hours, 1011 releases; waiting 1029 ms; commit 688 ms)
2026-11-07T03:15:29Z [load_day 2023-01-10] 2023-01-10 hour 11: 180077 events in 4 files, snapshot 4732071386667237498 (task 13911 ms: download 4540 ms overlapping gunzip 1052 ms, parse 4913 ms, sort 434 ms, write 6150 ms, index 439 ms: 2 candidates, 75751 repo-hours, 983 releases; waiting 574 ms; commit 554 ms)
2026-11-07T03:15:43Z [load_day 2023-01-10] 2023-01-10 hour 12: 209124 events in 5 files, snapshot 3594551144358633934 (task 13972 ms: download 3534 ms overlapping gunzip 1008 ms, parse 4751 ms, sort 310 ms, write 6358 ms, index 599 ms: 11 candidates, 101806 repo-hours, 968 releases; waiting 505 ms; commit 749 ms)
2026-11-07T03:15:44Z [load_day 2023-01-10] 2023-01-10 hour 13: 213486 events in 5 files, snapshot 5681154008013440888 (task 14463 ms: download 4123 ms overlapping gunzip 1154 ms, parse 5209 ms, sort 376 ms, write 6193 ms, index 574 ms: 4 candidates, 98566 repo-hours, 1022 releases; waiting 615 ms; commit 586 ms)
2026-11-07T03:15:57Z [load_day 2023-01-10] 2023-01-10 hour 14: 206518 events in 5 files, snapshot 6957563483402409944 (task 13937 ms: download 4220 ms overlapping gunzip 1051 ms, parse 4860 ms, sort 310 ms, write 6066 ms, index 539 ms: 6 candidates, 90491 repo-hours, 1100 releases; waiting 587 ms; commit 858 ms)
2026-11-07T03:15:59Z [load_day 2023-01-10] 2023-01-10 hour 15: 205981 events in 5 files, snapshot 8531711283958800064 (task 14867 ms: download 3511 ms overlapping gunzip 1099 ms, parse 5315 ms, sort 407 ms, write 6532 ms, index 546 ms: 3 candidates, 91029 repo-hours, 1269 releases; waiting 491 ms; commit 509 ms)
2026-11-07T03:16:11Z [load_day 2023-01-10] 2023-01-10 hour 16: 189209 events in 4 files, snapshot 2169181033640484618 (task 13284 ms: download 4019 ms overlapping gunzip 1047 ms, parse 4966 ms, sort 331 ms, write 5534 ms, index 503 ms: 2 candidates, 83732 repo-hours, 1160 releases; waiting 592 ms; commit 627 ms)
2026-11-07T03:16:14Z [load_day 2023-01-10] 2023-01-10 hour 17: 198309 events in 4 files, snapshot 1785325225521188908 (task 13498 ms: download 3534 ms overlapping gunzip 1035 ms, parse 4802 ms, sort 323 ms, write 5997 ms, index 542 ms: 7 candidates, 82694 repo-hours, 1059 releases; waiting 500 ms; commit 555 ms)
2026-11-07T03:16:25Z [load_day 2023-01-10] 2023-01-10 hour 18: 192957 events in 4 files, snapshot 3347310740929673748 (task 13305 ms: download 3499 ms overlapping gunzip 935 ms, parse 4368 ms, sort 404 ms, write 6282 ms, index 494 ms: 3 candidates, 82663 repo-hours, 1258 releases; waiting 490 ms; commit 841 ms)
2026-11-07T03:16:27Z [load_day 2023-01-10] 2023-01-10 hour 19: 188814 events in 4 files, snapshot 1263619331735506469 (task 12892 ms: download 3248 ms overlapping gunzip 887 ms, parse 4280 ms, sort 305 ms, write 6194 ms, index 432 ms: 3 candidates, 74386 repo-hours, 1088 releases; waiting 505 ms; commit 702 ms)
2026-11-07T03:16:38Z [load_day 2023-01-10] 2023-01-10 hour 20: 184779 events in 4 files, snapshot 3439860653102424953 (task 12381 ms: download 3660 ms overlapping gunzip 906 ms, parse 4214 ms, sort 359 ms, write 5605 ms, index 440 ms: 6 candidates, 72988 repo-hours, 1007 releases; waiting 518 ms; commit 766 ms)
2026-11-07T03:16:40Z [load_day 2023-01-10] 2023-01-10 hour 21: 177453 events in 4 files, snapshot 1881631074267000324 (task 12503 ms: download 3374 ms overlapping gunzip 982 ms, parse 4355 ms, sort 274 ms, write 5649 ms, index 411 ms: 7 candidates, 67917 repo-hours, 1127 releases; waiting 225 ms; commit 480 ms)
2026-11-07T03:16:52Z [load_day 2023-01-10] 2023-01-10 hour 22: 169476 events in 4 files, snapshot 5451725890736387821 (task 13048 ms: download 3770 ms overlapping gunzip 1049 ms, parse 4565 ms, sort 423 ms, write 5769 ms, index 396 ms: 6 candidates, 65123 repo-hours, 924 releases; waiting 521 ms; commit 693 ms)
2026-11-07T03:16:54Z [load_day 2023-01-10] 2023-01-10 hour 23: 152746 events in 4 files, snapshot 6280063187816864606 (task 12753 ms: download 3921 ms overlapping gunzip 1145 ms, parse 4791 ms, sort 437 ms, write 5228 ms, index 377 ms: 10 candidates, 60817 repo-hours, 791 releases; waiting 498 ms; commit 693 ms)
2026-11-07T03:17:01Z [load_day 2023-01-10] 2023-01-10: repo_hour merged from 24 files to 1 (1802580 rows, 7287 ms)
2026-11-07T03:17:03Z [load_day 2023-01-10] 2023-01-10: index committed in 9091 ms (24 + 1 + 24 files)
2026-11-07T03:17:03Z [load_day 2023-01-10] 2023-01-10: 4260131 events in 24 hours
2026-11-07T03:17:03Z [load_day 2023-01-10] attempt 1 succeeded