orcaLog in

Runs · run 1381

load_day 2023-08-11, attempt 1 succeeded

Host
3c2b29713ce8:217610
Started
2026-11-07T23:48:20Z
Ended
2026-11-07T23:52:03Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1381/load_day/2023-08-11/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:48:20Z [load_day 2023-08-11] attempt 1 started
2026-11-07T23:48:22Z [load_day 2023-08-11] 2023-08-11: 2 hours in flight, about 1200 MB
2026-11-07T23:48:40Z [load_day 2023-08-11] 2023-08-11 hour 0: 164327 events in 4 files, snapshot 6350065530686472395 (task 14089 ms: download 6089 ms overlapping gunzip 767 ms, parse 3872 ms, sort 102 ms, write 7974 ms, index 595 ms: 6 candidates, 88900 repo-hours, 991 releases; waiting 494 ms; commit 2343 ms)
2026-11-07T23:48:45Z [load_day 2023-08-11] 2023-08-11 hour 1: 151730 events in 4 files, snapshot 2716664129738957847 (task 13826 ms: download 5093 ms overlapping gunzip 676 ms, parse 3122 ms, sort 104 ms, write 8838 ms, index 609 ms: 4 candidates, 83372 repo-hours, 721 releases; waiting 201 ms; commit 5134 ms)
2026-11-07T23:48:54Z [load_day 2023-08-11] 2023-08-11 hour 2: 137941 events in 3 files, snapshot 2371924177667052969 (task 12426 ms: download 5578 ms overlapping gunzip 699 ms, parse 2977 ms, sort 109 ms, write 7352 ms, index 497 ms: 4 candidates, 57337 repo-hours, 885 releases; waiting 501 ms; commit 3570 ms)
2026-11-07T23:48:56Z [load_day 2023-08-11] 2023-08-11 hour 3: 132817 events in 3 files, snapshot 3761423007942024605 (task 11537 ms: download 5155 ms overlapping gunzip 684 ms, parse 2925 ms, sort 80 ms, write 6526 ms, index 556 ms: 1 candidates, 55832 repo-hours, 961 releases; waiting 483 ms; commit 2167 ms)
2026-11-07T23:49:06Z [load_day 2023-08-11] 2023-08-11 hour 4: 123867 events in 3 files, snapshot 6179106359056397570 (task 11636 ms: download 2294 ms overlapping gunzip 704 ms, parse 3100 ms, sort 83 ms, write 6494 ms, index 452 ms: 1 candidates, 51349 repo-hours, 617 releases; waiting 513 ms; commit 3305 ms)
2026-11-07T23:49:11Z [load_day 2023-08-11] 2023-08-11 hour 5: 136024 events in 3 files, snapshot 3786240514204344554 (task 12641 ms: download 4950 ms overlapping gunzip 643 ms, parse 2807 ms, sort 108 ms, write 7880 ms, index 398 ms: 1 candidates, 57057 repo-hours, 710 releases; waiting 524 ms; commit 3532 ms)
2026-11-07T23:49:19Z [load_day 2023-08-11] 2023-08-11 hour 6: 162924 events in 4 files, snapshot 417258518491022143 (task 12614 ms: download 5058 ms overlapping gunzip 770 ms, parse 3403 ms, sort 116 ms, write 6965 ms, index 561 ms: 4 candidates, 72069 repo-hours, 845 releases; waiting 487 ms; commit 2012 ms)
2026-11-07T23:49:25Z [load_day 2023-08-11] 2023-08-11 hour 7: 162592 events in 4 files, snapshot 5147511388036883609 (task 13559 ms: download 5403 ms overlapping gunzip 771 ms, parse 3372 ms, sort 156 ms, write 7822 ms, index 481 ms: 4 candidates, 69854 repo-hours, 842 releases; waiting 654 ms; commit 2025 ms)
2026-11-07T23:49:36Z [load_day 2023-08-11] 2023-08-11 hour 8: 178279 events in 4 files, snapshot 4300999310237153735 (task 16731 ms: download 8661 ms overlapping gunzip 963 ms, parse 4244 ms, sort 112 ms, write 10028 ms, index 632 ms: 4 candidates, 76883 repo-hours, 1232 releases; waiting 512 ms; commit 2312 ms)
2026-11-07T23:49:45Z [load_day 2023-08-11] 2023-08-11 hour 9: 179534 events in 4 files, snapshot 2871734241568877317 (task 17010 ms: download 9820 ms overlapping gunzip 931 ms, parse 4289 ms, sort 121 ms, write 10032 ms, index 793 ms: 8 candidates, 76844 repo-hours, 1254 releases; waiting 516 ms; commit 4321 ms)
2026-11-07T23:49:55Z [load_day 2023-08-11] 2023-08-11 hour 10: 186492 events in 4 files, snapshot 8499639762540671452 (task 17140 ms: download 9724 ms overlapping gunzip 1032 ms, parse 4572 ms, sort 121 ms, write 9967 ms, index 608 ms: 7 candidates, 88707 repo-hours, 953 releases; waiting 542 ms; commit 2284 ms)
2026-11-07T23:50:03Z [load_day 2023-08-11] 2023-08-11 hour 11: 173012 events in 4 files, snapshot 5559238718625221410 (task 17024 ms: download 10089 ms overlapping gunzip 936 ms, parse 3980 ms, sort 131 ms, write 10233 ms, index 621 ms: 6 candidates, 74571 repo-hours, 1008 releases; waiting 759 ms; commit 3975 ms)
2026-11-07T23:50:16Z [load_day 2023-08-11] 2023-08-11 hour 12: 232787 events in 5 files, snapshot 5392034814111526578 (task 20417 ms: download 10249 ms overlapping gunzip 1137 ms, parse 5681 ms, sort 144 ms, write 11924 ms, index 717 ms: 8 candidates, 103527 repo-hours, 1087 releases; waiting 552 ms; commit 2668 ms)
2026-11-07T23:50:23Z [load_day 2023-08-11] 2023-08-11 hour 13: 196069 events in 4 files, snapshot 8832750835568595447 (task 20054 ms: download 10770 ms overlapping gunzip 980 ms, parse 4585 ms, sort 258 ms, write 12491 ms, index 924 ms: 2 candidates, 95215 repo-hours, 994 releases; waiting 485 ms; commit 2471 ms)
2026-11-07T23:50:36Z [load_day 2023-08-11] 2023-08-11 hour 14: 185356 events in 4 files, snapshot 7729777156822008099 (task 18825 ms: download 10419 ms overlapping gunzip 1098 ms, parse 4813 ms, sort 120 ms, write 11600 ms, index 595 ms: 1 candidates, 81003 repo-hours, 1127 releases; waiting 331 ms; commit 2908 ms)
2026-11-07T23:50:43Z [load_day 2023-08-11] 2023-08-11 hour 15: 174145 events in 4 files, snapshot 2422765870985883991 (task 19554 ms: download 10819 ms overlapping gunzip 1029 ms, parse 4448 ms, sort 132 ms, write 11492 ms, index 659 ms: 3 candidates, 78165 repo-hours, 1216 releases; waiting 962 ms; commit 2749 ms)
2026-11-07T23:50:56Z [load_day 2023-08-11] 2023-08-11 hour 16: 171519 events in 4 files, snapshot 3414335608564708934 (task 18400 ms: download 10730 ms overlapping gunzip 966 ms, parse 4012 ms, sort 150 ms, write 11836 ms, index 641 ms: 5 candidates, 76131 repo-hours, 1050 releases; waiting 495 ms; commit 2528 ms)
2026-11-07T23:51:02Z [load_day 2023-08-11] 2023-08-11 hour 17: 170921 events in 4 files, snapshot 2902645180516484973 (task 17692 ms: download 10684 ms overlapping gunzip 1171 ms, parse 4889 ms, sort 116 ms, write 10060 ms, index 669 ms: 0 candidates, 72857 repo-hours, 1038 releases; waiting 510 ms; commit 2728 ms)
2026-11-07T23:51:13Z [load_day 2023-08-11] 2023-08-11 hour 18: 171454 events in 4 files, snapshot 1030354084144450426 (task 17020 ms: download 9646 ms overlapping gunzip 1082 ms, parse 4597 ms, sort 124 ms, write 9852 ms, index 573 ms: 1 candidates, 75147 repo-hours, 1019 releases; waiting 498 ms; commit 2263 ms)
2026-11-07T23:51:21Z [load_day 2023-08-11] 2023-08-11 hour 19: 157162 events in 4 files, snapshot 8697721464389113552 (task 18292 ms: download 10986 ms overlapping gunzip 1062 ms, parse 4682 ms, sort 111 ms, write 11060 ms, index 423 ms: 4 candidates, 63520 repo-hours, 893 releases; waiting 633 ms; commit 3032 ms)
2026-11-07T23:51:32Z [load_day 2023-08-11] 2023-08-11 hour 20: 156424 events in 4 files, snapshot 798253556750665514 (task 17227 ms: download 7543 ms overlapping gunzip 978 ms, parse 4364 ms, sort 158 ms, write 10096 ms, index 489 ms: 1 candidates, 63927 repo-hours, 958 releases; waiting 817 ms; commit 2469 ms)
2026-11-07T23:51:36Z [load_day 2023-08-11] 2023-08-11 hour 21: 137196 events in 3 files, snapshot 510618213171304275 (task 13719 ms: download 5819 ms overlapping gunzip 789 ms, parse 3487 ms, sort 124 ms, write 7983 ms, index 502 ms: 7 candidates, 55297 repo-hours, 928 releases; waiting 535 ms; commit 2989 ms)
2026-11-07T23:51:51Z [load_day 2023-08-11] 2023-08-11 hour 22: 125677 events in 3 files, snapshot 5734717239292525320 (task 13385 ms: download 6257 ms overlapping gunzip 812 ms, parse 3296 ms, sort 164 ms, write 6776 ms, index 1130 ms: 2 candidates, 50232 repo-hours, 778 releases; waiting 821 ms; commit 6779 ms)
2026-11-07T23:51:54Z [load_day 2023-08-11] 2023-08-11 hour 23: 110986 events in 3 files, snapshot 5784485581236908776 (task 9976 ms: download 2423 ms overlapping gunzip 631 ms, parse 2678 ms, sort 118 ms, write 5274 ms, index 311 ms: 2 candidates, 44840 repo-hours, 642 releases; waiting 493 ms; commit 3254 ms)
2026-11-07T23:52:01Z [load_day 2023-08-11] 2023-08-11: repo_hour merged from 24 files to 1 (1712636 rows, 7247 ms)
2026-11-07T23:52:03Z [load_day 2023-08-11] 2023-08-11: index committed in 8930 ms (23 + 1 + 24 files)
2026-11-07T23:52:03Z [load_day 2023-08-11] 2023-08-11: 3879235 events in 24 hours
2026-11-07T23:52:03Z [load_day 2023-08-11] attempt 1 succeeded