orcaLog in

Runs · run 1406

load_day 2023-08-18, attempt 1 succeeded

Host
3c2b29713ce8:238808
Started
2026-11-08T00:00:07Z
Ended
2026-11-08T00:03:53Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1406/load_day/2023-08-18/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T00:00:07Z [load_day 2023-08-18] attempt 1 started
2026-11-08T00:00:09Z [load_day 2023-08-18] 2023-08-18: 2 hours in flight, about 1200 MB
2026-11-08T00:00:29Z [load_day 2023-08-18] 2023-08-18 hour 0: 161888 events in 4 files, snapshot 4065622347776711639 (task 15724 ms: download 7410 ms overlapping gunzip 1056 ms, parse 4752 ms, sort 110 ms, write 8337 ms, index 679 ms: 5 candidates, 84914 repo-hours, 914 releases; waiting 497 ms; commit 2370 ms)
2026-11-08T00:00:31Z [load_day 2023-08-18] 2023-08-18 hour 1: 152032 events in 4 files, snapshot 4718717709164618324 (task 14362 ms: download 5915 ms overlapping gunzip 819 ms, parse 3716 ms, sort 128 ms, write 8384 ms, index 822 ms: 8 candidates, 83463 repo-hours, 827 releases; waiting 185 ms; commit 2596 ms)
2026-11-08T00:00:43Z [load_day 2023-08-18] 2023-08-18 hour 2: 136088 events in 3 files, snapshot 3007875862530636252 (task 13088 ms: download 5907 ms overlapping gunzip 771 ms, parse 3386 ms, sort 96 ms, write 7619 ms, index 400 ms: 4 candidates, 59204 repo-hours, 768 releases; waiting 507 ms; commit 2565 ms)
2026-11-08T00:00:46Z [load_day 2023-08-18] 2023-08-18 hour 3: 129894 events in 3 files, snapshot 5129256467370467746 (task 12275 ms: download 5567 ms overlapping gunzip 649 ms, parse 3022 ms, sort 78 ms, write 7298 ms, index 426 ms: 4 candidates, 55300 repo-hours, 880 releases; waiting 488 ms; commit 2730 ms)
2026-11-08T00:00:56Z [load_day 2023-08-18] 2023-08-18 hour 4: 128351 events in 3 files, snapshot 7427824967840735301 (task 11248 ms: download 4508 ms overlapping gunzip 648 ms, parse 2833 ms, sort 91 ms, write 6526 ms, index 339 ms: 2 candidates, 53351 repo-hours, 644 releases; waiting 518 ms; commit 2763 ms)
2026-11-08T00:01:00Z [load_day 2023-08-18] 2023-08-18 hour 5: 133271 events in 3 files, snapshot 436284363072010973 (task 13191 ms: download 5322 ms overlapping gunzip 758 ms, parse 3235 ms, sort 132 ms, write 7645 ms, index 516 ms: 2 candidates, 57116 repo-hours, 754 releases; waiting 604 ms; commit 2562 ms)
2026-11-08T00:01:23Z [load_day 2023-08-18] 2023-08-18 hour 6: 165348 events in 4 files, snapshot 4048693621179733530 (task 16429 ms: download 6489 ms overlapping gunzip 1087 ms, parse 4746 ms, sort 169 ms, write 8924 ms, index 698 ms: 3 candidates, 77028 repo-hours, 972 releases; waiting 474 ms; commit 12368 ms)
2026-11-08T00:01:25Z [load_day 2023-08-18] 2023-08-18 hour 7: 154311 events in 4 files, snapshot 8624984229009367557 (task 18254 ms: download 7176 ms overlapping gunzip 1061 ms, parse 4961 ms, sort 134 ms, write 10712 ms, index 556 ms: 5 candidates, 68119 repo-hours, 952 releases; waiting 491 ms; commit 2430 ms)
2026-11-08T00:01:33Z [load_day 2023-08-18] 2023-08-18 hour 8: 164757 events in 4 files, snapshot 7289998939333012688 (task 17546 ms: download 10368 ms overlapping gunzip 1058 ms, parse 4547 ms, sort 86 ms, write 10553 ms, index 514 ms: 4 candidates, 73686 repo-hours, 1039 releases; waiting 499 ms; commit 3995 ms)
2026-11-08T00:01:46Z [load_day 2023-08-18] 2023-08-18 hour 9: 174731 events in 4 files, snapshot 7691572528452692418 (task 19360 ms: download 11382 ms overlapping gunzip 1121 ms, parse 5109 ms, sort 157 ms, write 11537 ms, index 644 ms: 6 candidates, 75936 repo-hours, 1198 releases; waiting 495 ms; commit 2619 ms)
2026-11-08T00:01:52Z [load_day 2023-08-18] 2023-08-18 hour 10: 173565 events in 4 files, snapshot 8839466312669647105 (task 18159 ms: download 10990 ms overlapping gunzip 1131 ms, parse 5437 ms, sort 112 ms, write 10170 ms, index 554 ms: 5 candidates, 73303 repo-hours, 917 releases; waiting 489 ms; commit 3730 ms)
2026-11-08T00:02:06Z [load_day 2023-08-18] 2023-08-18 hour 11: 171828 events in 4 files, snapshot 463307959309901407 (task 17985 ms: download 10481 ms overlapping gunzip 1148 ms, parse 5132 ms, sort 226 ms, write 10151 ms, index 617 ms: 3 candidates, 73400 repo-hours, 1005 releases; waiting 382 ms; commit 3912 ms)
2026-11-08T00:02:11Z [load_day 2023-08-18] 2023-08-18 hour 12: 222361 events in 5 files, snapshot 2253569922881428183 (task 19148 ms: download 10419 ms overlapping gunzip 1080 ms, parse 4938 ms, sort 198 ms, write 11299 ms, index 771 ms: 6 candidates, 102230 repo-hours, 1102 releases; waiting 531 ms; commit 2230 ms)
2026-11-08T00:02:21Z [load_day 2023-08-18] 2023-08-18 hour 13: 195499 events in 4 files, snapshot 360584567086853143 (task 15901 ms: download 8220 ms overlapping gunzip 978 ms, parse 4350 ms, sort 140 ms, write 9358 ms, index 609 ms: 3 candidates, 95230 repo-hours, 1018 releases; waiting 187 ms; commit 2379 ms)
2026-11-08T00:02:34Z [load_day 2023-08-18] 2023-08-18 hour 14: 188712 events in 4 files, snapshot 6253613325951509514 (task 19475 ms: download 8507 ms overlapping gunzip 908 ms, parse 4050 ms, sort 104 ms, write 9427 ms, index 4200 ms: 4 candidates, 85727 repo-hours, 1148 releases; waiting 193 ms; commit 5363 ms)
2026-11-08T00:02:40Z [load_day 2023-08-18] 2023-08-18 hour 15: 171622 events in 4 files, snapshot 6412881292953231626 (task 17051 ms: download 10002 ms overlapping gunzip 867 ms, parse 3733 ms, sort 114 ms, write 11102 ms, index 574 ms: 4 candidates, 75558 repo-hours, 1034 releases; waiting 330 ms; commit 2240 ms)
2026-11-08T00:02:52Z [load_day 2023-08-18] 2023-08-18 hour 16: 172515 events in 4 files, snapshot 4143359837770139825 (task 16553 ms: download 9286 ms overlapping gunzip 836 ms, parse 3804 ms, sort 159 ms, write 10356 ms, index 542 ms: 2 candidates, 74086 repo-hours, 918 releases; waiting 541 ms; commit 2466 ms)
2026-11-08T00:02:58Z [load_day 2023-08-18] 2023-08-18 hour 17: 172276 events in 4 files, snapshot 200818314409179376 (task 17355 ms: download 9885 ms overlapping gunzip 993 ms, parse 4535 ms, sort 160 ms, write 10183 ms, index 662 ms: 5 candidates, 71184 repo-hours, 866 releases; waiting 518 ms; commit 2796 ms)
2026-11-08T00:03:12Z [load_day 2023-08-18] 2023-08-18 hour 18: 174620 events in 4 files, snapshot 1946592165854095150 (task 17564 ms: download 9971 ms overlapping gunzip 878 ms, parse 3955 ms, sort 200 ms, write 10923 ms, index 779 ms: 4 candidates, 74891 repo-hours, 955 releases; waiting 491 ms; commit 3290 ms)
2026-11-08T00:03:17Z [load_day 2023-08-18] 2023-08-18 hour 19: 158235 events in 4 files, snapshot 2667175754581066939 (task 16234 ms: download 6315 ms overlapping gunzip 969 ms, parse 4297 ms, sort 185 ms, write 9389 ms, index 906 ms: 4 candidates, 62967 repo-hours, 887 releases; waiting 192 ms; commit 4247 ms)
2026-11-08T00:03:28Z [load_day 2023-08-18] 2023-08-18 hour 20: 156933 events in 4 files, snapshot 7598513596988328157 (task 15694 ms: download 6531 ms overlapping gunzip 881 ms, parse 3790 ms, sort 113 ms, write 9587 ms, index 506 ms: 3 candidates, 64968 repo-hours, 912 releases; waiting 515 ms; commit 2574 ms)
2026-11-08T00:03:31Z [load_day 2023-08-18] 2023-08-18 hour 21: 139339 events in 3 files, snapshot 3033663384648165480 (task 14395 ms: download 6216 ms overlapping gunzip 837 ms, parse 3562 ms, sort 102 ms, write 8417 ms, index 640 ms: 3 candidates, 54756 repo-hours, 938 releases; waiting 475 ms; commit 2922 ms)
2026-11-08T00:03:41Z [load_day 2023-08-18] 2023-08-18 hour 22: 133922 events in 3 files, snapshot 2562617770809773535 (task 12558 ms: download 5222 ms overlapping gunzip 779 ms, parse 3235 ms, sort 134 ms, write 7553 ms, index 359 ms: 5 candidates, 49930 repo-hours, 750 releases; waiting 186 ms; commit 2273 ms)
2026-11-08T00:03:44Z [load_day 2023-08-18] 2023-08-18 hour 23: 115749 events in 3 files, snapshot 129096770646933744 (task 11140 ms: download 2236 ms overlapping gunzip 624 ms, parse 2589 ms, sort 70 ms, write 6720 ms, index 297 ms: 2 candidates, 45024 repo-hours, 722 releases; waiting 541 ms; commit 2062 ms)
2026-11-08T00:03:51Z [load_day 2023-08-18] 2023-08-18: repo_hour merged from 24 files to 1 (1691371 rows, 7575 ms)
2026-11-08T00:03:53Z [load_day 2023-08-18] 2023-08-18: index committed in 9891 ms (24 + 1 + 24 files)
2026-11-08T00:03:53Z [load_day 2023-08-18] 2023-08-18: 3847847 events in 24 hours
2026-11-08T00:03:53Z [load_day 2023-08-18] attempt 1 succeeded