orcaLog in

Runs · run 1656

load_day 2023-10-23, attempt 1 succeeded

Host
3c2b29713ce8:469609
Started
2026-11-08T02:03:48Z
Ended
2026-11-08T02:08:34Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1656/load_day/2023-10-23/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T02:03:48Z [load_day 2023-10-23] attempt 1 started
2026-11-08T02:03:50Z [load_day 2023-10-23] 2023-10-23: 2 hours in flight, about 1200 MB
2026-11-08T02:04:09Z [load_day 2023-10-23] 2023-10-23 hour 0: 150232 events in 4 files, snapshot 2752972130741196422 (task 14277 ms: download 6112 ms overlapping gunzip 826 ms, parse 3553 ms, sort 143 ms, write 8285 ms, index 634 ms: 11 candidates, 79848 repo-hours, 867 releases; waiting 489 ms; commit 2698 ms)
2026-11-08T02:04:14Z [load_day 2023-10-23] 2023-10-23 hour 1: 165909 events in 4 files, snapshot 5250924235023500569 (task 16788 ms: download 7317 ms overlapping gunzip 972 ms, parse 4476 ms, sort 137 ms, write 9589 ms, index 705 ms: 14 candidates, 88774 repo-hours, 659 releases; waiting 526 ms; commit 5721 ms)
2026-11-08T02:04:27Z [load_day 2023-10-23] 2023-10-23 hour 2: 146228 events in 3 files, snapshot 1033716416988551534 (task 15768 ms: download 7414 ms overlapping gunzip 1151 ms, parse 4431 ms, sort 100 ms, write 8763 ms, index 591 ms: 10 candidates, 60250 repo-hours, 876 releases; waiting 508 ms; commit 4219 ms)
2026-11-08T02:04:30Z [load_day 2023-10-23] 2023-10-23 hour 3: 141881 events in 3 files, snapshot 5201800758279019104 (task 14966 ms: download 6754 ms overlapping gunzip 1063 ms, parse 4343 ms, sort 97 ms, write 8082 ms, index 559 ms: 7 candidates, 59376 repo-hours, 839 releases; waiting 499 ms; commit 2728 ms)
2026-11-08T02:04:54Z [load_day 2023-10-23] 2023-10-23 hour 4: 137019 events in 3 files, snapshot 170760088329505363 (task 13171 ms: download 5590 ms overlapping gunzip 907 ms, parse 3671 ms, sort 73 ms, write 7552 ms, index 464 ms: 5 candidates, 54694 repo-hours, 632 releases; waiting 194 ms; commit 16638 ms)
2026-11-08T02:04:56Z [load_day 2023-10-23] 2023-10-23 hour 5: 143758 events in 3 files, snapshot 6856691619198853678 (task 16536 ms: download 6301 ms overlapping gunzip 1136 ms, parse 4798 ms, sort 131 ms, write 9279 ms, index 405 ms: 8 candidates, 59023 repo-hours, 750 releases; waiting 511 ms; commit 2595 ms)
2026-11-08T02:05:00Z [load_day 2023-10-23] 2023-10-23 hour 6: 173120 events in 4 files, snapshot 1240913738562978928 (task 18167 ms: download 11177 ms overlapping gunzip 1156 ms, parse 4846 ms, sort 139 ms, write 10374 ms, index 805 ms: 12 candidates, 76472 repo-hours, 852 releases; waiting 561 ms; commit 3353 ms)
2026-11-08T02:05:15Z [load_day 2023-10-23] 2023-10-23 hour 7: 181103 events in 4 files, snapshot 754372519521188066 (task 17192 ms: download 10426 ms overlapping gunzip 1124 ms, parse 4824 ms, sort 128 ms, write 10088 ms, index 493 ms: 8 candidates, 77734 repo-hours, 879 releases; waiting 291 ms; commit 2447 ms)
2026-11-08T02:05:20Z [load_day 2023-10-23] 2023-10-23 hour 8: 198467 events in 4 files, snapshot 8666238716736006312 (task 19538 ms: download 11518 ms overlapping gunzip 1183 ms, parse 5032 ms, sort 139 ms, write 11872 ms, index 572 ms: 9 candidates, 85491 repo-hours, 1116 releases; waiting 518 ms; commit 2430 ms)
2026-11-08T02:05:38Z [load_day 2023-10-23] 2023-10-23 hour 9: 200785 events in 5 files, snapshot 1194053820774600573 (task 21994 ms: download 11079 ms overlapping gunzip 1281 ms, parse 5555 ms, sort 179 ms, write 13612 ms, index 600 ms: 10 candidates, 85484 repo-hours, 1267 releases; waiting 499 ms; commit 2559 ms)
2026-11-08T02:05:43Z [load_day 2023-10-23] 2023-10-23 hour 10: 194387 events in 4 files, snapshot 8301309161274983079 (task 22042 ms: download 12873 ms overlapping gunzip 1517 ms, parse 6619 ms, sort 143 ms, write 12234 ms, index 777 ms: 11 candidates, 82214 repo-hours, 1013 releases; waiting 531 ms; commit 2177 ms)
2026-11-08T02:06:06Z [load_day 2023-10-23] 2023-10-23 hour 11: 195571 events in 4 files, snapshot 3331342740572047773 (task 24469 ms: download 15291 ms overlapping gunzip 1399 ms, parse 5687 ms, sort 122 ms, write 13339 ms, index 582 ms: 4 candidates, 82669 repo-hours, 997 releases; waiting 3110 ms; commit 5135 ms)
2026-11-08T02:06:10Z [load_day 2023-10-23] 2023-10-23 hour 12: 245552 events in 5 files, snapshot 3417715620718146741 (task 24797 ms: download 15169 ms overlapping gunzip 1395 ms, parse 6101 ms, sort 186 ms, write 14857 ms, index 1337 ms: 8 candidates, 116419 repo-hours, 1087 releases; waiting 581 ms; commit 3379 ms)
2026-11-08T02:06:31Z [load_day 2023-10-23] 2023-10-23 hour 13: 220270 events in 5 files, snapshot 7806840276741616489 (task 26345 ms: download 18323 ms overlapping gunzip 1475 ms, parse 6513 ms, sort 159 ms, write 16631 ms, index 768 ms: 12 candidates, 107755 repo-hours, 1019 releases; waiting 531 ms; commit 2676 ms)
2026-11-08T02:06:37Z [load_day 2023-10-23] 2023-10-23 hour 14: 213632 events in 5 files, snapshot 6183055956914170968 (task 25598 ms: download 18140 ms overlapping gunzip 1492 ms, parse 6023 ms, sort 115 ms, write 16342 ms, index 851 ms: 13 candidates, 96691 repo-hours, 1123 releases; waiting 467 ms; commit 2944 ms)
2026-11-08T02:06:57Z [load_day 2023-10-23] 2023-10-23 hour 15: 195609 events in 4 files, snapshot 6965016614523291495 (task 24571 ms: download 13492 ms overlapping gunzip 1401 ms, parse 6029 ms, sort 161 ms, write 15340 ms, index 745 ms: 14 candidates, 91493 repo-hours, 1153 releases; waiting 508 ms; commit 2569 ms)
2026-11-08T02:07:02Z [load_day 2023-10-23] 2023-10-23 hour 16: 196744 events in 4 files, snapshot 4487900670445360475 (task 24658 ms: download 14305 ms overlapping gunzip 1373 ms, parse 5897 ms, sort 200 ms, write 15667 ms, index 687 ms: 9 candidates, 89904 repo-hours, 980 releases; waiting 551 ms; commit 2804 ms)
2026-11-08T02:07:22Z [load_day 2023-10-23] 2023-10-23 hour 17: 199083 events in 4 files, snapshot 6461270822081692832 (task 23725 ms: download 13183 ms overlapping gunzip 1486 ms, parse 6353 ms, sort 215 ms, write 14222 ms, index 602 ms: 8 candidates, 87627 repo-hours, 954 releases; waiting 532 ms; commit 2790 ms)
2026-11-08T02:07:28Z [load_day 2023-10-23] 2023-10-23 hour 18: 202679 events in 5 files, snapshot 2486851657427270783 (task 24033 ms: download 13962 ms overlapping gunzip 1513 ms, parse 6494 ms, sort 168 ms, write 14118 ms, index 937 ms: 15 candidates, 91667 repo-hours, 982 releases; waiting 476 ms; commit 2798 ms)
2026-11-08T02:07:47Z [load_day 2023-10-23] 2023-10-23 hour 19: 198093 events in 4 files, snapshot 7242255839131234741 (task 23843 ms: download 13826 ms overlapping gunzip 1394 ms, parse 5785 ms, sort 176 ms, write 15007 ms, index 662 ms: 8 candidates, 82344 repo-hours, 1027 releases; waiting 511 ms; commit 2892 ms)
2026-11-08T02:07:52Z [load_day 2023-10-23] 2023-10-23 hour 20: 192495 events in 4 files, snapshot 545139599206453435 (task 22085 ms: download 13124 ms overlapping gunzip 1316 ms, parse 5802 ms, sort 166 ms, write 13478 ms, index 680 ms: 12 candidates, 80389 repo-hours, 921 releases; waiting 391 ms; commit 4087 ms)
2026-11-08T02:08:09Z [load_day 2023-10-23] 2023-10-23 hour 21: 179289 events in 4 files, snapshot 7165073414318249384 (task 20650 ms: download 12334 ms overlapping gunzip 1409 ms, parse 5937 ms, sort 128 ms, write 11887 ms, index 491 ms: 13 candidates, 71110 repo-hours, 1005 releases; waiting 538 ms; commit 2914 ms)
2026-11-08T02:08:11Z [load_day 2023-10-23] 2023-10-23 hour 22: 162003 events in 4 files, snapshot 1413150322107791189 (task 19303 ms: download 12654 ms overlapping gunzip 1421 ms, parse 6142 ms, sort 124 ms, write 10170 ms, index 545 ms: 8 candidates, 63664 repo-hours, 972 releases; waiting 575 ms; commit 2572 ms)
2026-11-08T02:08:23Z [load_day 2023-10-23] 2023-10-23 hour 23: 144079 events in 3 files, snapshot 6340679344171952307 (task 13745 ms: download 6236 ms overlapping gunzip 925 ms, parse 3840 ms, sort 90 ms, write 7730 ms, index 427 ms: 12 candidates, 59445 repo-hours, 737 releases; waiting 508 ms; commit 2268 ms)
2026-11-08T02:08:32Z [load_day 2023-10-23] 2023-10-23: repo_hour merged from 24 files to 1 (1930537 rows, 8470 ms)
2026-11-08T02:08:34Z [load_day 2023-10-23] 2023-10-23: index committed in 10838 ms (24 + 1 + 24 files)
2026-11-08T02:08:34Z [load_day 2023-10-23] 2023-10-23: 4377988 events in 24 hours
2026-11-08T02:08:34Z [load_day 2023-10-23] attempt 1 succeeded