orcaLog in

Runs · run 497

load_day 2026-06-05, attempt 1 succeeded

Host
4e84322b8c45:107849
Started
2026-11-07T06:02:07Z
Ended
2026-11-07T06:03:12Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/497/load_day/2026-06-05/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:02:07Z [load_day 2026-06-05] attempt 1 started
2026-11-07T06:02:11Z [load_day 2026-06-05] 2026-06-05 hour 0: 1001 events in 1 files, snapshot 5787845992665476113 (task 1117 ms: download 429 ms overlapping gunzip 10 ms, parse 29 ms, sort 1 ms, write 120 ms, index 25 ms: 1 candidates, 707 repo-hours, 0 releases; waiting 400 ms; commit 860 ms)
2026-11-07T06:02:13Z [load_day 2026-06-05] 2026-06-05 hour 1: 83596 events in 2 files, snapshot 5121451399860445640 (task 2817 ms: download 1014 ms overlapping gunzip 151 ms, parse 532 ms, sort 60 ms, write 923 ms, index 310 ms: 4 candidates, 46326 repo-hours, 71 releases; waiting 516 ms; commit 1097 ms)
2026-11-07T06:02:16Z [load_day 2026-06-05] 2026-06-05 hour 2: 160506 events in 4 files, snapshot 981695087094377586 (task 4309 ms: download 1440 ms overlapping gunzip 233 ms, parse 868 ms, sort 118 ms, write 1652 ms, index 557 ms: 6 candidates, 84047 repo-hours, 126 releases; waiting 518 ms; commit 1028 ms)
2026-11-07T06:02:18Z [load_day 2026-06-05] 2026-06-05 hour 3: 160739 events in 4 files, snapshot 7621275607126106313 (task 4144 ms: download 1562 ms overlapping gunzip 230 ms, parse 828 ms, sort 112 ms, write 1577 ms, index 531 ms: 9 candidates, 76805 repo-hours, 168 releases; waiting 545 ms; commit 1047 ms)
2026-11-07T06:02:21Z [load_day 2026-06-05] 2026-06-05 hour 4: 163172 events in 4 files, snapshot 8001958162028088957 (task 4295 ms: download 1479 ms overlapping gunzip 240 ms, parse 876 ms, sort 108 ms, write 1784 ms, index 504 ms: 12 candidates, 80712 repo-hours, 183 releases; waiting 512 ms; commit 1070 ms)
2026-11-07T06:02:23Z [load_day 2026-06-05] 2026-06-05 hour 5: 159035 events in 4 files, snapshot 791475971592376380 (task 4218 ms: download 1342 ms overlapping gunzip 248 ms, parse 872 ms, sort 119 ms, write 1682 ms, index 503 ms: 14 candidates, 73474 repo-hours, 206 releases; waiting 526 ms; commit 883 ms)
2026-11-07T06:02:26Z [load_day 2026-06-05] 2026-06-05 hour 6: 162150 events in 4 files, snapshot 8046826410278893285 (task 4063 ms: download 1482 ms overlapping gunzip 235 ms, parse 843 ms, sort 106 ms, write 1551 ms, index 511 ms: 11 candidates, 75990 repo-hours, 116 releases; waiting 519 ms; commit 1204 ms)
2026-11-07T06:02:27Z [load_day 2026-06-05] 2026-06-05 hour 7: 114896 events in 3 files, snapshot 8040723717684736766 (task 3067 ms: download 1114 ms overlapping gunzip 156 ms, parse 549 ms, sort 73 ms, write 1151 ms, index 341 ms: 5 candidates, 56154 repo-hours, 61 releases; waiting 535 ms; commit 982 ms)
2026-11-07T06:02:28Z [load_day 2026-06-05] 2026-06-05 hour 8: 570 events in 1 files, snapshot 1226162656273523296 (task 791 ms: download 431 ms overlapping gunzip 9 ms, parse 24 ms, sort 0 ms, write 99 ms, index 34 ms: 0 candidates, 360 repo-hours, 0 releases; waiting 411 ms; commit 998 ms)
2026-11-07T06:02:30Z [load_day 2026-06-05] 2026-06-05 hour 9: 50525 events in 2 files, snapshot 4928464608828449277 (task 1928 ms: download 810 ms overlapping gunzip 81 ms, parse 277 ms, sort 33 ms, write 463 ms, index 207 ms: 6 candidates, 31266 repo-hours, 34 releases; waiting 540 ms; commit 908 ms)
2026-11-07T06:02:33Z [load_day 2026-06-05] 2026-06-05 hour 10: 123877 events in 3 files, snapshot 9219678447714658193 (task 3371 ms: download 1174 ms overlapping gunzip 167 ms, parse 603 ms, sort 84 ms, write 1259 ms, index 418 ms: 7 candidates, 63970 repo-hours, 43 releases; waiting 535 ms; commit 1094 ms)
2026-11-07T06:02:35Z [load_day 2026-06-05] 2026-06-05 hour 11: 158220 events in 4 files, snapshot 7378402980849439235 (task 3812 ms: download 1942 ms overlapping gunzip 200 ms, parse 729 ms, sort 99 ms, write 1372 ms, index 627 ms: 7 candidates, 76323 repo-hours, 42 releases; waiting 523 ms; commit 1025 ms)
2026-11-07T06:02:37Z [load_day 2026-06-05] 2026-06-05 hour 12: 159129 events in 4 files, snapshot 6822453978944231565 (task 3927 ms: download 1281 ms overlapping gunzip 199 ms, parse 730 ms, sort 103 ms, write 1499 ms, index 582 ms: 6 candidates, 79538 repo-hours, 24 releases; waiting 523 ms; commit 1011 ms)
2026-11-07T06:02:39Z [load_day 2026-06-05] 2026-06-05 hour 13: 156468 events in 4 files, snapshot 1548453649188948425 (task 3772 ms: download 1304 ms overlapping gunzip 214 ms, parse 812 ms, sort 103 ms, write 1410 ms, index 543 ms: 11 candidates, 79747 repo-hours, 33 releases; waiting 471 ms; commit 1236 ms)
2026-11-07T06:02:42Z [load_day 2026-06-05] 2026-06-05 hour 14: 158592 events in 4 files, snapshot 2177964155148600902 (task 3994 ms: download 1321 ms overlapping gunzip 199 ms, parse 742 ms, sort 105 ms, write 1541 ms, index 556 ms: 3 candidates, 88683 repo-hours, 37 releases; waiting 518 ms; commit 1153 ms)
2026-11-07T06:02:44Z [load_day 2026-06-05] 2026-06-05 hour 15: 157892 events in 4 files, snapshot 670226670348787480 (task 3649 ms: download 883 ms overlapping gunzip 205 ms, parse 755 ms, sort 115 ms, write 1556 ms, index 555 ms: 4 candidates, 84427 repo-hours, 36 releases; waiting 211 ms; commit 1116 ms)
2026-11-07T06:02:47Z [load_day 2026-06-05] 2026-06-05 hour 16: 158219 events in 4 files, snapshot 4837222900512188528 (task 4111 ms: download 1213 ms overlapping gunzip 211 ms, parse 830 ms, sort 114 ms, write 1553 ms, index 560 ms: 7 candidates, 79512 repo-hours, 46 releases; waiting 511 ms; commit 941 ms)
2026-11-07T06:02:48Z [load_day 2026-06-05] 2026-06-05 hour 17: 162469 events in 4 files, snapshot 518606119052435381 (task 4061 ms: download 1364 ms overlapping gunzip 208 ms, parse 763 ms, sort 106 ms, write 1591 ms, index 539 ms: 8 candidates, 78801 repo-hours, 33 releases; waiting 531 ms; commit 950 ms)
2026-11-07T06:02:51Z [load_day 2026-06-05] 2026-06-05 hour 18: 165549 events in 4 files, snapshot 3023883703251857944 (task 3660 ms: download 892 ms overlapping gunzip 209 ms, parse 771 ms, sort 115 ms, write 1580 ms, index 496 ms: 9 candidates, 76543 repo-hours, 88 releases; waiting 181 ms; commit 1059 ms)
2026-11-07T06:02:53Z [load_day 2026-06-05] 2026-06-05 hour 19: 158114 events in 4 files, snapshot 4340298369977809727 (task 3933 ms: download 1375 ms overlapping gunzip 234 ms, parse 847 ms, sort 101 ms, write 1487 ms, index 500 ms: 8 candidates, 76140 repo-hours, 90 releases; waiting 505 ms; commit 1363 ms)
2026-11-07T06:02:56Z [load_day 2026-06-05] 2026-06-05 hour 20: 160029 events in 4 files, snapshot 3892457925183565807 (task 4371 ms: download 1411 ms overlapping gunzip 250 ms, parse 902 ms, sort 113 ms, write 1821 ms, index 489 ms: 11 candidates, 76719 repo-hours, 178 releases; waiting 517 ms; commit 1336 ms)
2026-11-07T06:02:57Z [load_day 2026-06-05] 2026-06-05 hour 21: 160753 events in 4 files, snapshot 8278720646789959882 (task 3832 ms: download 887 ms overlapping gunzip 240 ms, parse 840 ms, sort 98 ms, write 1618 ms, index 526 ms: 10 candidates, 71927 repo-hours, 147 releases; waiting 209 ms; commit 1027 ms)
2026-11-07T06:03:02Z [load_day 2026-06-05] 2026-06-05 hour 22: 151875 events in 4 files, snapshot 2167764456636288745 (task 4622 ms: download 1653 ms overlapping gunzip 295 ms, parse 1063 ms, sort 113 ms, write 1942 ms, index 458 ms: 7 candidates, 67853 repo-hours, 457 releases; waiting 521 ms; commit 1171 ms)
2026-11-07T06:03:03Z [load_day 2026-06-05] 2026-06-05 hour 23: 149522 events in 3 files, snapshot 8112291583620027508 (task 5237 ms: download 2022 ms overlapping gunzip 377 ms, parse 1248 ms, sort 115 ms, write 2234 ms, index 408 ms: 3 candidates, 64170 repo-hours, 723 releases; waiting 504 ms; commit 950 ms)
2026-11-07T06:03:10Z [load_day 2026-06-05] 2026-06-05: repo_hour merged from 24 files to 1 (1590194 rows, 6689 ms)
2026-11-07T06:03:12Z [load_day 2026-06-05] 2026-06-05: index committed in 8484 ms (23 + 1 + 22 files)
2026-11-07T06:03:12Z [load_day 2026-06-05] 2026-06-05: 3236898 events in 24 hours
2026-11-07T06:03:12Z [load_day 2026-06-05] attempt 1 succeeded