orcaLog in

Runs · run 454

load_day 2026-06-20, attempt 1 succeeded

Host
4e84322b8c45:94889
Started
2026-11-07T05:42:13Z
Ended
2026-11-07T05:43:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/454/load_day/2026-06-20/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:42:14Z [load_day 2026-06-20] attempt 1 started
2026-11-07T05:42:21Z [load_day 2026-06-20] 2026-06-20 hour 0: 158596 events in 4 files, snapshot 7438566183688932364 (task 4048 ms: download 1328 ms overlapping gunzip 240 ms, parse 916 ms, sort 188 ms, write 1636 ms, index 353 ms: 4 candidates, 59393 repo-hours, 0 releases; waiting 496 ms; commit 1085 ms)
2026-11-07T05:42:22Z [load_day 2026-06-20] 2026-06-20 hour 1: 156950 events in 4 files, snapshot 7582456241218335034 (task 4152 ms: download 1265 ms overlapping gunzip 209 ms, parse 787 ms, sort 115 ms, write 1778 ms, index 480 ms: 5 candidates, 59308 repo-hours, 0 releases; waiting 507 ms; commit 1164 ms)
2026-11-07T05:42:25Z [load_day 2026-06-20] 2026-06-20 hour 2: 159763 events in 4 files, snapshot 2778484577789857925 (task 3774 ms: download 1228 ms overlapping gunzip 202 ms, parse 803 ms, sort 102 ms, write 1423 ms, index 476 ms: 3 candidates, 73343 repo-hours, 0 releases; waiting 512 ms; commit 948 ms)
2026-11-07T05:42:26Z [load_day 2026-06-20] 2026-06-20 hour 3: 157015 events in 4 files, snapshot 4569352586351281309 (task 3808 ms: download 1226 ms overlapping gunzip 214 ms, parse 758 ms, sort 103 ms, write 1453 ms, index 445 ms: 6 candidates, 70607 repo-hours, 0 releases; waiting 557 ms; commit 987 ms)
2026-11-07T05:42:29Z [load_day 2026-06-20] 2026-06-20 hour 4: 159433 events in 4 files, snapshot 7813676985387581230 (task 3888 ms: download 1393 ms overlapping gunzip 231 ms, parse 817 ms, sort 102 ms, write 1482 ms, index 439 ms: 7 candidates, 69817 repo-hours, 0 releases; waiting 527 ms; commit 1087 ms)
2026-11-07T05:42:31Z [load_day 2026-06-20] 2026-06-20 hour 5: 162490 events in 4 files, snapshot 8110668936637931861 (task 3947 ms: download 1246 ms overlapping gunzip 225 ms, parse 841 ms, sort 109 ms, write 1513 ms, index 438 ms: 9 candidates, 65922 repo-hours, 0 releases; waiting 510 ms; commit 1090 ms)
2026-11-07T05:42:34Z [load_day 2026-06-20] 2026-06-20 hour 6: 160568 events in 4 files, snapshot 5275243137438375718 (task 3914 ms: download 1729 ms overlapping gunzip 213 ms, parse 774 ms, sort 113 ms, write 1501 ms, index 454 ms: 3 candidates, 66532 repo-hours, 0 releases; waiting 524 ms; commit 986 ms)
2026-11-07T05:42:36Z [load_day 2026-06-20] 2026-06-20 hour 7: 158530 events in 4 files, snapshot 3628088204785681882 (task 4211 ms: download 1312 ms overlapping gunzip 226 ms, parse 802 ms, sort 110 ms, write 1409 ms, index 488 ms: 6 candidates, 66554 repo-hours, 0 releases; waiting 531 ms; commit 1126 ms)
2026-11-07T05:42:38Z [load_day 2026-06-20] 2026-06-20 hour 8: 160870 events in 4 files, snapshot 4095672397293734501 (task 3958 ms: download 1383 ms overlapping gunzip 213 ms, parse 761 ms, sort 106 ms, write 1535 ms, index 508 ms: 4 candidates, 72205 repo-hours, 0 releases; waiting 515 ms; commit 1084 ms)
2026-11-07T05:42:40Z [load_day 2026-06-20] 2026-06-20 hour 9: 164485 events in 4 files, snapshot 7910877926515914101 (task 3891 ms: download 1478 ms overlapping gunzip 210 ms, parse 783 ms, sort 106 ms, write 1458 ms, index 484 ms: 6 candidates, 71389 repo-hours, 0 releases; waiting 531 ms; commit 1053 ms)
2026-11-07T05:42:43Z [load_day 2026-06-20] 2026-06-20 hour 10: 161925 events in 4 files, snapshot 3521076618874153223 (task 3965 ms: download 1361 ms overlapping gunzip 209 ms, parse 767 ms, sort 109 ms, write 1555 ms, index 554 ms: 9 candidates, 69855 repo-hours, 0 releases; waiting 526 ms; commit 1156 ms)
2026-11-07T05:42:45Z [load_day 2026-06-20] 2026-06-20 hour 11: 160543 events in 4 files, snapshot 914181433184904080 (task 4166 ms: download 1313 ms overlapping gunzip 222 ms, parse 819 ms, sort 113 ms, write 1479 ms, index 507 ms: 13 candidates, 73102 repo-hours, 0 releases; waiting 523 ms; commit 1161 ms)
2026-11-07T05:42:47Z [load_day 2026-06-20] 2026-06-20 hour 12: 160945 events in 4 files, snapshot 7647465851800975502 (task 3755 ms: download 1388 ms overlapping gunzip 204 ms, parse 762 ms, sort 106 ms, write 1462 ms, index 470 ms: 5 candidates, 71965 repo-hours, 0 releases; waiting 487 ms; commit 1001 ms)
2026-11-07T05:42:50Z [load_day 2026-06-20] 2026-06-20 hour 13: 165209 events in 4 files, snapshot 3946643357333083142 (task 4088 ms: download 1517 ms overlapping gunzip 206 ms, parse 779 ms, sort 104 ms, write 1555 ms, index 623 ms: 12 candidates, 84526 repo-hours, 0 releases; waiting 527 ms; commit 1209 ms)
2026-11-07T05:42:52Z [load_day 2026-06-20] 2026-06-20 hour 14: 166151 events in 4 files, snapshot 5102797853128468039 (task 3894 ms: download 1671 ms overlapping gunzip 211 ms, parse 791 ms, sort 106 ms, write 1445 ms, index 562 ms: 7 candidates, 82407 repo-hours, 0 releases; waiting 503 ms; commit 947 ms)
2026-11-07T05:42:55Z [load_day 2026-06-20] 2026-06-20 hour 15: 167116 events in 4 files, snapshot 6914069628695358988 (task 3941 ms: download 1198 ms overlapping gunzip 211 ms, parse 794 ms, sort 112 ms, write 1464 ms, index 551 ms: 13 candidates, 76559 repo-hours, 0 releases; waiting 516 ms; commit 1100 ms)
2026-11-07T05:42:57Z [load_day 2026-06-20] 2026-06-20 hour 16: 162198 events in 4 files, snapshot 726308604230276827 (task 3878 ms: download 1324 ms overlapping gunzip 193 ms, parse 750 ms, sort 103 ms, write 1428 ms, index 542 ms: 5 candidates, 77162 repo-hours, 0 releases; waiting 528 ms; commit 1076 ms)
2026-11-07T05:42:59Z [load_day 2026-06-20] 2026-06-20 hour 17: 162928 events in 4 files, snapshot 6043720024551991042 (task 3720 ms: download 1027 ms overlapping gunzip 196 ms, parse 744 ms, sort 104 ms, write 1554 ms, index 494 ms: 4 candidates, 70469 repo-hours, 0 releases; waiting 359 ms; commit 933 ms)
2026-11-07T05:43:01Z [load_day 2026-06-20] 2026-06-20 hour 18: 163129 events in 4 files, snapshot 8355694037456074393 (task 3950 ms: download 1341 ms overlapping gunzip 209 ms, parse 774 ms, sort 114 ms, write 1481 ms, index 552 ms: 9 candidates, 70381 repo-hours, 0 releases; waiting 524 ms; commit 1237 ms)
2026-11-07T05:43:04Z [load_day 2026-06-20] 2026-06-20 hour 19: 165018 events in 4 files, snapshot 6766121552077050790 (task 4111 ms: download 1482 ms overlapping gunzip 215 ms, parse 795 ms, sort 114 ms, write 1726 ms, index 512 ms: 7 candidates, 76353 repo-hours, 0 releases; waiting 528 ms; commit 1098 ms)
2026-11-07T05:43:06Z [load_day 2026-06-20] 2026-06-20 hour 20: 161092 events in 4 files, snapshot 1006217587497175735 (task 3935 ms: download 1573 ms overlapping gunzip 228 ms, parse 803 ms, sort 114 ms, write 1498 ms, index 424 ms: 3 candidates, 65925 repo-hours, 0 releases; waiting 541 ms; commit 1056 ms)
2026-11-07T05:43:08Z [load_day 2026-06-20] 2026-06-20 hour 21: 159380 events in 4 files, snapshot 2924715673638503697 (task 3860 ms: download 1143 ms overlapping gunzip 214 ms, parse 777 ms, sort 113 ms, write 1583 ms, index 483 ms: 5 candidates, 66489 repo-hours, 0 releases; waiting 360 ms; commit 903 ms)
2026-11-07T05:43:10Z [load_day 2026-06-20] 2026-06-20 hour 22: 157941 events in 4 files, snapshot 1347153509840037062 (task 3880 ms: download 1262 ms overlapping gunzip 227 ms, parse 793 ms, sort 107 ms, write 1601 ms, index 379 ms: 6 candidates, 62828 repo-hours, 0 releases; waiting 551 ms; commit 1095 ms)
2026-11-07T05:43:13Z [load_day 2026-06-20] 2026-06-20 hour 23: 154864 events in 4 files, snapshot 520303373125443602 (task 3734 ms: download 1408 ms overlapping gunzip 226 ms, parse 817 ms, sort 106 ms, write 1408 ms, index 356 ms: 4 candidates, 60142 repo-hours, 0 releases; waiting 514 ms; commit 983 ms)
2026-11-07T05:43:20Z [load_day 2026-06-20] 2026-06-20: repo_hour merged from 24 files to 1 (1683233 rows, 6680 ms)
2026-11-07T05:43:21Z [load_day 2026-06-20] 2026-06-20: index committed in 8392 ms (24 + 1 + 1 files)
2026-11-07T05:43:21Z [load_day 2026-06-20] 2026-06-20: 3867139 events in 24 hours
2026-11-07T05:43:21Z [load_day 2026-06-20] attempt 1 succeeded