orcaLog in

Runs · run 654

load_day 2026-04-14, attempt 1 succeeded

Host
4e84322b8c45:160031
Started
2026-11-07T12:53:48Z
Ended
2026-11-07T12:55:18Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/654/load_day/2026-04-14/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T12:53:48Z [load_day 2026-04-14] attempt 1 started
2026-11-07T12:53:58Z [load_day 2026-04-14] 2026-04-14 hour 0: 151204 events in 4 files, snapshot 1858321305306468825 (task 5987 ms: download 1988 ms overlapping gunzip 375 ms, parse 1313 ms, sort 192 ms, write 2756 ms, index 508 ms: 11 candidates, 75258 repo-hours, 729 releases; waiting 555 ms; commit 1191 ms)
2026-11-07T12:53:59Z [load_day 2026-04-14] 2026-04-14 hour 1: 152221 events in 4 files, snapshot 4884715765855357799 (task 5790 ms: download 2129 ms overlapping gunzip 311 ms, parse 1144 ms, sort 154 ms, write 2713 ms, index 585 ms: 9 candidates, 86607 repo-hours, 440 releases; waiting 536 ms; commit 1447 ms)
2026-11-07T12:54:05Z [load_day 2026-04-14] 2026-04-14 hour 2: 155538 events in 4 files, snapshot 3780023799704318734 (task 6192 ms: download 1801 ms overlapping gunzip 379 ms, parse 1264 ms, sort 162 ms, write 2890 ms, index 599 ms: 3 candidates, 88922 repo-hours, 433 releases; waiting 556 ms; commit 1188 ms)
2026-11-07T12:54:06Z [load_day 2026-04-14] 2026-04-14 hour 3: 155013 events in 4 files, snapshot 5878915773052273805 (task 6008 ms: download 2038 ms overlapping gunzip 343 ms, parse 1163 ms, sort 159 ms, write 2886 ms, index 575 ms: 4 candidates, 80141 repo-hours, 529 releases; waiting 545 ms; commit 1496 ms)
2026-11-07T12:54:11Z [load_day 2026-04-14] 2026-04-14 hour 4: 150134 events in 4 files, snapshot 4721120180185776014 (task 5861 ms: download 1983 ms overlapping gunzip 368 ms, parse 1229 ms, sort 218 ms, write 2633 ms, index 529 ms: 11 candidates, 73668 repo-hours, 759 releases; waiting 530 ms; commit 1189 ms)
2026-11-07T12:54:13Z [load_day 2026-04-14] 2026-04-14 hour 5: 150675 events in 4 files, snapshot 1152273615874941129 (task 6039 ms: download 2222 ms overlapping gunzip 383 ms, parse 1240 ms, sort 158 ms, write 2816 ms, index 512 ms: 9 candidates, 77255 repo-hours, 663 releases; waiting 603 ms; commit 1373 ms)
2026-11-07T12:54:18Z [load_day 2026-04-14] 2026-04-14 hour 6: 153034 events in 4 files, snapshot 7599246861650946251 (task 5543 ms: download 2037 ms overlapping gunzip 361 ms, parse 1200 ms, sort 140 ms, write 2329 ms, index 705 ms: 10 candidates, 82114 repo-hours, 507 releases; waiting 565 ms; commit 1253 ms)
2026-11-07T12:54:19Z [load_day 2026-04-14] 2026-04-14 hour 7: 159023 events in 4 files, snapshot 5545953640448369105 (task 5287 ms: download 1895 ms overlapping gunzip 325 ms, parse 1088 ms, sort 133 ms, write 2319 ms, index 589 ms: 5 candidates, 86392 repo-hours, 316 releases; waiting 539 ms; commit 1257 ms)
2026-11-07T12:54:23Z [load_day 2026-04-14] 2026-04-14 hour 8: 154305 events in 4 files, snapshot 3160307277930375199 (task 4974 ms: download 1809 ms overlapping gunzip 332 ms, parse 1120 ms, sort 159 ms, write 1961 ms, index 528 ms: 7 candidates, 79839 repo-hours, 244 releases; waiting 537 ms; commit 1236 ms)
2026-11-07T12:54:25Z [load_day 2026-04-14] 2026-04-14 hour 9: 154438 events in 4 files, snapshot 6478908217891395097 (task 5111 ms: download 1619 ms overlapping gunzip 308 ms, parse 1049 ms, sort 135 ms, write 2033 ms, index 633 ms: 9 candidates, 86170 repo-hours, 369 releases; waiting 560 ms; commit 1288 ms)
2026-11-07T12:54:29Z [load_day 2026-04-14] 2026-04-14 hour 10: 153685 events in 4 files, snapshot 4191010480768535325 (task 5165 ms: download 1577 ms overlapping gunzip 286 ms, parse 977 ms, sort 135 ms, write 2309 ms, index 620 ms: 7 candidates, 86530 repo-hours, 332 releases; waiting 530 ms; commit 1160 ms)
2026-11-07T12:54:31Z [load_day 2026-04-14] 2026-04-14 hour 11: 155678 events in 4 files, snapshot 5894098864961485537 (task 4775 ms: download 1510 ms overlapping gunzip 286 ms, parse 967 ms, sort 122 ms, write 2101 ms, index 621 ms: 11 candidates, 86363 repo-hours, 356 releases; waiting 367 ms; commit 1429 ms)
2026-11-07T12:54:35Z [load_day 2026-04-14] 2026-04-14 hour 12: 157552 events in 4 files, snapshot 8403570439068336174 (task 4655 ms: download 1474 ms overlapping gunzip 265 ms, parse 907 ms, sort 142 ms, write 2018 ms, index 703 ms: 7 candidates, 90633 repo-hours, 157 releases; waiting 292 ms; commit 1158 ms)
2026-11-07T12:54:36Z [load_day 2026-04-14] 2026-04-14 hour 13: 156557 events in 4 files, snapshot 4505444287943130870 (task 4346 ms: download 1568 ms overlapping gunzip 232 ms, parse 813 ms, sort 116 ms, write 1617 ms, index 675 ms: 9 candidates, 97011 repo-hours, 64 releases; waiting 609 ms; commit 1146 ms)
2026-11-07T12:54:40Z [load_day 2026-04-14] 2026-04-14 hour 14: 155617 events in 4 files, snapshot 663392115077732509 (task 4475 ms: download 1398 ms overlapping gunzip 230 ms, parse 808 ms, sort 123 ms, write 1813 ms, index 644 ms: 8 candidates, 89899 repo-hours, 112 releases; waiting 237 ms; commit 1249 ms)
2026-11-07T12:54:41Z [load_day 2026-04-14] 2026-04-14 hour 15: 159816 events in 4 files, snapshot 1061016439996290785 (task 4337 ms: download 1509 ms overlapping gunzip 248 ms, parse 846 ms, sort 124 ms, write 1672 ms, index 631 ms: 9 candidates, 90197 repo-hours, 85 releases; waiting 530 ms; commit 1308 ms)
2026-11-07T12:54:47Z [load_day 2026-04-14] 2026-04-14 hour 16: 155556 events in 4 files, snapshot 6180261193156586367 (task 4633 ms: download 1615 ms overlapping gunzip 239 ms, parse 821 ms, sort 134 ms, write 1901 ms, index 642 ms: 4 candidates, 88122 repo-hours, 119 releases; waiting 583 ms; commit 3400 ms)
2026-11-07T12:54:49Z [load_day 2026-04-14] 2026-04-14 hour 17: 162456 events in 4 files, snapshot 4934569157459623531 (task 4815 ms: download 1380 ms overlapping gunzip 256 ms, parse 877 ms, sort 189 ms, write 2041 ms, index 629 ms: 7 candidates, 88747 repo-hours, 174 releases; waiting 553 ms; commit 1308 ms)
2026-11-07T12:54:51Z [load_day 2026-04-14] 2026-04-14 hour 18: 158648 events in 4 files, snapshot 4434611353129097134 (task 5004 ms: download 1697 ms overlapping gunzip 272 ms, parse 955 ms, sort 149 ms, write 2140 ms, index 589 ms: 11 candidates, 84988 repo-hours, 289 releases; waiting 533 ms; commit 1388 ms)
2026-11-07T12:54:55Z [load_day 2026-04-14] 2026-04-14 hour 19: 159957 events in 4 files, snapshot 792864583178002509 (task 5431 ms: download 1606 ms overlapping gunzip 296 ms, parse 1083 ms, sort 203 ms, write 2288 ms, index 649 ms: 13 candidates, 87032 repo-hours, 340 releases; waiting 536 ms; commit 1229 ms)
2026-11-07T12:54:57Z [load_day 2026-04-14] 2026-04-14 hour 20: 155462 events in 4 files, snapshot 4587231404818543573 (task 5315 ms: download 2222 ms overlapping gunzip 301 ms, parse 1033 ms, sort 139 ms, write 2411 ms, index 581 ms: 16 candidates, 81500 repo-hours, 384 releases; waiting 554 ms; commit 1306 ms)
2026-11-07T12:55:01Z [load_day 2026-04-14] 2026-04-14 hour 21: 153841 events in 4 files, snapshot 7180031669099294332 (task 5547 ms: download 1778 ms overlapping gunzip 345 ms, parse 1175 ms, sort 150 ms, write 2448 ms, index 575 ms: 16 candidates, 78899 repo-hours, 597 releases; waiting 554 ms; commit 1382 ms)
2026-11-07T12:55:03Z [load_day 2026-04-14] 2026-04-14 hour 22: 149465 events in 3 files, snapshot 6799539534533929678 (task 5748 ms: download 1920 ms overlapping gunzip 356 ms, parse 1179 ms, sort 148 ms, write 2670 ms, index 509 ms: 11 candidates, 72943 repo-hours, 713 releases; waiting 566 ms; commit 1359 ms)
2026-11-07T12:55:08Z [load_day 2026-04-14] 2026-04-14 hour 23: 150799 events in 4 files, snapshot 4397706859333779229 (task 5795 ms: download 2574 ms overlapping gunzip 386 ms, parse 1354 ms, sort 153 ms, write 2496 ms, index 557 ms: 9 candidates, 73798 repo-hours, 981 releases; waiting 526 ms; commit 1517 ms)
2026-11-07T12:55:16Z [load_day 2026-04-14] 2026-04-14: repo_hour merged from 24 files to 1 (2013028 rows, 8449 ms)
2026-11-07T12:55:18Z [load_day 2026-04-14] 2026-04-14: index committed in 10469 ms (24 + 1 + 24 files)
2026-11-07T12:55:18Z [load_day 2026-04-14] 2026-04-14: 3720674 events in 24 hours
2026-11-07T12:55:18Z [load_day 2026-04-14] attempt 1 succeeded