orcaLog in

Runs · run 215

load_day 2026-09-07, attempt 1 succeeded

Host
4e84322b8c45:36753
Started
2026-11-07T04:11:35Z
Ended
2026-11-07T04:12:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/215/load_day/2026-09-07/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:11:35Z [load_day 2026-09-07] attempt 1 started
2026-11-07T04:11:45Z [load_day 2026-09-07] 2026-09-07 hour 0: 91297 events in 2 files, snapshot 9216596077126300547 (task 7345 ms: download 2423 ms overlapping gunzip 509 ms, parse 1603 ms, sort 283 ms, write 3705 ms, index 322 ms: 8 candidates, 42831 repo-hours, 1185 releases; waiting 550 ms; commit 687 ms)
2026-11-07T04:11:45Z [load_day 2026-09-07] 2026-09-07 hour 1: 91141 events in 2 files, snapshot 7056180515307605797 (task 6616 ms: download 1572 ms overlapping gunzip 484 ms, parse 1532 ms, sort 156 ms, write 3636 ms, index 344 ms: 3 candidates, 46518 repo-hours, 1164 releases; waiting 158 ms; commit 751 ms)
2026-11-07T04:11:51Z [load_day 2026-09-07] 2026-09-07 hour 2: 91251 events in 2 files, snapshot 8474518505347950455 (task 5963 ms: download 1747 ms overlapping gunzip 425 ms, parse 1260 ms, sort 122 ms, write 2979 ms, index 307 ms: 6 candidates, 47496 repo-hours, 886 releases; waiting 582 ms; commit 706 ms)
2026-11-07T04:11:52Z [load_day 2026-09-07] 2026-09-07 hour 3: 88810 events in 2 files, snapshot 5523821972498379197 (task 5908 ms: download 2742 ms overlapping gunzip 398 ms, parse 1224 ms, sort 82 ms, write 2511 ms, index 290 ms: 3 candidates, 45346 repo-hours, 638 releases; waiting 1079 ms; commit 664 ms)
2026-11-07T04:11:57Z [load_day 2026-09-07] 2026-09-07 hour 4: 92104 events in 2 files, snapshot 752811728593881196 (task 4665 ms: download 1406 ms overlapping gunzip 283 ms, parse 842 ms, sort 75 ms, write 2337 ms, index 264 ms: 8 candidates, 42797 repo-hours, 421 releases; waiting 593 ms; commit 994 ms)
2026-11-07T04:11:58Z [load_day 2026-09-07] 2026-09-07 hour 5: 84985 events in 2 files, snapshot 411794090699971075 (task 3651 ms: download 1426 ms overlapping gunzip 211 ms, parse 611 ms, sort 74 ms, write 1630 ms, index 296 ms: 3 candidates, 41224 repo-hours, 253 releases; waiting 533 ms; commit 792 ms)
2026-11-07T04:12:00Z [load_day 2026-09-07] 2026-09-07 hour 6: 89584 events in 2 files, snapshot 8173973049862992436 (task 3018 ms: download 1026 ms overlapping gunzip 177 ms, parse 528 ms, sort 66 ms, write 1234 ms, index 247 ms: 4 candidates, 39498 repo-hours, 159 releases; waiting 503 ms; commit 919 ms)
2026-11-07T04:12:02Z [load_day 2026-09-07] 2026-09-07 hour 7: 91428 events in 2 files, snapshot 6650072801639275558 (task 2943 ms: download 1079 ms overlapping gunzip 176 ms, parse 566 ms, sort 57 ms, write 1069 ms, index 269 ms: 7 candidates, 40435 repo-hours, 131 releases; waiting 547 ms; commit 967 ms)
2026-11-07T04:12:04Z [load_day 2026-09-07] 2026-09-07 hour 8: 79696 events in 2 files, snapshot 6715839458300188725 (task 2948 ms: download 1037 ms overlapping gunzip 173 ms, parse 525 ms, sort 58 ms, write 1070 ms, index 275 ms: 6 candidates, 39487 repo-hours, 133 releases; waiting 536 ms; commit 838 ms)
2026-11-07T04:12:05Z [load_day 2026-09-07] 2026-09-07 hour 9: 81644 events in 2 files, snapshot 5014562191579296650 (task 3146 ms: download 1293 ms overlapping gunzip 176 ms, parse 547 ms, sort 56 ms, write 1211 ms, index 251 ms: 4 candidates, 40090 repo-hours, 165 releases; waiting 599 ms; commit 700 ms)
2026-11-07T04:12:08Z [load_day 2026-09-07] 2026-09-07 hour 10: 73091 events in 2 files, snapshot 1956579445674138284 (task 3179 ms: download 1203 ms overlapping gunzip 173 ms, parse 539 ms, sort 68 ms, write 1248 ms, index 283 ms: 7 candidates, 38771 repo-hours, 242 releases; waiting 554 ms; commit 750 ms)
2026-11-07T04:12:10Z [load_day 2026-09-07] 2026-09-07 hour 11: 78250 events in 2 files, snapshot 7537645681850766716 (task 3774 ms: download 1428 ms overlapping gunzip 229 ms, parse 707 ms, sort 93 ms, write 1653 ms, index 251 ms: 8 candidates, 40575 repo-hours, 415 releases; waiting 570 ms; commit 809 ms)
2026-11-07T04:12:13Z [load_day 2026-09-07] 2026-09-07 hour 12: 69666 events in 2 files, snapshot 8960928250996605437 (task 4641 ms: download 1783 ms overlapping gunzip 235 ms, parse 722 ms, sort 88 ms, write 1696 ms, index 374 ms: 9 candidates, 42079 repo-hours, 406 releases; waiting 882 ms; commit 688 ms)
2026-11-07T04:12:14Z [load_day 2026-09-07] 2026-09-07 hour 13: 66645 events in 2 files, snapshot 198093771899088649 (task 4069 ms: download 1710 ms overlapping gunzip 220 ms, parse 644 ms, sort 71 ms, write 1553 ms, index 258 ms: 10 candidates, 40298 repo-hours, 384 releases; waiting 981 ms; commit 617 ms)
2026-11-07T04:12:17Z [load_day 2026-09-07] 2026-09-07 hour 14: 79981 events in 2 files, snapshot 8605440912322069100 (task 3783 ms: download 1299 ms overlapping gunzip 220 ms, parse 664 ms, sort 64 ms, write 1710 ms, index 266 ms: 6 candidates, 42901 repo-hours, 302 releases; waiting 560 ms; commit 719 ms)
2026-11-07T04:12:18Z [load_day 2026-09-07] 2026-09-07 hour 15: 73767 events in 2 files, snapshot 4828301793177664007 (task 3418 ms: download 1186 ms overlapping gunzip 190 ms, parse 566 ms, sort 53 ms, write 1483 ms, index 274 ms: 5 candidates, 41274 repo-hours, 291 releases; waiting 614 ms; commit 870 ms)
2026-11-07T04:12:21Z [load_day 2026-09-07] 2026-09-07 hour 16: 83606 events in 2 files, snapshot 1783358700110849348 (task 3287 ms: download 1135 ms overlapping gunzip 180 ms, parse 555 ms, sort 59 ms, write 1365 ms, index 297 ms: 6 candidates, 40643 repo-hours, 198 releases; waiting 565 ms; commit 1147 ms)
2026-11-07T04:12:22Z [load_day 2026-09-07] 2026-09-07 hour 17: 98787 events in 2 files, snapshot 5133533871781369304 (task 3140 ms: download 1486 ms overlapping gunzip 179 ms, parse 575 ms, sort 69 ms, write 1342 ms, index 231 ms: 6 candidates, 35585 repo-hours, 186 releases; waiting 543 ms; commit 800 ms)
2026-11-07T04:12:25Z [load_day 2026-09-07] 2026-09-07 hour 18: 107442 events in 3 files, snapshot 1723691493019054187 (task 3372 ms: download 1198 ms overlapping gunzip 177 ms, parse 607 ms, sort 73 ms, write 1492 ms, index 203 ms: 3 candidates, 29252 repo-hours, 125 releases; waiting 539 ms; commit 808 ms)
2026-11-07T04:12:26Z [load_day 2026-09-07] 2026-09-07 hour 19: 108159 events in 3 files, snapshot 5538899033771869541 (task 3001 ms: download 1178 ms overlapping gunzip 161 ms, parse 548 ms, sort 70 ms, write 1235 ms, index 183 ms: 6 candidates, 27106 repo-hours, 92 releases; waiting 537 ms; commit 722 ms)
2026-11-07T04:12:29Z [load_day 2026-09-07] 2026-09-07 hour 20: 107961 events in 3 files, snapshot 4403182829326790490 (task 2992 ms: download 1061 ms overlapping gunzip 162 ms, parse 581 ms, sort 85 ms, write 1175 ms, index 180 ms: 1 candidates, 26712 repo-hours, 88 releases; waiting 527 ms; commit 1003 ms)
2026-11-07T04:12:30Z [load_day 2026-09-07] 2026-09-07 hour 21: 100730 events in 3 files, snapshot 4782569790579702142 (task 2896 ms: download 1147 ms overlapping gunzip 143 ms, parse 510 ms, sort 64 ms, write 1193 ms, index 170 ms: 3 candidates, 25662 repo-hours, 74 releases; waiting 536 ms; commit 762 ms)
2026-11-07T04:12:32Z [load_day 2026-09-07] 2026-09-07 hour 22: 99314 events in 2 files, snapshot 3961881366854389093 (task 2914 ms: download 1082 ms overlapping gunzip 186 ms, parse 535 ms, sort 64 ms, write 1038 ms, index 206 ms: 6 candidates, 23859 repo-hours, 75 releases; waiting 541 ms; commit 779 ms)
2026-11-07T04:12:33Z [load_day 2026-09-07] 2026-09-07 hour 23: 94987 events in 2 files, snapshot 2496518986673150835 (task 2434 ms: download 595 ms overlapping gunzip 184 ms, parse 537 ms, sort 70 ms, write 1020 ms, index 153 ms: 3 candidates, 22993 repo-hours, 83 releases; waiting 197 ms; commit 761 ms)
2026-11-07T04:12:37Z [load_day 2026-09-07] 2026-09-07: repo_hour merged from 24 files to 1 (903432 rows, 4346 ms)
2026-11-07T04:12:39Z [load_day 2026-09-07] 2026-09-07: index committed in 6154 ms (24 + 1 + 24 files)
2026-11-07T04:12:39Z [load_day 2026-09-07] 2026-09-07: 2124326 events in 24 hours
2026-11-07T04:12:39Z [load_day 2026-09-07] attempt 1 succeeded