orcaLog in

Runs · run 566

load_day 2026-05-13, attempt 1 succeeded

Host
4e84322b8c45:126181
Started
2026-11-07T06:30:55Z
Ended
2026-11-07T06:32:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/566/load_day/2026-05-13/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:30:56Z [load_day 2026-05-13] attempt 1 started
2026-11-07T06:31:04Z [load_day 2026-05-13] 2026-05-13 hour 0: 150376 events in 4 files, snapshot 3531341404058562363 (task 5290 ms: download 1810 ms overlapping gunzip 299 ms, parse 1047 ms, sort 139 ms, write 2491 ms, index 467 ms: 5 candidates, 73871 repo-hours, 422 releases; waiting 546 ms; commit 1120 ms)
2026-11-07T06:31:05Z [load_day 2026-05-13] 2026-05-13 hour 1: 154692 events in 4 files, snapshot 7532883319171152598 (task 5375 ms: download 1926 ms overlapping gunzip 281 ms, parse 986 ms, sort 121 ms, write 2525 ms, index 497 ms: 6 candidates, 78566 repo-hours, 345 releases; waiting 613 ms; commit 1246 ms)
2026-11-07T06:31:09Z [load_day 2026-05-13] 2026-05-13 hour 2: 162495 events in 4 files, snapshot 8946202117144367339 (task 4290 ms: download 1586 ms overlapping gunzip 241 ms, parse 858 ms, sort 104 ms, write 1635 ms, index 682 ms: 6 candidates, 90017 repo-hours, 131 releases; waiting 525 ms; commit 1155 ms)
2026-11-07T06:31:11Z [load_day 2026-05-13] 2026-05-13 hour 3: 157349 events in 4 files, snapshot 4125173013024721384 (task 4660 ms: download 1955 ms overlapping gunzip 265 ms, parse 914 ms, sort 107 ms, write 1950 ms, index 568 ms: 9 candidates, 87406 repo-hours, 253 releases; waiting 545 ms; commit 1158 ms)
2026-11-07T06:31:15Z [load_day 2026-05-13] 2026-05-13 hour 4: 152067 events in 4 files, snapshot 9005562633526230177 (task 5044 ms: download 1629 ms overlapping gunzip 308 ms, parse 1015 ms, sort 122 ms, write 2297 ms, index 470 ms: 7 candidates, 75371 repo-hours, 526 releases; waiting 509 ms; commit 1200 ms)
2026-11-07T06:31:16Z [load_day 2026-05-13] 2026-05-13 hour 5: 151173 events in 4 files, snapshot 6542329260863619427 (task 4574 ms: download 1373 ms overlapping gunzip 309 ms, parse 1032 ms, sort 132 ms, write 1913 ms, index 485 ms: 6 candidates, 74832 repo-hours, 490 releases; waiting 384 ms; commit 1156 ms)
2026-11-07T06:31:20Z [load_day 2026-05-13] 2026-05-13 hour 6: 151232 events in 4 files, snapshot 5558947594558458491 (task 4674 ms: download 1445 ms overlapping gunzip 266 ms, parse 863 ms, sort 109 ms, write 2059 ms, index 518 ms: 7 candidates, 81040 repo-hours, 351 releases; waiting 578 ms; commit 1041 ms)
2026-11-07T06:31:21Z [load_day 2026-05-13] 2026-05-13 hour 7: 153189 events in 4 files, snapshot 409416447850761154 (task 4453 ms: download 1438 ms overlapping gunzip 261 ms, parse 868 ms, sort 108 ms, write 1863 ms, index 558 ms: 6 candidates, 82662 repo-hours, 186 releases; waiting 540 ms; commit 1229 ms)
2026-11-07T06:31:25Z [load_day 2026-05-13] 2026-05-13 hour 8: 147348 events in 3 files, snapshot 2261292210161444642 (task 3914 ms: download 1079 ms overlapping gunzip 225 ms, parse 792 ms, sort 110 ms, write 1563 ms, index 563 ms: 5 candidates, 82830 repo-hours, 154 releases; waiting 353 ms; commit 995 ms)
2026-11-07T06:31:26Z [load_day 2026-05-13] 2026-05-13 hour 9: 145511 events in 3 files, snapshot 5741137295992584315 (task 4222 ms: download 1427 ms overlapping gunzip 260 ms, parse 885 ms, sort 95 ms, write 1606 ms, index 515 ms: 5 candidates, 80960 repo-hours, 201 releases; waiting 523 ms; commit 1129 ms)
2026-11-07T06:31:30Z [load_day 2026-05-13] 2026-05-13 hour 10: 148903 events in 3 files, snapshot 6895478828595642008 (task 4191 ms: download 1360 ms overlapping gunzip 227 ms, parse 787 ms, sort 102 ms, write 1596 ms, index 542 ms: 2 candidates, 80877 repo-hours, 202 releases; waiting 604 ms; commit 1221 ms)
2026-11-07T06:31:31Z [load_day 2026-05-13] 2026-05-13 hour 11: 149381 events in 3 files, snapshot 1050506387277244813 (task 4077 ms: download 1404 ms overlapping gunzip 242 ms, parse 861 ms, sort 99 ms, write 1482 ms, index 521 ms: 8 candidates, 80271 repo-hours, 197 releases; waiting 529 ms; commit 1128 ms)
2026-11-07T06:31:34Z [load_day 2026-05-13] 2026-05-13 hour 12: 144563 events in 3 files, snapshot 9163089298763472124 (task 3928 ms: download 1324 ms overlapping gunzip 227 ms, parse 780 ms, sort 109 ms, write 1531 ms, index 517 ms: 4 candidates, 80567 repo-hours, 153 releases; waiting 533 ms; commit 1112 ms)
2026-11-07T06:31:36Z [load_day 2026-05-13] 2026-05-13 hour 13: 146148 events in 3 files, snapshot 6247236297100372984 (task 3895 ms: download 1394 ms overlapping gunzip 230 ms, parse 794 ms, sort 101 ms, write 1304 ms, index 546 ms: 10 candidates, 83762 repo-hours, 133 releases; waiting 546 ms; commit 1229 ms)
2026-11-07T06:31:40Z [load_day 2026-05-13] 2026-05-13 hour 14: 153459 events in 4 files, snapshot 7507930532729460873 (task 4305 ms: download 1426 ms overlapping gunzip 217 ms, parse 796 ms, sort 111 ms, write 1641 ms, index 686 ms: 6 candidates, 94913 repo-hours, 67 releases; waiting 525 ms; commit 1278 ms)
2026-11-07T06:31:41Z [load_day 2026-05-13] 2026-05-13 hour 15: 138045 events in 3 files, snapshot 2879840802751738465 (task 3426 ms: download 961 ms overlapping gunzip 187 ms, parse 677 ms, sort 91 ms, write 1456 ms, index 546 ms: 8 candidates, 75369 repo-hours, 105 releases; waiting 250 ms; commit 1184 ms)
2026-11-07T06:31:43Z [load_day 2026-05-13] 2026-05-13 hour 16: 127045 events in 3 files, snapshot 217746603780788652 (task 3114 ms: download 758 ms overlapping gunzip 173 ms, parse 608 ms, sort 88 ms, write 1285 ms, index 504 ms: 7 candidates, 71078 repo-hours, 72 releases; waiting 225 ms; commit 1248 ms)
2026-11-07T06:31:45Z [load_day 2026-05-13] 2026-05-13 hour 17: 125511 events in 3 files, snapshot 862974082129492322 (task 3399 ms: download 1106 ms overlapping gunzip 173 ms, parse 621 ms, sort 78 ms, write 1226 ms, index 484 ms: 10 candidates, 71734 repo-hours, 63 releases; waiting 525 ms; commit 1174 ms)
2026-11-07T06:31:48Z [load_day 2026-05-13] 2026-05-13 hour 18: 122892 events in 3 files, snapshot 6430176844284773356 (task 3456 ms: download 1187 ms overlapping gunzip 173 ms, parse 629 ms, sort 76 ms, write 1233 ms, index 473 ms: 6 candidates, 69642 repo-hours, 58 releases; waiting 528 ms; commit 1075 ms)
2026-11-07T06:31:51Z [load_day 2026-05-13] 2026-05-13 hour 19: 148600 events in 3 files, snapshot 3124642126999386971 (task 3951 ms: download 1399 ms overlapping gunzip 207 ms, parse 738 ms, sort 100 ms, write 1457 ms, index 601 ms: 7 candidates, 79176 repo-hours, 107 releases; waiting 532 ms; commit 2991 ms)
2026-11-07T06:31:52Z [load_day 2026-05-13] 2026-05-13 hour 20: 155455 events in 4 files, snapshot 2809326612336765318 (task 3931 ms: download 1276 ms overlapping gunzip 230 ms, parse 829 ms, sort 110 ms, write 1595 ms, index 578 ms: 7 candidates, 76736 repo-hours, 166 releases; waiting 382 ms; commit 1039 ms)
2026-11-07T06:31:55Z [load_day 2026-05-13] 2026-05-13 hour 21: 153640 events in 4 files, snapshot 1873758205070243521 (task 4239 ms: download 1824 ms overlapping gunzip 248 ms, parse 837 ms, sort 100 ms, write 1600 ms, index 538 ms: 3 candidates, 75875 repo-hours, 221 releases; waiting 545 ms; commit 1215 ms)
2026-11-07T06:31:58Z [load_day 2026-05-13] 2026-05-13 hour 22: 151699 events in 4 files, snapshot 479665858462769718 (task 4530 ms: download 1169 ms overlapping gunzip 279 ms, parse 954 ms, sort 129 ms, write 2085 ms, index 482 ms: 8 candidates, 74179 repo-hours, 316 releases; waiting 354 ms; commit 1010 ms)
2026-11-07T06:32:00Z [load_day 2026-05-13] 2026-05-13 hour 23: 148956 events in 3 files, snapshot 9016439548115174180 (task 4899 ms: download 1760 ms overlapping gunzip 297 ms, parse 1014 ms, sort 109 ms, write 2027 ms, index 493 ms: 7 candidates, 71967 repo-hours, 499 releases; waiting 532 ms; commit 1032 ms)
2026-11-07T06:32:08Z [load_day 2026-05-13] 2026-05-13: repo_hour merged from 24 files to 1 (1893701 rows, 7594 ms)
2026-11-07T06:32:09Z [load_day 2026-05-13] 2026-05-13: index committed in 9561 ms (24 + 1 + 24 files)
2026-11-07T06:32:09Z [load_day 2026-05-13] 2026-05-13: 3539729 events in 24 hours
2026-11-07T06:32:09Z [load_day 2026-05-13] attempt 1 succeeded