orcaLog in

Runs · run 461

load_day 2026-06-17, attempt 1 succeeded

Host
4e84322b8c45:97457
Started
2026-11-07T05:45:39Z
Ended
2026-11-07T05:46:48Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/461/load_day/2026-06-17/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:45:39Z [load_day 2026-06-17] attempt 1 started
2026-11-07T05:45:47Z [load_day 2026-06-17] 2026-06-17 hour 0: 160294 events in 4 files, snapshot 1011549666250907307 (task 4646 ms: download 1889 ms overlapping gunzip 251 ms, parse 915 ms, sort 129 ms, write 1925 ms, index 450 ms: 7 candidates, 67962 repo-hours, 211 releases; waiting 546 ms; commit 1078 ms)
2026-11-07T05:45:48Z [load_day 2026-06-17] 2026-06-17 hour 1: 158169 events in 4 files, snapshot 1596494295336418795 (task 4557 ms: download 1635 ms overlapping gunzip 277 ms, parse 1016 ms, sort 139 ms, write 1910 ms, index 396 ms: 11 candidates, 63860 repo-hours, 258 releases; waiting 497 ms; commit 1066 ms)
2026-11-07T05:45:52Z [load_day 2026-06-17] 2026-06-17 hour 2: 159450 events in 4 files, snapshot 8907069387943291081 (task 4098 ms: download 1465 ms overlapping gunzip 230 ms, parse 799 ms, sort 105 ms, write 1643 ms, index 489 ms: 6 candidates, 76656 repo-hours, 73 releases; waiting 524 ms; commit 1090 ms)
2026-11-07T05:45:53Z [load_day 2026-06-17] 2026-06-17 hour 3: 157091 events in 4 files, snapshot 7397842986919777155 (task 4155 ms: download 1398 ms overlapping gunzip 226 ms, parse 820 ms, sort 109 ms, write 1653 ms, index 483 ms: 11 candidates, 73280 repo-hours, 153 releases; waiting 552 ms; commit 1013 ms)
2026-11-07T05:45:56Z [load_day 2026-06-17] 2026-06-17 hour 4: 167397 events in 4 files, snapshot 8927583028994002088 (task 3835 ms: download 1096 ms overlapping gunzip 214 ms, parse 814 ms, sort 107 ms, write 1622 ms, index 510 ms: 8 candidates, 79444 repo-hours, 70 releases; waiting 277 ms; commit 837 ms)
2026-11-07T05:45:57Z [load_day 2026-06-17] 2026-06-17 hour 5: 165109 events in 4 files, snapshot 4884689220043537132 (task 3887 ms: download 1620 ms overlapping gunzip 216 ms, parse 806 ms, sort 112 ms, write 1687 ms, index 438 ms: 4 candidates, 67918 repo-hours, 74 releases; waiting 288 ms; commit 838 ms)
2026-11-07T05:46:01Z [load_day 2026-06-17] 2026-06-17 hour 6: 161124 events in 4 files, snapshot 3893052030365210330 (task 3916 ms: download 1198 ms overlapping gunzip 207 ms, parse 766 ms, sort 101 ms, write 1582 ms, index 477 ms: 9 candidates, 71185 repo-hours, 41 releases; waiting 518 ms; commit 899 ms)
2026-11-07T05:46:02Z [load_day 2026-06-17] 2026-06-17 hour 7: 162234 events in 4 files, snapshot 4759054389855901286 (task 3807 ms: download 1215 ms overlapping gunzip 207 ms, parse 743 ms, sort 102 ms, write 1451 ms, index 515 ms: 5 candidates, 71074 repo-hours, 22 releases; waiting 526 ms; commit 849 ms)
2026-11-07T05:46:06Z [load_day 2026-06-17] 2026-06-17 hour 8: 166594 events in 4 files, snapshot 6666574650396241821 (task 4035 ms: download 1362 ms overlapping gunzip 217 ms, parse 804 ms, sort 107 ms, write 1547 ms, index 534 ms: 7 candidates, 75168 repo-hours, 51 releases; waiting 529 ms; commit 1084 ms)
2026-11-07T05:46:07Z [load_day 2026-06-17] 2026-06-17 hour 9: 162442 events in 4 files, snapshot 1466290204013723867 (task 3926 ms: download 1341 ms overlapping gunzip 213 ms, parse 805 ms, sort 105 ms, write 1487 ms, index 484 ms: 5 candidates, 74451 repo-hours, 37 releases; waiting 521 ms; commit 1093 ms)
2026-11-07T05:46:10Z [load_day 2026-06-17] 2026-06-17 hour 10: 156013 events in 4 files, snapshot 716762515690702551 (task 4051 ms: download 1442 ms overlapping gunzip 210 ms, parse 788 ms, sort 116 ms, write 1533 ms, index 540 ms: 5 candidates, 73655 repo-hours, 42 releases; waiting 529 ms; commit 933 ms)
2026-11-07T05:46:11Z [load_day 2026-06-17] 2026-06-17 hour 11: 160304 events in 4 files, snapshot 6864224975754236411 (task 4024 ms: download 1674 ms overlapping gunzip 199 ms, parse 740 ms, sort 100 ms, write 1504 ms, index 582 ms: 6 candidates, 77957 repo-hours, 43 releases; waiting 552 ms; commit 1031 ms)
2026-11-07T05:46:15Z [load_day 2026-06-17] 2026-06-17 hour 12: 160314 events in 4 files, snapshot 1143753507075951082 (task 3993 ms: download 1280 ms overlapping gunzip 206 ms, parse 769 ms, sort 103 ms, write 1452 ms, index 600 ms: 8 candidates, 75183 repo-hours, 32 releases; waiting 516 ms; commit 1030 ms)
2026-11-07T05:46:16Z [load_day 2026-06-17] 2026-06-17 hour 13: 157929 events in 4 files, snapshot 7245403900635274620 (task 3910 ms: download 1731 ms overlapping gunzip 212 ms, parse 759 ms, sort 106 ms, write 1441 ms, index 531 ms: 10 candidates, 79031 repo-hours, 28 releases; waiting 555 ms; commit 968 ms)
2026-11-07T05:46:19Z [load_day 2026-06-17] 2026-06-17 hour 14: 157401 events in 4 files, snapshot 8030222819687203306 (task 3907 ms: download 1227 ms overlapping gunzip 197 ms, parse 757 ms, sort 112 ms, write 1507 ms, index 527 ms: 5 candidates, 78747 repo-hours, 27 releases; waiting 525 ms; commit 1055 ms)
2026-11-07T05:46:20Z [load_day 2026-06-17] 2026-06-17 hour 15: 158424 events in 4 files, snapshot 4887690797090295228 (task 3887 ms: download 1273 ms overlapping gunzip 194 ms, parse 727 ms, sort 106 ms, write 1505 ms, index 530 ms: 6 candidates, 79886 repo-hours, 16 releases; waiting 530 ms; commit 841 ms)
2026-11-07T05:46:24Z [load_day 2026-06-17] 2026-06-17 hour 16: 158959 events in 4 files, snapshot 2078933434464031640 (task 3984 ms: download 1287 ms overlapping gunzip 207 ms, parse 754 ms, sort 99 ms, write 1523 ms, index 537 ms: 9 candidates, 74557 repo-hours, 22 releases; waiting 537 ms; commit 1041 ms)
2026-11-07T05:46:25Z [load_day 2026-06-17] 2026-06-17 hour 17: 159727 events in 4 files, snapshot 3955829203922831493 (task 3978 ms: download 1422 ms overlapping gunzip 191 ms, parse 753 ms, sort 129 ms, write 1523 ms, index 529 ms: 7 candidates, 71593 repo-hours, 10 releases; waiting 540 ms; commit 932 ms)
2026-11-07T05:46:29Z [load_day 2026-06-17] 2026-06-17 hour 18: 160393 events in 4 files, snapshot 8361934905337847771 (task 3830 ms: download 1038 ms overlapping gunzip 210 ms, parse 778 ms, sort 111 ms, write 1520 ms, index 506 ms: 4 candidates, 69493 repo-hours, 41 releases; waiting 264 ms; commit 1132 ms)
2026-11-07T05:46:30Z [load_day 2026-06-17] 2026-06-17 hour 19: 160976 events in 4 files, snapshot 6801259453805237691 (task 3848 ms: download 2019 ms overlapping gunzip 202 ms, parse 750 ms, sort 107 ms, write 1486 ms, index 487 ms: 11 candidates, 70773 repo-hours, 43 releases; waiting 520 ms; commit 1027 ms)
2026-11-07T05:46:33Z [load_day 2026-06-17] 2026-06-17 hour 20: 159891 events in 4 files, snapshot 7430433808963196672 (task 3685 ms: download 1722 ms overlapping gunzip 205 ms, parse 753 ms, sort 106 ms, write 1401 ms, index 468 ms: 6 candidates, 70680 repo-hours, 45 releases; waiting 529 ms; commit 1088 ms)
2026-11-07T05:46:35Z [load_day 2026-06-17] 2026-06-17 hour 21: 164746 events in 4 files, snapshot 7459548699154579482 (task 3918 ms: download 1674 ms overlapping gunzip 211 ms, parse 784 ms, sort 102 ms, write 1511 ms, index 459 ms: 8 candidates, 69032 repo-hours, 39 releases; waiting 542 ms; commit 1081 ms)
2026-11-07T05:46:38Z [load_day 2026-06-17] 2026-06-17 hour 22: 157188 events in 4 files, snapshot 4407606780699282979 (task 4261 ms: download 1413 ms overlapping gunzip 229 ms, parse 807 ms, sort 105 ms, write 1815 ms, index 433 ms: 5 candidates, 64435 repo-hours, 83 releases; waiting 531 ms; commit 1106 ms)
2026-11-07T05:46:39Z [load_day 2026-06-17] 2026-06-17 hour 23: 159460 events in 4 files, snapshot 3439620601827289168 (task 3738 ms: download 822 ms overlapping gunzip 216 ms, parse 799 ms, sort 108 ms, write 1720 ms, index 409 ms: 8 candidates, 64255 repo-hours, 83 releases; waiting 210 ms; commit 1023 ms)
2026-11-07T05:46:47Z [load_day 2026-06-17] 2026-06-17: repo_hour merged from 24 files to 1 (1740275 rows, 7311 ms)
2026-11-07T05:46:48Z [load_day 2026-06-17] 2026-06-17: index committed in 8986 ms (24 + 1 + 24 files)
2026-11-07T05:46:48Z [load_day 2026-06-17] 2026-06-17: 3851629 events in 24 hours
2026-11-07T05:46:48Z [load_day 2026-06-17] attempt 1 succeeded