orcaLog in

Runs · run 431

load_day 2026-06-27, attempt 1 succeeded

Host
4e84322b8c45:88861
Started
2026-11-07T05:32:12Z
Ended
2026-11-07T05:33:27Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/431/load_day/2026-06-27/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:32:12Z [load_day 2026-06-27] attempt 1 started
2026-11-07T05:32:23Z [load_day 2026-06-27] 2026-06-27 hour 0: 154107 events in 4 files, snapshot 3753663126369596691 (task 4705 ms: download 1336 ms overlapping gunzip 290 ms, parse 1044 ms, sort 135 ms, write 2263 ms, index 395 ms: 4 candidates, 62552 repo-hours, 464 releases; waiting 264 ms; commit 837 ms)
2026-11-07T05:32:24Z [load_day 2026-06-27] 2026-06-27 hour 1: 150307 events in 4 files, snapshot 8704001936712539777 (task 4452 ms: download 1562 ms overlapping gunzip 288 ms, parse 1045 ms, sort 142 ms, write 1705 ms, index 451 ms: 8 candidates, 63694 repo-hours, 334 releases; waiting 515 ms; commit 975 ms)
2026-11-07T05:32:28Z [load_day 2026-06-27] 2026-06-27 hour 2: 160015 events in 4 files, snapshot 7270107634962686593 (task 4309 ms: download 1348 ms overlapping gunzip 227 ms, parse 807 ms, sort 110 ms, write 1858 ms, index 482 ms: 5 candidates, 77105 repo-hours, 188 releases; waiting 532 ms; commit 1097 ms)
2026-11-07T05:32:29Z [load_day 2026-06-27] 2026-06-27 hour 3: 157134 events in 4 files, snapshot 5248773442588186153 (task 4350 ms: download 1498 ms overlapping gunzip 229 ms, parse 822 ms, sort 110 ms, write 1890 ms, index 473 ms: 4 candidates, 70010 repo-hours, 221 releases; waiting 534 ms; commit 923 ms)
2026-11-07T05:32:33Z [load_day 2026-06-27] 2026-06-27 hour 4: 154439 events in 4 files, snapshot 7178424541305523322 (task 4372 ms: download 1422 ms overlapping gunzip 284 ms, parse 930 ms, sort 129 ms, write 1850 ms, index 448 ms: 4 candidates, 68231 repo-hours, 341 releases; waiting 520 ms; commit 1094 ms)
2026-11-07T05:32:34Z [load_day 2026-06-27] 2026-06-27 hour 5: 157972 events in 4 files, snapshot 3501641342630747518 (task 4265 ms: download 1382 ms overlapping gunzip 274 ms, parse 976 ms, sort 119 ms, write 1683 ms, index 393 ms: 2 candidates, 62260 repo-hours, 299 releases; waiting 536 ms; commit 990 ms)
2026-11-07T05:32:38Z [load_day 2026-06-27] 2026-06-27 hour 6: 158889 events in 4 files, snapshot 3426432729948119025 (task 4022 ms: download 1270 ms overlapping gunzip 242 ms, parse 846 ms, sort 117 ms, write 1600 ms, index 442 ms: 3 candidates, 67340 repo-hours, 162 releases; waiting 543 ms; commit 1088 ms)
2026-11-07T05:32:39Z [load_day 2026-06-27] 2026-06-27 hour 7: 158212 events in 4 files, snapshot 6695736224600251024 (task 4208 ms: download 1394 ms overlapping gunzip 251 ms, parse 919 ms, sort 145 ms, write 1663 ms, index 443 ms: 8 candidates, 67800 repo-hours, 266 releases; waiting 514 ms; commit 902 ms)
2026-11-07T05:32:43Z [load_day 2026-06-27] 2026-06-27 hour 8: 162200 events in 4 files, snapshot 2650816174187397370 (task 4452 ms: download 1415 ms overlapping gunzip 255 ms, parse 911 ms, sort 136 ms, write 1867 ms, index 487 ms: 9 candidates, 72901 repo-hours, 151 releases; waiting 526 ms; commit 990 ms)
2026-11-07T05:32:44Z [load_day 2026-06-27] 2026-06-27 hour 9: 163964 events in 4 files, snapshot 7546815482253066312 (task 4224 ms: download 1393 ms overlapping gunzip 225 ms, parse 820 ms, sort 114 ms, write 1909 ms, index 518 ms: 8 candidates, 70547 repo-hours, 135 releases; waiting 344 ms; commit 1058 ms)
2026-11-07T05:32:49Z [load_day 2026-06-27] 2026-06-27 hour 10: 163729 events in 4 files, snapshot 5503380798935929276 (task 4286 ms: download 1399 ms overlapping gunzip 234 ms, parse 855 ms, sort 115 ms, write 1776 ms, index 494 ms: 6 candidates, 72996 repo-hours, 150 releases; waiting 528 ms; commit 2237 ms)
2026-11-07T05:32:50Z [load_day 2026-06-27] 2026-06-27 hour 11: 163857 events in 4 files, snapshot 1129588719536664906 (task 4100 ms: download 1242 ms overlapping gunzip 220 ms, parse 816 ms, sort 114 ms, write 1678 ms, index 496 ms: 5 candidates, 73391 repo-hours, 103 releases; waiting 533 ms; commit 1020 ms)
2026-11-07T05:32:53Z [load_day 2026-06-27] 2026-06-27 hour 12: 163799 events in 4 files, snapshot 1242642102594804485 (task 4823 ms: download 1197 ms overlapping gunzip 211 ms, parse 783 ms, sort 99 ms, write 1937 ms, index 1002 ms: 5 candidates, 73947 repo-hours, 71 releases; waiting 524 ms; commit 1044 ms)
2026-11-07T05:32:55Z [load_day 2026-06-27] 2026-06-27 hour 13: 161369 events in 4 files, snapshot 6164969733665932152 (task 4039 ms: download 1205 ms overlapping gunzip 197 ms, parse 771 ms, sort 98 ms, write 1397 ms, index 582 ms: 8 candidates, 85911 repo-hours, 15 releases; waiting 509 ms; commit 820 ms)
2026-11-07T05:32:58Z [load_day 2026-06-27] 2026-06-27 hour 14: 166352 events in 4 files, snapshot 3782677206327179349 (task 4122 ms: download 1553 ms overlapping gunzip 214 ms, parse 819 ms, sort 121 ms, write 1585 ms, index 521 ms: 7 candidates, 72436 repo-hours, 32 releases; waiting 520 ms; commit 1197 ms)
2026-11-07T05:32:59Z [load_day 2026-06-27] 2026-06-27 hour 15: 164356 events in 4 files, snapshot 7269343599966305406 (task 4042 ms: download 1271 ms overlapping gunzip 203 ms, parse 767 ms, sort 110 ms, write 1607 ms, index 529 ms: 12 candidates, 73688 repo-hours, 40 releases; waiting 525 ms; commit 983 ms)
2026-11-07T05:33:03Z [load_day 2026-06-27] 2026-06-27 hour 16: 160844 events in 4 files, snapshot 612515855295720689 (task 4093 ms: download 1252 ms overlapping gunzip 210 ms, parse 794 ms, sort 129 ms, write 1447 ms, index 562 ms: 2 candidates, 75551 repo-hours, 58 releases; waiting 504 ms; commit 1036 ms)
2026-11-07T05:33:04Z [load_day 2026-06-27] 2026-06-27 hour 17: 164520 events in 4 files, snapshot 8588263375804836966 (task 4067 ms: download 1520 ms overlapping gunzip 201 ms, parse 770 ms, sort 114 ms, write 1534 ms, index 574 ms: 7 candidates, 72776 repo-hours, 56 releases; waiting 562 ms; commit 1080 ms)
2026-11-07T05:33:07Z [load_day 2026-06-27] 2026-06-27 hour 18: 166047 events in 4 files, snapshot 3688674978225914042 (task 3953 ms: download 1194 ms overlapping gunzip 205 ms, parse 780 ms, sort 105 ms, write 1532 ms, index 499 ms: 11 candidates, 69426 repo-hours, 53 releases; waiting 503 ms; commit 988 ms)
2026-11-07T05:33:09Z [load_day 2026-06-27] 2026-06-27 hour 19: 161802 events in 4 files, snapshot 6320356727832671689 (task 4138 ms: download 1456 ms overlapping gunzip 203 ms, parse 771 ms, sort 105 ms, write 1711 ms, index 489 ms: 12 candidates, 70940 repo-hours, 59 releases; waiting 550 ms; commit 1025 ms)
2026-11-07T05:33:12Z [load_day 2026-06-27] 2026-06-27 hour 20: 165782 events in 4 files, snapshot 1078858331778473165 (task 4259 ms: download 1373 ms overlapping gunzip 235 ms, parse 887 ms, sort 104 ms, write 1740 ms, index 545 ms: 7 candidates, 67736 repo-hours, 194 releases; waiting 521 ms; commit 1033 ms)
2026-11-07T05:33:13Z [load_day 2026-06-27] 2026-06-27 hour 21: 163675 events in 4 files, snapshot 4268765905473119224 (task 3866 ms: download 1232 ms overlapping gunzip 222 ms, parse 807 ms, sort 103 ms, write 1615 ms, index 392 ms: 8 candidates, 62062 repo-hours, 116 releases; waiting 513 ms; commit 1034 ms)
2026-11-07T05:33:17Z [load_day 2026-06-27] 2026-06-27 hour 22: 161600 events in 4 files, snapshot 1265286089041701477 (task 4349 ms: download 1485 ms overlapping gunzip 265 ms, parse 943 ms, sort 115 ms, write 1837 ms, index 382 ms: 4 candidates, 62540 repo-hours, 272 releases; waiting 515 ms; commit 1013 ms)
2026-11-07T05:33:18Z [load_day 2026-06-27] 2026-06-27 hour 23: 163733 events in 4 files, snapshot 2083005733007041097 (task 4503 ms: download 1672 ms overlapping gunzip 291 ms, parse 1004 ms, sort 116 ms, write 1871 ms, index 392 ms: 2 candidates, 60981 repo-hours, 337 releases; waiting 508 ms; commit 1066 ms)
2026-11-07T05:33:25Z [load_day 2026-06-27] 2026-06-27: repo_hour merged from 24 files to 1 (1676821 rows, 6604 ms)
2026-11-07T05:33:27Z [load_day 2026-06-27] 2026-06-27: index committed in 8232 ms (24 + 1 + 24 files)
2026-11-07T05:33:27Z [load_day 2026-06-27] 2026-06-27: 3868704 events in 24 hours
2026-11-07T05:33:27Z [load_day 2026-06-27] attempt 1 succeeded