orcaLog in

Runs · run 708

load_day 2026-03-27, attempt 1 succeeded

Host
4e84322b8c45:175462
Started
2026-11-07T13:24:29Z
Ended
2026-11-07T13:26:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/708/load_day/2026-03-27/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T13:24:29Z [load_day 2026-03-27] attempt 1 started
2026-11-07T13:24:40Z [load_day 2026-03-27] 2026-03-27 hour 0: 158834 events in 4 files, snapshot 4053188798141842636 (task 6778 ms: download 2504 ms overlapping gunzip 496 ms, parse 1643 ms, sort 385 ms, write 2875 ms, index 481 ms: 9 candidates, 74513 repo-hours, 1082 releases; waiting 531 ms; commit 1245 ms)
2026-11-07T13:24:41Z [load_day 2026-03-27] 2026-03-27 hour 1: 163065 events in 4 files, snapshot 7026294135267951063 (task 5869 ms: download 1953 ms overlapping gunzip 382 ms, parse 1283 ms, sort 161 ms, write 2480 ms, index 711 ms: 8 candidates, 91779 repo-hours, 325 releases; waiting 598 ms; commit 1264 ms)
2026-11-07T13:24:46Z [load_day 2026-03-27] 2026-03-27 hour 2: 166466 events in 4 files, snapshot 2718547189714908433 (task 5273 ms: download 1721 ms overlapping gunzip 346 ms, parse 1128 ms, sort 161 ms, write 2418 ms, index 654 ms: 8 candidates, 97054 repo-hours, 297 releases; waiting 241 ms; commit 1276 ms)
2026-11-07T13:24:49Z [load_day 2026-03-27] 2026-03-27 hour 3: 152306 events in 4 files, snapshot 6003507087348487472 (task 7400 ms: download 2613 ms overlapping gunzip 559 ms, parse 1776 ms, sort 220 ms, write 3364 ms, index 507 ms: 7 candidates, 74287 repo-hours, 508 releases; waiting 587 ms; commit 1285 ms)
2026-11-07T13:24:56Z [load_day 2026-03-27] 2026-03-27 hour 4: 156560 events in 4 files, snapshot 4771092221196300707 (task 9546 ms: download 2575 ms overlapping gunzip 713 ms, parse 2127 ms, sort 457 ms, write 4777 ms, index 600 ms: 7 candidates, 71371 repo-hours, 488 releases; waiting 237 ms; commit 1148 ms)
2026-11-07T13:25:00Z [load_day 2026-03-27] 2026-03-27 hour 5: 162154 events in 4 files, snapshot 8003431985813424039 (task 10134 ms: download 3517 ms overlapping gunzip 782 ms, parse 2111 ms, sort 222 ms, write 5413 ms, index 502 ms: 5 candidates, 77655 repo-hours, 352 releases; waiting 732 ms; commit 1484 ms)
2026-11-07T13:25:06Z [load_day 2026-03-27] 2026-03-27 hour 6: 159856 events in 4 files, snapshot 251658100099002901 (task 8685 ms: download 3601 ms overlapping gunzip 661 ms, parse 1883 ms, sort 215 ms, write 3023 ms, index 623 ms: 11 candidates, 76936 repo-hours, 383 releases; waiting 1953 ms; commit 1336 ms)
2026-11-07T13:25:09Z [load_day 2026-03-27] 2026-03-27 hour 7: 166689 events in 4 files, snapshot 3971604100833039152 (task 8043 ms: download 3513 ms overlapping gunzip 623 ms, parse 1833 ms, sort 208 ms, write 3384 ms, index 718 ms: 6 candidates, 85149 repo-hours, 281 releases; waiting 953 ms; commit 1153 ms)
2026-11-07T13:25:13Z [load_day 2026-03-27] 2026-03-27 hour 8: 159908 events in 4 files, snapshot 4589939204358379581 (task 6463 ms: download 2600 ms overlapping gunzip 491 ms, parse 1399 ms, sort 146 ms, write 2959 ms, index 581 ms: 10 candidates, 85665 repo-hours, 255 releases; waiting 587 ms; commit 1520 ms)
2026-11-07T13:25:15Z [load_day 2026-03-27] 2026-03-27 hour 9: 162697 events in 4 files, snapshot 921040787197061327 (task 5996 ms: download 2085 ms overlapping gunzip 448 ms, parse 1239 ms, sort 192 ms, write 2406 ms, index 747 ms: 10 candidates, 87867 repo-hours, 223 releases; waiting 610 ms; commit 1329 ms)
2026-11-07T13:25:19Z [load_day 2026-03-27] 2026-03-27 hour 10: 166769 events in 4 files, snapshot 4595679177408823624 (task 5309 ms: download 1693 ms overlapping gunzip 355 ms, parse 1069 ms, sort 168 ms, write 2205 ms, index 691 ms: 10 candidates, 91145 repo-hours, 153 releases; waiting 579 ms; commit 1318 ms)
2026-11-07T13:25:22Z [load_day 2026-03-27] 2026-03-27 hour 11: 164734 events in 4 files, snapshot 8653044470523422467 (task 5712 ms: download 2037 ms overlapping gunzip 391 ms, parse 1257 ms, sort 154 ms, write 2437 ms, index 622 ms: 8 candidates, 88831 repo-hours, 214 releases; waiting 518 ms; commit 1277 ms)
2026-11-07T13:25:24Z [load_day 2026-03-27] 2026-03-27 hour 12: 165339 events in 4 files, snapshot 7893134524623325948 (task 5036 ms: download 1750 ms overlapping gunzip 315 ms, parse 1030 ms, sort 147 ms, write 2040 ms, index 629 ms: 15 candidates, 94060 repo-hours, 134 releases; waiting 555 ms; commit 1355 ms)
2026-11-07T13:25:28Z [load_day 2026-03-27] 2026-03-27 hour 13: 165423 events in 4 files, snapshot 7706157909198992270 (task 4816 ms: download 1826 ms overlapping gunzip 252 ms, parse 877 ms, sort 131 ms, write 1932 ms, index 799 ms: 14 candidates, 103780 repo-hours, 46 releases; waiting 539 ms; commit 1345 ms)
2026-11-07T13:25:30Z [load_day 2026-03-27] 2026-03-27 hour 14: 160592 events in 4 files, snapshot 6667009254158672243 (task 4755 ms: download 2120 ms overlapping gunzip 248 ms, parse 858 ms, sort 132 ms, write 1873 ms, index 712 ms: 11 candidates, 92992 repo-hours, 42 releases; waiting 553 ms; commit 1391 ms)
2026-11-07T13:25:33Z [load_day 2026-03-27] 2026-03-27 hour 15: 158904 events in 4 files, snapshot 4594679769928368859 (task 4801 ms: download 1656 ms overlapping gunzip 266 ms, parse 879 ms, sort 129 ms, write 1849 ms, index 717 ms: 17 candidates, 91076 repo-hours, 73 releases; waiting 630 ms; commit 1318 ms)
2026-11-07T13:25:35Z [load_day 2026-03-27] 2026-03-27 hour 16: 161914 events in 4 files, snapshot 4446191091378318454 (task 4865 ms: download 2254 ms overlapping gunzip 317 ms, parse 1009 ms, sort 137 ms, write 1908 ms, index 623 ms: 16 candidates, 87535 repo-hours, 45 releases; waiting 593 ms; commit 1275 ms)
2026-11-07T13:25:38Z [load_day 2026-03-27] 2026-03-27 hour 17: 164749 events in 4 files, snapshot 4080476906999733537 (task 4260 ms: download 1470 ms overlapping gunzip 214 ms, parse 834 ms, sort 143 ms, write 1569 ms, index 682 ms: 7 candidates, 76437 repo-hours, 33 releases; waiting 523 ms; commit 1243 ms)
2026-11-07T13:25:42Z [load_day 2026-03-27] 2026-03-27 hour 18: 165575 events in 4 files, snapshot 8057457162175698787 (task 5339 ms: download 2057 ms overlapping gunzip 340 ms, parse 1090 ms, sort 147 ms, write 2200 ms, index 729 ms: 14 candidates, 84331 repo-hours, 159 releases; waiting 510 ms; commit 1476 ms)
2026-11-07T13:25:45Z [load_day 2026-03-27] 2026-03-27 hour 19: 165908 events in 4 files, snapshot 8739632950289571167 (task 5094 ms: download 1844 ms overlapping gunzip 293 ms, parse 1073 ms, sort 163 ms, write 2013 ms, index 679 ms: 13 candidates, 79564 repo-hours, 186 releases; waiting 538 ms; commit 1386 ms)
2026-11-07T13:25:48Z [load_day 2026-03-27] 2026-03-27 hour 20: 165125 events in 4 files, snapshot 6353511810318337039 (task 5629 ms: download 1693 ms overlapping gunzip 349 ms, parse 1141 ms, sort 155 ms, write 2400 ms, index 658 ms: 19 candidates, 83626 repo-hours, 311 releases; waiting 571 ms; commit 1424 ms)
2026-11-07T13:25:52Z [load_day 2026-03-27] 2026-03-27 hour 21: 156436 events in 4 files, snapshot 6294020039558748956 (task 6651 ms: download 2850 ms overlapping gunzip 411 ms, parse 1369 ms, sort 156 ms, write 2822 ms, index 546 ms: 11 candidates, 78067 repo-hours, 513 releases; waiting 1041 ms; commit 1174 ms)
2026-11-07T13:25:56Z [load_day 2026-03-27] 2026-03-27 hour 22: 156037 events in 4 files, snapshot 7887140560639530433 (task 7450 ms: download 2618 ms overlapping gunzip 480 ms, parse 1517 ms, sort 226 ms, write 3487 ms, index 586 ms: 26 candidates, 75488 repo-hours, 671 releases; waiting 790 ms; commit 1393 ms)
2026-11-07T13:26:00Z [load_day 2026-03-27] 2026-03-27 hour 23: 155201 events in 4 files, snapshot 115133521887939676 (task 7364 ms: download 2699 ms overlapping gunzip 552 ms, parse 1794 ms, sort 175 ms, write 3468 ms, index 470 ms: 16 candidates, 71960 repo-hours, 973 releases; waiting 556 ms; commit 1260 ms)
2026-11-07T13:26:08Z [load_day 2026-03-27] 2026-03-27: repo_hour merged from 24 files to 1 (2021168 rows, 8087 ms)
2026-11-07T13:26:10Z [load_day 2026-03-27] 2026-03-27: index committed in 9695 ms (24 + 1 + 24 files)
2026-11-07T13:26:10Z [load_day 2026-03-27] 2026-03-27: 3881241 events in 24 hours
2026-11-07T13:26:10Z [load_day 2026-03-27] attempt 1 succeeded