orcaLog in

Runs · run 672

load_day 2026-04-08, attempt 1 succeeded

Host
4e84322b8c45:165141
Started
2026-11-07T13:03:35Z
Ended
2026-11-07T13:05:06Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/672/load_day/2026-04-08/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T13:03:35Z [load_day 2026-04-08] attempt 1 started
2026-11-07T13:03:44Z [load_day 2026-04-08] 2026-04-08 hour 0: 151066 events in 4 files, snapshot 279064137619887096 (task 6228 ms: download 2384 ms overlapping gunzip 485 ms, parse 1648 ms, sort 174 ms, write 2469 ms, index 479 ms: 7 candidates, 71338 repo-hours, 757 releases; waiting 615 ms; commit 1181 ms)
2026-11-07T13:03:45Z [load_day 2026-04-08] 2026-04-08 hour 1: 154857 events in 4 files, snapshot 8135185911538798997 (task 5799 ms: download 1347 ms overlapping gunzip 447 ms, parse 1447 ms, sort 165 ms, write 2657 ms, index 620 ms: 8 candidates, 88145 repo-hours, 681 releases; waiting 216 ms; commit 1065 ms)
2026-11-07T13:03:51Z [load_day 2026-04-08] 2026-04-08 hour 2: 155583 events in 4 files, snapshot 4260144290339130521 (task 6097 ms: download 1753 ms overlapping gunzip 360 ms, parse 1200 ms, sort 155 ms, write 2898 ms, index 602 ms: 7 candidates, 89386 repo-hours, 670 releases; waiting 569 ms; commit 1113 ms)
2026-11-07T13:03:52Z [load_day 2026-04-08] 2026-04-08 hour 3: 151830 events in 4 files, snapshot 5102821709976245393 (task 6014 ms: download 1801 ms overlapping gunzip 352 ms, parse 1247 ms, sort 156 ms, write 2800 ms, index 513 ms: 9 candidates, 73796 repo-hours, 602 releases; waiting 546 ms; commit 1130 ms)
2026-11-07T13:03:58Z [load_day 2026-04-08] 2026-04-08 hour 4: 152952 events in 4 files, snapshot 8460762321257860628 (task 6638 ms: download 2038 ms overlapping gunzip 437 ms, parse 1488 ms, sort 159 ms, write 3059 ms, index 526 ms: 9 candidates, 75106 repo-hours, 638 releases; waiting 637 ms; commit 1180 ms)
2026-11-07T13:03:59Z [load_day 2026-04-08] 2026-04-08 hour 5: 151085 events in 4 files, snapshot 9219937799427492391 (task 5805 ms: download 1449 ms overlapping gunzip 453 ms, parse 1455 ms, sort 134 ms, write 2619 ms, index 514 ms: 8 candidates, 76944 repo-hours, 629 releases; waiting 262 ms; commit 1190 ms)
2026-11-07T13:04:05Z [load_day 2026-04-08] 2026-04-08 hour 6: 151495 events in 4 files, snapshot 1938238596418753846 (task 6160 ms: download 2200 ms overlapping gunzip 458 ms, parse 1498 ms, sort 141 ms, write 2518 ms, index 673 ms: 9 candidates, 81601 repo-hours, 589 releases; waiting 547 ms; commit 1243 ms)
2026-11-07T13:04:06Z [load_day 2026-04-08] 2026-04-08 hour 7: 153383 events in 4 files, snapshot 5346303127592871547 (task 5661 ms: download 1846 ms overlapping gunzip 366 ms, parse 1187 ms, sort 154 ms, write 2484 ms, index 539 ms: 14 candidates, 86688 repo-hours, 519 releases; waiting 606 ms; commit 1461 ms)
2026-11-07T13:04:11Z [load_day 2026-04-08] 2026-04-08 hour 8: 151436 events in 4 files, snapshot 7677305373270911983 (task 5397 ms: download 1826 ms overlapping gunzip 330 ms, parse 1115 ms, sort 188 ms, write 2414 ms, index 544 ms: 7 candidates, 84609 repo-hours, 463 releases; waiting 550 ms; commit 1171 ms)
2026-11-07T13:04:12Z [load_day 2026-04-08] 2026-04-08 hour 9: 156833 events in 4 files, snapshot 4222075237474021677 (task 5317 ms: download 1835 ms overlapping gunzip 313 ms, parse 1017 ms, sort 118 ms, write 2316 ms, index 563 ms: 10 candidates, 87761 repo-hours, 417 releases; waiting 666 ms; commit 1142 ms)
2026-11-07T13:04:17Z [load_day 2026-04-08] 2026-04-08 hour 10: 155224 events in 4 files, snapshot 7594669017293706984 (task 5501 ms: download 1680 ms overlapping gunzip 373 ms, parse 1267 ms, sort 144 ms, write 2296 ms, index 588 ms: 5 candidates, 84493 repo-hours, 493 releases; waiting 502 ms; commit 1163 ms)
2026-11-07T13:04:18Z [load_day 2026-04-08] 2026-04-08 hour 11: 154906 events in 4 files, snapshot 8730628304718394671 (task 5484 ms: download 1933 ms overlapping gunzip 329 ms, parse 1093 ms, sort 132 ms, write 2380 ms, index 585 ms: 12 candidates, 84956 repo-hours, 481 releases; waiting 662 ms; commit 1030 ms)
2026-11-07T13:04:24Z [load_day 2026-04-08] 2026-04-08 hour 12: 157365 events in 4 files, snapshot 1647992543840106213 (task 5603 ms: download 1823 ms overlapping gunzip 336 ms, parse 1115 ms, sort 132 ms, write 2518 ms, index 653 ms: 10 candidates, 88755 repo-hours, 448 releases; waiting 537 ms; commit 1203 ms)
2026-11-07T13:04:25Z [load_day 2026-04-08] 2026-04-08 hour 13: 159350 events in 4 files, snapshot 6578090648368123744 (task 5396 ms: download 1603 ms overlapping gunzip 283 ms, parse 964 ms, sort 145 ms, write 2385 ms, index 679 ms: 13 candidates, 97959 repo-hours, 224 releases; waiting 557 ms; commit 1313 ms)
2026-11-07T13:04:29Z [load_day 2026-04-08] 2026-04-08 hour 14: 152906 events in 4 files, snapshot 7123263080320260364 (task 4383 ms: download 1588 ms overlapping gunzip 280 ms, parse 970 ms, sort 109 ms, write 1874 ms, index 608 ms: 11 candidates, 89333 repo-hours, 301 releases; waiting 212 ms; commit 1297 ms)
2026-11-07T13:04:31Z [load_day 2026-04-08] 2026-04-08 hour 15: 155073 events in 4 files, snapshot 1800837447229280189 (task 5047 ms: download 1687 ms overlapping gunzip 298 ms, parse 1022 ms, sort 127 ms, write 2130 ms, index 697 ms: 10 candidates, 90146 repo-hours, 327 releases; waiting 420 ms; commit 1287 ms)
2026-11-07T13:04:35Z [load_day 2026-04-08] 2026-04-08 hour 16: 154951 events in 4 files, snapshot 8633632779979188937 (task 5359 ms: download 2306 ms overlapping gunzip 329 ms, parse 1082 ms, sort 163 ms, write 2289 ms, index 556 ms: 8 candidates, 87092 repo-hours, 347 releases; waiting 588 ms; commit 1339 ms)
2026-11-07T13:04:37Z [load_day 2026-04-08] 2026-04-08 hour 17: 156277 events in 4 files, snapshot 3179358118906695281 (task 5458 ms: download 1876 ms overlapping gunzip 326 ms, parse 1089 ms, sort 132 ms, write 2351 ms, index 679 ms: 12 candidates, 87356 repo-hours, 373 releases; waiting 578 ms; commit 1356 ms)
2026-11-07T13:04:41Z [load_day 2026-04-08] 2026-04-08 hour 18: 158058 events in 4 files, snapshot 5451190603987157045 (task 5620 ms: download 1864 ms overlapping gunzip 359 ms, parse 1203 ms, sort 174 ms, write 2472 ms, index 547 ms: 12 candidates, 84523 repo-hours, 348 releases; waiting 536 ms; commit 1360 ms)
2026-11-07T13:04:43Z [load_day 2026-04-08] 2026-04-08 hour 19: 157092 events in 4 files, snapshot 1163792595177455683 (task 5458 ms: download 1868 ms overlapping gunzip 334 ms, parse 1090 ms, sort 122 ms, write 2459 ms, index 584 ms: 6 candidates, 85611 repo-hours, 399 releases; waiting 533 ms; commit 1269 ms)
2026-11-07T13:04:47Z [load_day 2026-04-08] 2026-04-08 hour 20: 160206 events in 4 files, snapshot 4888458193024115896 (task 5198 ms: download 1251 ms overlapping gunzip 320 ms, parse 1043 ms, sort 136 ms, write 2359 ms, index 549 ms: 6 candidates, 79719 repo-hours, 394 releases; waiting 248 ms; commit 1153 ms)
2026-11-07T13:04:50Z [load_day 2026-04-08] 2026-04-08 hour 21: 159414 events in 4 files, snapshot 703340698298917601 (task 5561 ms: download 1837 ms overlapping gunzip 369 ms, parse 1201 ms, sort 139 ms, write 2404 ms, index 573 ms: 14 candidates, 78533 repo-hours, 520 releases; waiting 536 ms; commit 1373 ms)
2026-11-07T13:04:54Z [load_day 2026-04-08] 2026-04-08 hour 22: 156414 events in 4 files, snapshot 8068902168535979625 (task 6076 ms: download 1909 ms overlapping gunzip 400 ms, parse 1340 ms, sort 126 ms, write 2778 ms, index 486 ms: 6 candidates, 74910 repo-hours, 648 releases; waiting 600 ms; commit 1273 ms)
2026-11-07T13:04:56Z [load_day 2026-04-08] 2026-04-08 hour 23: 151265 events in 4 files, snapshot 1527050395586989732 (task 5877 ms: download 2442 ms overlapping gunzip 390 ms, parse 1317 ms, sort 124 ms, write 2643 ms, index 475 ms: 10 candidates, 75733 repo-hours, 707 releases; waiting 624 ms; commit 1061 ms)
2026-11-07T13:05:04Z [load_day 2026-04-08] 2026-04-08: repo_hour merged from 24 files to 1 (2004493 rows, 8335 ms)
2026-11-07T13:05:06Z [load_day 2026-04-08] 2026-04-08: index committed in 10367 ms (24 + 1 + 24 files)
2026-11-07T13:05:06Z [load_day 2026-04-08] 2026-04-08: 3719021 events in 24 hours
2026-11-07T13:05:06Z [load_day 2026-04-08] attempt 1 succeeded