orcaLog in

Runs · run 374

load_day 2026-07-16, attempt 1 succeeded

Host
4e84322b8c45:72431
Started
2026-11-07T05:05:57Z
Ended
2026-11-07T05:07:00Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/374/load_day/2026-07-16/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:05:57Z [load_day 2026-07-16] attempt 1 started
2026-11-07T05:06:04Z [load_day 2026-07-16] 2026-07-16 hour 0: 168599 events in 4 files, snapshot 3744403382464655869 (task 4330 ms: download 1658 ms overlapping gunzip 260 ms, parse 949 ms, sort 125 ms, write 1645 ms, index 482 ms: 5 candidates, 71510 repo-hours, 95 releases; waiting 510 ms; commit 1137 ms)
2026-11-07T05:06:05Z [load_day 2026-07-16] 2026-07-16 hour 1: 161534 events in 4 files, snapshot 7216575113248197851 (task 3885 ms: download 1323 ms overlapping gunzip 206 ms, parse 791 ms, sort 123 ms, write 1595 ms, index 564 ms: 6 candidates, 81254 repo-hours, 30 releases; waiting 306 ms; commit 938 ms)
2026-11-07T05:06:09Z [load_day 2026-07-16] 2026-07-16 hour 2: 164938 events in 4 files, snapshot 8172854893488669756 (task 4111 ms: download 1147 ms overlapping gunzip 210 ms, parse 783 ms, sort 118 ms, write 1718 ms, index 553 ms: 11 candidates, 84925 repo-hours, 28 releases; waiting 511 ms; commit 1005 ms)
2026-11-07T05:06:10Z [load_day 2026-07-16] 2026-07-16 hour 3: 169325 events in 4 files, snapshot 1591153306108926638 (task 4096 ms: download 1218 ms overlapping gunzip 208 ms, parse 790 ms, sort 123 ms, write 1658 ms, index 501 ms: 13 candidates, 68465 repo-hours, 19 releases; waiting 551 ms; commit 954 ms)
2026-11-07T05:06:14Z [load_day 2026-07-16] 2026-07-16 hour 4: 167027 events in 4 files, snapshot 239070588113460790 (task 3810 ms: download 1017 ms overlapping gunzip 200 ms, parse 775 ms, sort 108 ms, write 1696 ms, index 363 ms: 7 candidates, 56466 repo-hours, 21 releases; waiting 297 ms; commit 979 ms)
2026-11-07T05:06:15Z [load_day 2026-07-16] 2026-07-16 hour 5: 169757 events in 4 files, snapshot 3457216681970544796 (task 3814 ms: download 1464 ms overlapping gunzip 204 ms, parse 785 ms, sort 116 ms, write 1555 ms, index 326 ms: 8 candidates, 48581 repo-hours, 16 releases; waiting 523 ms; commit 916 ms)
2026-11-07T05:06:18Z [load_day 2026-07-16] 2026-07-16 hour 6: 164183 events in 4 files, snapshot 8060301774907158031 (task 3673 ms: download 1185 ms overlapping gunzip 191 ms, parse 733 ms, sort 99 ms, write 1532 ms, index 291 ms: 1 candidates, 45615 repo-hours, 20 releases; waiting 517 ms; commit 1038 ms)
2026-11-07T05:06:19Z [load_day 2026-07-16] 2026-07-16 hour 7: 163968 events in 4 files, snapshot 5824999771029423595 (task 3610 ms: download 1298 ms overlapping gunzip 193 ms, parse 734 ms, sort 98 ms, write 1442 ms, index 327 ms: 2 candidates, 44761 repo-hours, 9 releases; waiting 511 ms; commit 1018 ms)
2026-11-07T05:06:22Z [load_day 2026-07-16] 2026-07-16 hour 8: 170263 events in 4 files, snapshot 2578904044602193316 (task 3815 ms: download 1979 ms overlapping gunzip 199 ms, parse 762 ms, sort 107 ms, write 1556 ms, index 373 ms: 6 candidates, 46959 repo-hours, 22 releases; waiting 511 ms; commit 939 ms)
2026-11-07T05:06:23Z [load_day 2026-07-16] 2026-07-16 hour 9: 164284 events in 4 files, snapshot 311999892338796717 (task 3399 ms: download 1255 ms overlapping gunzip 190 ms, parse 723 ms, sort 97 ms, write 1438 ms, index 359 ms: 2 candidates, 43464 repo-hours, 6 releases; waiting 185 ms; commit 1036 ms)
2026-11-07T05:06:26Z [load_day 2026-07-16] 2026-07-16 hour 10: 164983 events in 4 files, snapshot 273438201050303934 (task 3694 ms: download 1122 ms overlapping gunzip 195 ms, parse 742 ms, sort 98 ms, write 1502 ms, index 362 ms: 1 candidates, 47807 repo-hours, 18 releases; waiting 525 ms; commit 872 ms)
2026-11-07T05:06:28Z [load_day 2026-07-16] 2026-07-16 hour 11: 168076 events in 4 files, snapshot 7596626531207033933 (task 3700 ms: download 1490 ms overlapping gunzip 199 ms, parse 765 ms, sort 107 ms, write 1436 ms, index 338 ms: 9 candidates, 49028 repo-hours, 10 releases; waiting 538 ms; commit 1031 ms)
2026-11-07T05:06:31Z [load_day 2026-07-16] 2026-07-16 hour 12: 166563 events in 4 files, snapshot 3153364125755749633 (task 3792 ms: download 1346 ms overlapping gunzip 195 ms, parse 736 ms, sort 105 ms, write 1580 ms, index 336 ms: 4 candidates, 46685 repo-hours, 24 releases; waiting 527 ms; commit 979 ms)
2026-11-07T05:06:32Z [load_day 2026-07-16] 2026-07-16 hour 13: 162586 events in 4 files, snapshot 1541506165051391121 (task 3726 ms: download 1162 ms overlapping gunzip 188 ms, parse 727 ms, sort 103 ms, write 1529 ms, index 359 ms: 5 candidates, 52039 repo-hours, 18 releases; waiting 528 ms; commit 1050 ms)
2026-11-07T05:06:35Z [load_day 2026-07-16] 2026-07-16 hour 14: 156962 events in 4 files, snapshot 539465188088645559 (task 3597 ms: download 1103 ms overlapping gunzip 202 ms, parse 739 ms, sort 103 ms, write 1496 ms, index 311 ms: 3 candidates, 47169 repo-hours, 31 releases; waiting 522 ms; commit 1003 ms)
2026-11-07T05:06:37Z [load_day 2026-07-16] 2026-07-16 hour 15: 163532 events in 4 files, snapshot 2218429439404580514 (task 3835 ms: download 1893 ms overlapping gunzip 209 ms, parse 796 ms, sort 100 ms, write 1491 ms, index 372 ms: 6 candidates, 51795 repo-hours, 22 releases; waiting 526 ms; commit 934 ms)
2026-11-07T05:06:40Z [load_day 2026-07-16] 2026-07-16 hour 16: 166570 events in 4 files, snapshot 7546587937241428497 (task 3755 ms: download 2055 ms overlapping gunzip 215 ms, parse 783 ms, sort 108 ms, write 1480 ms, index 370 ms: 6 candidates, 53684 repo-hours, 19 releases; waiting 512 ms; commit 886 ms)
2026-11-07T05:06:41Z [load_day 2026-07-16] 2026-07-16 hour 17: 162854 events in 4 files, snapshot 7382310256285334897 (task 3621 ms: download 1337 ms overlapping gunzip 194 ms, parse 731 ms, sort 103 ms, write 1439 ms, index 339 ms: 5 candidates, 51613 repo-hours, 10 releases; waiting 521 ms; commit 1080 ms)
2026-11-07T05:06:44Z [load_day 2026-07-16] 2026-07-16 hour 18: 161388 events in 4 files, snapshot 5583771332331817940 (task 3674 ms: download 1314 ms overlapping gunzip 202 ms, parse 759 ms, sort 102 ms, write 1438 ms, index 361 ms: 6 candidates, 51356 repo-hours, 15 releases; waiting 520 ms; commit 1047 ms)
2026-11-07T05:06:45Z [load_day 2026-07-16] 2026-07-16 hour 19: 161555 events in 4 files, snapshot 8759097563684283909 (task 3802 ms: download 1385 ms overlapping gunzip 203 ms, parse 778 ms, sort 98 ms, write 1393 ms, index 353 ms: 6 candidates, 57216 repo-hours, 30 releases; waiting 670 ms; commit 975 ms)
2026-11-07T05:06:49Z [load_day 2026-07-16] 2026-07-16 hour 20: 168141 events in 4 files, snapshot 1969084850494409521 (task 4000 ms: download 1493 ms overlapping gunzip 226 ms, parse 829 ms, sort 109 ms, write 1543 ms, index 428 ms: 5 candidates, 63047 repo-hours, 48 releases; waiting 518 ms; commit 1192 ms)
2026-11-07T05:06:50Z [load_day 2026-07-16] 2026-07-16 hour 21: 158260 events in 4 files, snapshot 2512493893426853083 (task 3707 ms: download 1217 ms overlapping gunzip 208 ms, parse 738 ms, sort 96 ms, write 1370 ms, index 422 ms: 3 candidates, 65074 repo-hours, 20 releases; waiting 529 ms; commit 945 ms)
2026-11-07T05:06:51Z [load_day 2026-07-16] 2026-07-16 hour 22: 47473 events in 1 files, snapshot 5672341761177938433 (task 1775 ms: download 802 ms overlapping gunzip 67 ms, parse 254 ms, sort 29 ms, write 475 ms, index 166 ms: 2 candidates, 23402 repo-hours, 5 releases; waiting 527 ms; commit 875 ms)
2026-11-07T05:06:52Z [load_day 2026-07-16] 2026-07-16 hour 23: 48472 events in 1 files, snapshot 4842828447275702810 (task 2046 ms: download 838 ms overlapping gunzip 85 ms, parse 314 ms, sort 36 ms, write 540 ms, index 211 ms: 3 candidates, 28376 repo-hours, 92 releases; waiting 542 ms; commit 1006 ms)
2026-11-07T05:06:58Z [load_day 2026-07-16] 2026-07-16: repo_hour merged from 24 files to 1 (1280291 rows, 5778 ms)
2026-11-07T05:07:00Z [load_day 2026-07-16] 2026-07-16: index committed in 7463 ms (24 + 1 + 24 files)
2026-11-07T05:07:00Z [load_day 2026-07-16] 2026-07-16: 3721293 events in 24 hours
2026-11-07T05:07:00Z [load_day 2026-07-16] attempt 1 succeeded