orcaLog in

Runs · run 401

load_day 2026-07-07, attempt 1 succeeded

Host
4e84322b8c45:80115
Started
2026-11-07T05:15:53Z
Ended
2026-11-07T05:16:59Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/401/load_day/2026-07-07/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:15:53Z [load_day 2026-07-07] attempt 1 started
2026-11-07T05:16:00Z [load_day 2026-07-07] 2026-07-07 hour 0: 164607 events in 4 files, snapshot 5359341379118509428 (task 3949 ms: download 1817 ms overlapping gunzip 196 ms, parse 747 ms, sort 106 ms, write 1538 ms, index 408 ms: 3 candidates, 59370 repo-hours, 25 releases; waiting 632 ms; commit 1218 ms)
2026-11-07T05:16:01Z [load_day 2026-07-07] 2026-07-07 hour 1: 172055 events in 4 files, snapshot 7928290538940073623 (task 3982 ms: download 1464 ms overlapping gunzip 204 ms, parse 839 ms, sort 117 ms, write 1542 ms, index 442 ms: 5 candidates, 66528 repo-hours, 28 releases; waiting 511 ms; commit 1207 ms)
2026-11-07T05:16:05Z [load_day 2026-07-07] 2026-07-07 hour 2: 169145 events in 4 files, snapshot 608604819923518021 (task 4130 ms: download 1623 ms overlapping gunzip 204 ms, parse 777 ms, sort 103 ms, write 1608 ms, index 493 ms: 5 candidates, 79910 repo-hours, 49 releases; waiting 524 ms; commit 1106 ms)
2026-11-07T05:16:06Z [load_day 2026-07-07] 2026-07-07 hour 3: 168607 events in 4 files, snapshot 4926449497083996543 (task 4047 ms: download 1393 ms overlapping gunzip 211 ms, parse 786 ms, sort 104 ms, write 1598 ms, index 481 ms: 10 candidates, 75247 repo-hours, 25 releases; waiting 536 ms; commit 854 ms)
2026-11-07T05:16:09Z [load_day 2026-07-07] 2026-07-07 hour 4: 163856 events in 4 files, snapshot 4684394667421876653 (task 3805 ms: download 1379 ms overlapping gunzip 205 ms, parse 767 ms, sort 103 ms, write 1477 ms, index 460 ms: 6 candidates, 67279 repo-hours, 54 releases; waiting 524 ms; commit 925 ms)
2026-11-07T05:16:11Z [load_day 2026-07-07] 2026-07-07 hour 5: 166927 events in 4 files, snapshot 8666418468469761077 (task 3862 ms: download 1221 ms overlapping gunzip 198 ms, parse 755 ms, sort 103 ms, write 1565 ms, index 444 ms: 4 candidates, 68237 repo-hours, 29 releases; waiting 521 ms; commit 988 ms)
2026-11-07T05:16:13Z [load_day 2026-07-07] 2026-07-07 hour 6: 161232 events in 4 files, snapshot 1936650600525555021 (task 3403 ms: download 1146 ms overlapping gunzip 194 ms, parse 744 ms, sort 108 ms, write 1364 ms, index 481 ms: 14 candidates, 72087 repo-hours, 32 releases; waiting 230 ms; commit 1018 ms)
2026-11-07T05:16:15Z [load_day 2026-07-07] 2026-07-07 hour 7: 161653 events in 4 files, snapshot 4811352040015910149 (task 3712 ms: download 1314 ms overlapping gunzip 202 ms, parse 753 ms, sort 102 ms, write 1361 ms, index 515 ms: 11 candidates, 74228 repo-hours, 20 releases; waiting 515 ms; commit 972 ms)
2026-11-07T05:16:17Z [load_day 2026-07-07] 2026-07-07 hour 8: 163446 events in 4 files, snapshot 3496649181362682980 (task 3679 ms: download 1214 ms overlapping gunzip 203 ms, parse 773 ms, sort 104 ms, write 1420 ms, index 561 ms: 6 candidates, 70001 repo-hours, 15 releases; waiting 347 ms; commit 874 ms)
2026-11-07T05:16:20Z [load_day 2026-07-07] 2026-07-07 hour 9: 164515 events in 4 files, snapshot 6500751006501903415 (task 4042 ms: download 1247 ms overlapping gunzip 201 ms, parse 766 ms, sort 103 ms, write 1426 ms, index 542 ms: 10 candidates, 72269 repo-hours, 35 releases; waiting 513 ms; commit 943 ms)
2026-11-07T05:16:22Z [load_day 2026-07-07] 2026-07-07 hour 10: 164637 events in 4 files, snapshot 1892689478188001823 (task 3807 ms: download 1336 ms overlapping gunzip 194 ms, parse 755 ms, sort 101 ms, write 1445 ms, index 500 ms: 5 candidates, 70045 repo-hours, 25 releases; waiting 523 ms; commit 1009 ms)
2026-11-07T05:16:24Z [load_day 2026-07-07] 2026-07-07 hour 11: 163040 events in 4 files, snapshot 189021223372065968 (task 3696 ms: download 1137 ms overlapping gunzip 194 ms, parse 721 ms, sort 100 ms, write 1386 ms, index 527 ms: 9 candidates, 72844 repo-hours, 17 releases; waiting 546 ms; commit 893 ms)
2026-11-07T05:16:27Z [load_day 2026-07-07] 2026-07-07 hour 12: 161021 events in 4 files, snapshot 420501568145886996 (task 3765 ms: download 1475 ms overlapping gunzip 204 ms, parse 759 ms, sort 101 ms, write 1389 ms, index 475 ms: 7 candidates, 70871 repo-hours, 20 releases; waiting 518 ms; commit 1143 ms)
2026-11-07T05:16:29Z [load_day 2026-07-07] 2026-07-07 hour 13: 159216 events in 4 files, snapshot 654960401982283251 (task 3856 ms: download 1335 ms overlapping gunzip 210 ms, parse 814 ms, sort 105 ms, write 1390 ms, index 497 ms: 3 candidates, 70189 repo-hours, 22 releases; waiting 511 ms; commit 1063 ms)
2026-11-07T05:16:31Z [load_day 2026-07-07] 2026-07-07 hour 14: 158169 events in 4 files, snapshot 6203537300180634173 (task 3899 ms: download 1434 ms overlapping gunzip 198 ms, parse 758 ms, sort 94 ms, write 1396 ms, index 568 ms: 2 candidates, 80745 repo-hours, 20 releases; waiting 527 ms; commit 1018 ms)
2026-11-07T05:16:33Z [load_day 2026-07-07] 2026-07-07 hour 15: 160835 events in 4 files, snapshot 653606385053674873 (task 3724 ms: download 1434 ms overlapping gunzip 205 ms, parse 754 ms, sort 95 ms, write 1349 ms, index 457 ms: 5 candidates, 66414 repo-hours, 28 releases; waiting 543 ms; commit 867 ms)
2026-11-07T05:16:36Z [load_day 2026-07-07] 2026-07-07 hour 16: 162708 events in 4 files, snapshot 50983788176552026 (task 3758 ms: download 1441 ms overlapping gunzip 199 ms, parse 744 ms, sort 101 ms, write 1508 ms, index 396 ms: 8 candidates, 63177 repo-hours, 21 releases; waiting 526 ms; commit 1022 ms)
2026-11-07T05:16:37Z [load_day 2026-07-07] 2026-07-07 hour 17: 163942 events in 4 files, snapshot 4110577116163152052 (task 3742 ms: download 1240 ms overlapping gunzip 194 ms, parse 734 ms, sort 103 ms, write 1460 ms, index 398 ms: 6 candidates, 61000 repo-hours, 15 releases; waiting 541 ms; commit 1113 ms)
2026-11-07T05:16:40Z [load_day 2026-07-07] 2026-07-07 hour 18: 160239 events in 4 files, snapshot 8724190851852705102 (task 3410 ms: download 884 ms overlapping gunzip 190 ms, parse 716 ms, sort 103 ms, write 1429 ms, index 432 ms: 11 candidates, 59410 repo-hours, 23 releases; waiting 246 ms; commit 1072 ms)
2026-11-07T05:16:42Z [load_day 2026-07-07] 2026-07-07 hour 19: 162034 events in 4 files, snapshot 3500320094886149772 (task 3700 ms: download 1369 ms overlapping gunzip 192 ms, parse 723 ms, sort 98 ms, write 1411 ms, index 399 ms: 9 candidates, 61374 repo-hours, 21 releases; waiting 530 ms; commit 1072 ms)
2026-11-07T05:16:44Z [load_day 2026-07-07] 2026-07-07 hour 20: 162317 events in 4 files, snapshot 4081707936512985419 (task 3658 ms: download 1513 ms overlapping gunzip 191 ms, parse 733 ms, sort 102 ms, write 1410 ms, index 400 ms: 8 candidates, 61125 repo-hours, 24 releases; waiting 531 ms; commit 1002 ms)
2026-11-07T05:16:46Z [load_day 2026-07-07] 2026-07-07 hour 21: 160256 events in 4 files, snapshot 3748088261273880487 (task 3618 ms: download 1498 ms overlapping gunzip 192 ms, parse 725 ms, sort 100 ms, write 1378 ms, index 391 ms: 8 candidates, 61205 repo-hours, 48 releases; waiting 537 ms; commit 1130 ms)
2026-11-07T05:16:49Z [load_day 2026-07-07] 2026-07-07 hour 22: 164352 events in 4 files, snapshot 6312503898911174977 (task 3856 ms: download 1845 ms overlapping gunzip 205 ms, parse 767 ms, sort 117 ms, write 1424 ms, index 416 ms: 4 candidates, 64047 repo-hours, 31 releases; waiting 535 ms; commit 997 ms)
2026-11-07T05:16:50Z [load_day 2026-07-07] 2026-07-07 hour 23: 163877 events in 4 files, snapshot 293424643733270009 (task 3691 ms: download 1390 ms overlapping gunzip 220 ms, parse 822 ms, sort 109 ms, write 1429 ms, index 458 ms: 5 candidates, 64803 repo-hours, 78 releases; waiting 334 ms; commit 845 ms)
2026-11-07T05:16:57Z [load_day 2026-07-07] 2026-07-07: repo_hour merged from 24 files to 1 (1632405 rows, 6889 ms)
2026-11-07T05:16:59Z [load_day 2026-07-07] 2026-07-07: index committed in 8760 ms (24 + 1 + 24 files)
2026-11-07T05:16:59Z [load_day 2026-07-07] 2026-07-07: 3922686 events in 24 hours
2026-11-07T05:16:59Z [load_day 2026-07-07] attempt 1 succeeded