orcaLog in

Runs · run 371

load_day 2026-07-17, attempt 1 succeeded

Host
4e84322b8c45:71575
Started
2026-11-07T05:04:50Z
Ended
2026-11-07T05:05:56Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/371/load_day/2026-07-17/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:04:50Z [load_day 2026-07-17] attempt 1 started
2026-11-07T05:04:58Z [load_day 2026-07-17] 2026-07-17 hour 0: 160651 events in 4 files, snapshot 206640555985102106 (task 4764 ms: download 1579 ms overlapping gunzip 266 ms, parse 983 ms, sort 132 ms, write 2044 ms, index 480 ms: 10 candidates, 72707 repo-hours, 218 releases; waiting 548 ms; commit 843 ms)
2026-11-07T05:04:59Z [load_day 2026-07-17] 2026-07-17 hour 1: 163402 events in 4 files, snapshot 1123906934387839940 (task 4493 ms: download 1535 ms overlapping gunzip 220 ms, parse 827 ms, sort 112 ms, write 1872 ms, index 582 ms: 9 candidates, 85759 repo-hours, 97 releases; waiting 510 ms; commit 983 ms)
2026-11-07T05:05:03Z [load_day 2026-07-17] 2026-07-17 hour 2: 166733 events in 4 files, snapshot 285658999272239410 (task 4282 ms: download 1444 ms overlapping gunzip 220 ms, parse 839 ms, sort 134 ms, write 1655 ms, index 519 ms: 5 candidates, 81259 repo-hours, 22 releases; waiting 542 ms; commit 993 ms)
2026-11-07T05:05:04Z [load_day 2026-07-17] 2026-07-17 hour 3: 167178 events in 4 files, snapshot 9162013860499726302 (task 3951 ms: download 1504 ms overlapping gunzip 199 ms, parse 795 ms, sort 109 ms, write 1593 ms, index 449 ms: 5 candidates, 65719 repo-hours, 27 releases; waiting 521 ms; commit 1041 ms)
2026-11-07T05:05:08Z [load_day 2026-07-17] 2026-07-17 hour 4: 164629 events in 4 files, snapshot 8156962711994800560 (task 3824 ms: download 1452 ms overlapping gunzip 207 ms, parse 809 ms, sort 108 ms, write 1446 ms, index 428 ms: 8 candidates, 62534 repo-hours, 31 releases; waiting 520 ms; commit 1181 ms)
2026-11-07T05:05:09Z [load_day 2026-07-17] 2026-07-17 hour 5: 164857 events in 4 files, snapshot 1949182292727324920 (task 3696 ms: download 1311 ms overlapping gunzip 195 ms, parse 763 ms, sort 101 ms, write 1453 ms, index 436 ms: 5 candidates, 54213 repo-hours, 17 releases; waiting 505 ms; commit 1047 ms)
2026-11-07T05:05:12Z [load_day 2026-07-17] 2026-07-17 hour 6: 161132 events in 4 files, snapshot 6446111958339460111 (task 3653 ms: download 1409 ms overlapping gunzip 197 ms, parse 750 ms, sort 115 ms, write 1471 ms, index 286 ms: 1 candidates, 41734 repo-hours, 10 releases; waiting 528 ms; commit 873 ms)
2026-11-07T05:05:14Z [load_day 2026-07-17] 2026-07-17 hour 7: 169481 events in 4 files, snapshot 3945393748801705463 (task 3814 ms: download 1376 ms overlapping gunzip 204 ms, parse 783 ms, sort 100 ms, write 1573 ms, index 328 ms: 4 candidates, 44651 repo-hours, 14 releases; waiting 512 ms; commit 1062 ms)
2026-11-07T05:05:16Z [load_day 2026-07-17] 2026-07-17 hour 8: 165876 events in 4 files, snapshot 5289873088900801142 (task 3716 ms: download 1312 ms overlapping gunzip 198 ms, parse 766 ms, sort 107 ms, write 1484 ms, index 326 ms: 1 candidates, 45492 repo-hours, 16 releases; waiting 524 ms; commit 920 ms)
2026-11-07T05:05:18Z [load_day 2026-07-17] 2026-07-17 hour 9: 165981 events in 4 files, snapshot 637125610603465544 (task 3802 ms: download 1609 ms overlapping gunzip 192 ms, parse 743 ms, sort 101 ms, write 1616 ms, index 310 ms: 1 candidates, 43342 repo-hours, 9 releases; waiting 519 ms; commit 1046 ms)
2026-11-07T05:05:21Z [load_day 2026-07-17] 2026-07-17 hour 10: 165071 events in 4 files, snapshot 1293622852296904263 (task 3706 ms: download 1173 ms overlapping gunzip 204 ms, parse 752 ms, sort 107 ms, write 1556 ms, index 350 ms: 5 candidates, 45396 repo-hours, 8 releases; waiting 534 ms; commit 864 ms)
2026-11-07T05:05:22Z [load_day 2026-07-17] 2026-07-17 hour 11: 165135 events in 4 files, snapshot 3990296479168643784 (task 3768 ms: download 1526 ms overlapping gunzip 191 ms, parse 736 ms, sort 111 ms, write 1537 ms, index 338 ms: 1 candidates, 49685 repo-hours, 24 releases; waiting 532 ms; commit 1092 ms)
2026-11-07T05:05:25Z [load_day 2026-07-17] 2026-07-17 hour 12: 168080 events in 4 files, snapshot 3130404031043642791 (task 3787 ms: download 1268 ms overlapping gunzip 209 ms, parse 816 ms, sort 109 ms, write 1455 ms, index 331 ms: 1 candidates, 48109 repo-hours, 10 releases; waiting 560 ms; commit 1210 ms)
2026-11-07T05:05:27Z [load_day 2026-07-17] 2026-07-17 hour 13: 165181 events in 4 files, snapshot 1547845787914170833 (task 3621 ms: download 1114 ms overlapping gunzip 196 ms, parse 788 ms, sort 110 ms, write 1440 ms, index 351 ms: 4 candidates, 53077 repo-hours, 16 releases; waiting 521 ms; commit 863 ms)
2026-11-07T05:05:29Z [load_day 2026-07-17] 2026-07-17 hour 14: 164259 events in 4 files, snapshot 5629286138685023051 (task 3758 ms: download 1621 ms overlapping gunzip 207 ms, parse 770 ms, sort 102 ms, write 1475 ms, index 359 ms: 4 candidates, 53382 repo-hours, 19 releases; waiting 524 ms; commit 1096 ms)
2026-11-07T05:05:32Z [load_day 2026-07-17] 2026-07-17 hour 15: 160360 events in 4 files, snapshot 470658047536941955 (task 3683 ms: download 1137 ms overlapping gunzip 201 ms, parse 734 ms, sort 96 ms, write 1366 ms, index 466 ms: 7 candidates, 53919 repo-hours, 17 releases; waiting 522 ms; commit 2245 ms)
2026-11-07T05:05:35Z [load_day 2026-07-17] 2026-07-17 hour 16: 162971 events in 4 files, snapshot 6641497248128314908 (task 3779 ms: download 1154 ms overlapping gunzip 190 ms, parse 725 ms, sort 99 ms, write 1583 ms, index 442 ms: 4 candidates, 53833 repo-hours, 23 releases; waiting 396 ms; commit 2202 ms)
2026-11-07T05:05:36Z [load_day 2026-07-17] 2026-07-17 hour 17: 162770 events in 4 files, snapshot 4353168273695853900 (task 4102 ms: download 1762 ms overlapping gunzip 203 ms, parse 768 ms, sort 104 ms, write 1814 ms, index 382 ms: 8 candidates, 58283 repo-hours, 13 releases; waiting 529 ms; commit 919 ms)
2026-11-07T05:05:38Z [load_day 2026-07-17] 2026-07-17 hour 18: 164564 events in 4 files, snapshot 7684503291056903319 (task 3725 ms: download 1369 ms overlapping gunzip 198 ms, parse 745 ms, sort 100 ms, write 1460 ms, index 383 ms: 7 candidates, 58214 repo-hours, 21 releases; waiting 542 ms; commit 988 ms)
2026-11-07T05:05:39Z [load_day 2026-07-17] 2026-07-17 hour 19: 162862 events in 4 files, snapshot 4219970661293869175 (task 2983 ms: download 373 ms overlapping gunzip 197 ms, parse 696 ms, sort 101 ms, write 1418 ms, index 375 ms: 8 candidates, 58024 repo-hours, 15 releases; waiting 14 ms; commit 932 ms)
2026-11-07T05:05:42Z [load_day 2026-07-17] 2026-07-17 hour 20: 166061 events in 4 files, snapshot 6138121926132485497 (task 3840 ms: download 1155 ms overlapping gunzip 203 ms, parse 747 ms, sort 99 ms, write 1570 ms, index 383 ms: 5 candidates, 59540 repo-hours, 22 releases; waiting 523 ms; commit 792 ms)
2026-11-07T05:05:44Z [load_day 2026-07-17] 2026-07-17 hour 21: 165960 events in 4 files, snapshot 4255142188605784875 (task 3713 ms: download 1300 ms overlapping gunzip 201 ms, parse 750 ms, sort 99 ms, write 1431 ms, index 399 ms: 4 candidates, 56976 repo-hours, 18 releases; waiting 545 ms; commit 978 ms)
2026-11-07T05:05:47Z [load_day 2026-07-17] 2026-07-17 hour 22: 164876 events in 4 files, snapshot 8591120262384207701 (task 3740 ms: download 1629 ms overlapping gunzip 201 ms, parse 773 ms, sort 113 ms, write 1442 ms, index 365 ms: 8 candidates, 58187 repo-hours, 32 releases; waiting 540 ms; commit 1172 ms)
2026-11-07T05:05:48Z [load_day 2026-07-17] 2026-07-17 hour 23: 167169 events in 4 files, snapshot 2713294887649393467 (task 3829 ms: download 1589 ms overlapping gunzip 206 ms, parse 765 ms, sort 101 ms, write 1519 ms, index 380 ms: 5 candidates, 59443 repo-hours, 20 releases; waiting 526 ms; commit 883 ms)
2026-11-07T05:05:54Z [load_day 2026-07-17] 2026-07-17: repo_hour merged from 24 files to 1 (1363478 rows, 5955 ms)
2026-11-07T05:05:56Z [load_day 2026-07-17] 2026-07-17: index committed in 7938 ms (24 + 1 + 24 files)
2026-11-07T05:05:56Z [load_day 2026-07-17] 2026-07-17: 3955239 events in 24 hours
2026-11-07T05:05:56Z [load_day 2026-07-17] attempt 1 succeeded