orcaLog in

Runs · run 338

load_day 2026-07-28, attempt 1 succeeded

Host
4e84322b8c45:62179
Started
2026-11-07T04:53:01Z
Ended
2026-11-07T04:54:03Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/338/load_day/2026-07-28/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:53:01Z [load_day 2026-07-28] attempt 1 started
2026-11-07T04:53:08Z [load_day 2026-07-28] 2026-07-28 hour 0: 164849 events in 4 files, snapshot 4007842193508459284 (task 4077 ms: download 1369 ms overlapping gunzip 223 ms, parse 838 ms, sort 136 ms, write 1684 ms, index 336 ms: 3 candidates, 50638 repo-hours, 42 releases; waiting 530 ms; commit 828 ms)
2026-11-07T04:53:09Z [load_day 2026-07-28] 2026-07-28 hour 1: 170265 events in 4 files, snapshot 7238194247363985423 (task 4082 ms: download 1348 ms overlapping gunzip 204 ms, parse 812 ms, sort 148 ms, write 1712 ms, index 377 ms: 5 candidates, 62750 repo-hours, 21 releases; waiting 511 ms; commit 905 ms)
2026-11-07T04:53:12Z [load_day 2026-07-28] 2026-07-28 hour 2: 165167 events in 4 files, snapshot 1972720457600807679 (task 3710 ms: download 1325 ms overlapping gunzip 195 ms, parse 752 ms, sort 104 ms, write 1507 ms, index 315 ms: 1 candidates, 48999 repo-hours, 21 releases; waiting 530 ms; commit 781 ms)
2026-11-07T04:53:13Z [load_day 2026-07-28] 2026-07-28 hour 3: 165370 events in 4 files, snapshot 2340685494227710332 (task 3870 ms: download 1333 ms overlapping gunzip 230 ms, parse 878 ms, sort 106 ms, write 1616 ms, index 254 ms: 2 candidates, 35204 repo-hours, 123 releases; waiting 505 ms; commit 854 ms)
2026-11-07T04:53:17Z [load_day 2026-07-28] 2026-07-28 hour 4: 171051 events in 4 files, snapshot 5779543969265672072 (task 3933 ms: download 1455 ms overlapping gunzip 204 ms, parse 781 ms, sort 104 ms, write 1704 ms, index 219 ms: 1 candidates, 29825 repo-hours, 27 releases; waiting 621 ms; commit 761 ms)
2026-11-07T04:53:17Z [load_day 2026-07-28] 2026-07-28 hour 5: 163984 events in 4 files, snapshot 3149635038127700451 (task 3474 ms: download 1128 ms overlapping gunzip 187 ms, parse 727 ms, sort 104 ms, write 1477 ms, index 198 ms: 1 candidates, 28184 repo-hours, 15 releases; waiting 530 ms; commit 791 ms)
2026-11-07T04:53:21Z [load_day 2026-07-28] 2026-07-28 hour 6: 171372 events in 4 files, snapshot 361487214428606505 (task 3689 ms: download 1615 ms overlapping gunzip 189 ms, parse 746 ms, sort 103 ms, write 1560 ms, index 233 ms: 1 candidates, 31979 repo-hours, 17 releases; waiting 567 ms; commit 861 ms)
2026-11-07T04:53:22Z [load_day 2026-07-28] 2026-07-28 hour 7: 166886 events in 4 files, snapshot 521401946689408807 (task 3628 ms: download 1405 ms overlapping gunzip 197 ms, parse 780 ms, sort 120 ms, write 1479 ms, index 207 ms: 3 candidates, 31532 repo-hours, 8 releases; waiting 534 ms; commit 840 ms)
2026-11-07T04:53:25Z [load_day 2026-07-28] 2026-07-28 hour 8: 166080 events in 4 files, snapshot 9208182268406639891 (task 3727 ms: download 1402 ms overlapping gunzip 197 ms, parse 768 ms, sort 113 ms, write 1618 ms, index 238 ms: 3 candidates, 34747 repo-hours, 12 releases; waiting 524 ms; commit 716 ms)
2026-11-07T04:53:26Z [load_day 2026-07-28] 2026-07-28 hour 9: 163671 events in 4 files, snapshot 6885777118150094970 (task 3591 ms: download 1226 ms overlapping gunzip 189 ms, parse 730 ms, sort 100 ms, write 1535 ms, index 234 ms: 1 candidates, 33553 repo-hours, 17 releases; waiting 534 ms; commit 712 ms)
2026-11-07T04:53:30Z [load_day 2026-07-28] 2026-07-28 hour 10: 162877 events in 4 files, snapshot 6325040132979034665 (task 3765 ms: download 1391 ms overlapping gunzip 194 ms, parse 731 ms, sort 100 ms, write 1548 ms, index 276 ms: 2 candidates, 38516 repo-hours, 13 releases; waiting 573 ms; commit 809 ms)
2026-11-07T04:53:30Z [load_day 2026-07-28] 2026-07-28 hour 11: 166339 events in 4 files, snapshot 7914303055282742420 (task 3798 ms: download 1132 ms overlapping gunzip 194 ms, parse 748 ms, sort 103 ms, write 1693 ms, index 283 ms: 2 candidates, 36507 repo-hours, 14 releases; waiting 519 ms; commit 807 ms)
2026-11-07T04:53:34Z [load_day 2026-07-28] 2026-07-28 hour 12: 164385 events in 4 files, snapshot 4802835379632121485 (task 3707 ms: download 1538 ms overlapping gunzip 196 ms, parse 777 ms, sort 109 ms, write 1577 ms, index 215 ms: 0 candidates, 31541 repo-hours, 12 releases; waiting 522 ms; commit 927 ms)
2026-11-07T04:53:35Z [load_day 2026-07-28] 2026-07-28 hour 13: 158510 events in 4 files, snapshot 2441350114134260639 (task 3566 ms: download 1426 ms overlapping gunzip 184 ms, parse 704 ms, sort 96 ms, write 1514 ms, index 235 ms: 5 candidates, 35820 repo-hours, 15 releases; waiting 516 ms; commit 918 ms)
2026-11-07T04:53:38Z [load_day 2026-07-28] 2026-07-28 hour 14: 152316 events in 4 files, snapshot 3453177445055072918 (task 3475 ms: download 1213 ms overlapping gunzip 188 ms, parse 713 ms, sort 109 ms, write 1420 ms, index 273 ms: 2 candidates, 35074 repo-hours, 13 releases; waiting 516 ms; commit 879 ms)
2026-11-07T04:53:39Z [load_day 2026-07-28] 2026-07-28 hour 15: 150277 events in 4 files, snapshot 8343146019089184817 (task 3357 ms: download 1571 ms overlapping gunzip 180 ms, parse 702 ms, sort 96 ms, write 1322 ms, index 250 ms: 1 candidates, 35010 repo-hours, 14 releases; waiting 522 ms; commit 795 ms)
2026-11-07T04:53:42Z [load_day 2026-07-28] 2026-07-28 hour 16: 149548 events in 3 files, snapshot 1279207689281622895 (task 3393 ms: download 1259 ms overlapping gunzip 179 ms, parse 680 ms, sort 93 ms, write 1347 ms, index 271 ms: 6 candidates, 37575 repo-hours, 9 releases; waiting 513 ms; commit 822 ms)
2026-11-07T04:53:44Z [load_day 2026-07-28] 2026-07-28 hour 17: 158844 events in 4 files, snapshot 4691099459481890424 (task 3805 ms: download 1536 ms overlapping gunzip 184 ms, parse 733 ms, sort 100 ms, write 1475 ms, index 292 ms: 0 candidates, 47190 repo-hours, 12 releases; waiting 549 ms; commit 966 ms)
2026-11-07T04:53:47Z [load_day 2026-07-28] 2026-07-28 hour 18: 160572 events in 4 files, snapshot 293139187558987612 (task 3812 ms: download 1614 ms overlapping gunzip 202 ms, parse 779 ms, sort 106 ms, write 1449 ms, index 277 ms: 2 candidates, 42696 repo-hours, 14 releases; waiting 520 ms; commit 917 ms)
2026-11-07T04:53:48Z [load_day 2026-07-28] 2026-07-28 hour 19: 163173 events in 4 files, snapshot 6031727636442198974 (task 3764 ms: download 1936 ms overlapping gunzip 196 ms, parse 744 ms, sort 104 ms, write 1522 ms, index 319 ms: 4 candidates, 47153 repo-hours, 16 releases; waiting 538 ms; commit 889 ms)
2026-11-07T04:53:51Z [load_day 2026-07-28] 2026-07-28 hour 20: 169275 events in 4 files, snapshot 2105913716510997815 (task 4276 ms: download 2080 ms overlapping gunzip 200 ms, parse 762 ms, sort 111 ms, write 1509 ms, index 301 ms: 6 candidates, 48747 repo-hours, 15 releases; waiting 768 ms; commit 789 ms)
2026-11-07T04:53:52Z [load_day 2026-07-28] 2026-07-28 hour 21: 164480 events in 4 files, snapshot 7942637729142561833 (task 3617 ms: download 1550 ms overlapping gunzip 192 ms, parse 742 ms, sort 103 ms, write 1424 ms, index 289 ms: 8 candidates, 47283 repo-hours, 20 releases; waiting 551 ms; commit 817 ms)
2026-11-07T04:53:55Z [load_day 2026-07-28] 2026-07-28 hour 22: 167070 events in 4 files, snapshot 2472815223168192490 (task 3739 ms: download 1227 ms overlapping gunzip 204 ms, parse 789 ms, sort 122 ms, write 1491 ms, index 331 ms: 8 candidates, 46742 repo-hours, 25 releases; waiting 533 ms; commit 737 ms)
2026-11-07T04:53:56Z [load_day 2026-07-28] 2026-07-28 hour 23: 164862 events in 4 files, snapshot 9065452781396487994 (task 3369 ms: download 1123 ms overlapping gunzip 204 ms, parse 753 ms, sort 109 ms, write 1524 ms, index 286 ms: 2 candidates, 45082 repo-hours, 17 releases; waiting 184 ms; commit 795 ms)
2026-11-07T04:54:01Z [load_day 2026-07-28] 2026-07-28: repo_hour merged from 24 files to 1 (962347 rows, 4509 ms)
2026-11-07T04:54:03Z [load_day 2026-07-28] 2026-07-28: index committed in 6644 ms (22 + 1 + 24 files)
2026-11-07T04:54:03Z [load_day 2026-07-28] 2026-07-28: 3921223 events in 24 hours
2026-11-07T04:54:03Z [load_day 2026-07-28] attempt 1 succeeded