orcaLog in

Runs · run 323

load_day 2026-08-02, attempt 1 succeeded

Host
4e84322b8c45:57899
Started
2026-11-07T04:47:42Z
Ended
2026-11-07T04:48:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/323/load_day/2026-08-02/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:47:42Z [load_day 2026-08-02] attempt 1 started
2026-11-07T04:47:49Z [load_day 2026-08-02] 2026-08-02 hour 0: 168360 events in 4 files, snapshot 1838509975407881832 (task 3890 ms: download 1690 ms overlapping gunzip 221 ms, parse 851 ms, sort 113 ms, write 1509 ms, index 311 ms: 4 candidates, 48757 repo-hours, 26 releases; waiting 508 ms; commit 818 ms)
2026-11-07T04:47:50Z [load_day 2026-08-02] 2026-08-02 hour 1: 175856 events in 4 files, snapshot 6091761034683379512 (task 3762 ms: download 756 ms overlapping gunzip 236 ms, parse 871 ms, sort 164 ms, write 1621 ms, index 384 ms: 3 candidates, 61832 repo-hours, 25 releases; waiting 193 ms; commit 811 ms)
2026-11-07T04:47:54Z [load_day 2026-08-02] 2026-08-02 hour 2: 166873 events in 4 files, snapshot 8993979535643951155 (task 3896 ms: download 1216 ms overlapping gunzip 196 ms, parse 767 ms, sort 118 ms, write 1653 ms, index 370 ms: 3 candidates, 57932 repo-hours, 15 releases; waiting 514 ms; commit 931 ms)
2026-11-07T04:47:54Z [load_day 2026-08-02] 2026-08-02 hour 3: 169695 events in 4 files, snapshot 2887719114729637311 (task 3579 ms: download 1202 ms overlapping gunzip 194 ms, parse 771 ms, sort 110 ms, write 1496 ms, index 191 ms: 1 candidates, 26056 repo-hours, 10 releases; waiting 545 ms; commit 759 ms)
2026-11-07T04:47:58Z [load_day 2026-08-02] 2026-08-02 hour 4: 172166 events in 4 files, snapshot 7779831609015367968 (task 3588 ms: download 1590 ms overlapping gunzip 203 ms, parse 788 ms, sort 107 ms, write 1591 ms, index 134 ms: 0 candidates, 20203 repo-hours, 26 releases; waiting 531 ms; commit 978 ms)
2026-11-07T04:47:59Z [load_day 2026-08-02] 2026-08-02 hour 5: 173486 events in 4 files, snapshot 1404019034080628747 (task 3699 ms: download 1306 ms overlapping gunzip 192 ms, parse 773 ms, sort 107 ms, write 1648 ms, index 220 ms: 1 candidates, 20373 repo-hours, 14 releases; waiting 536 ms; commit 1028 ms)
2026-11-07T04:48:03Z [load_day 2026-08-02] 2026-08-02 hour 6: 172156 events in 4 files, snapshot 7549542200363689650 (task 4087 ms: download 822 ms overlapping gunzip 196 ms, parse 806 ms, sort 120 ms, write 1918 ms, index 177 ms: 2 candidates, 22539 repo-hours, 12 releases; waiting 210 ms; commit 959 ms)
2026-11-07T04:48:04Z [load_day 2026-08-02] 2026-08-02 hour 7: 172091 events in 4 files, snapshot 6757052194235830357 (task 3825 ms: download 1450 ms overlapping gunzip 190 ms, parse 797 ms, sort 118 ms, write 1722 ms, index 152 ms: 1 candidates, 22825 repo-hours, 8 releases; waiting 529 ms; commit 963 ms)
2026-11-07T04:48:07Z [load_day 2026-08-02] 2026-08-02 hour 8: 171571 events in 4 files, snapshot 2461000530728894007 (task 3429 ms: download 1022 ms overlapping gunzip 186 ms, parse 750 ms, sort 107 ms, write 1525 ms, index 170 ms: 1 candidates, 24127 repo-hours, 8 releases; waiting 423 ms; commit 1025 ms)
2026-11-07T04:48:08Z [load_day 2026-08-02] 2026-08-02 hour 9: 171388 events in 4 files, snapshot 2865719629808143724 (task 3839 ms: download 1825 ms overlapping gunzip 194 ms, parse 757 ms, sort 108 ms, write 1536 ms, index 200 ms: 2 candidates, 25680 repo-hours, 9 releases; waiting 557 ms; commit 1154 ms)
2026-11-07T04:48:11Z [load_day 2026-08-02] 2026-08-02 hour 10: 169626 events in 4 files, snapshot 1641714771732668285 (task 3766 ms: download 1638 ms overlapping gunzip 196 ms, parse 798 ms, sort 115 ms, write 1584 ms, index 211 ms: 1 candidates, 31421 repo-hours, 12 releases; waiting 531 ms; commit 1010 ms)
2026-11-07T04:48:12Z [load_day 2026-08-02] 2026-08-02 hour 11: 171593 events in 4 files, snapshot 529860143040538243 (task 3693 ms: download 1180 ms overlapping gunzip 192 ms, parse 770 ms, sort 110 ms, write 1576 ms, index 210 ms: 2 candidates, 30573 repo-hours, 7 releases; waiting 529 ms; commit 727 ms)
2026-11-07T04:48:15Z [load_day 2026-08-02] 2026-08-02 hour 12: 170884 events in 4 files, snapshot 850524682169979511 (task 3549 ms: download 1122 ms overlapping gunzip 188 ms, parse 763 ms, sort 109 ms, write 1571 ms, index 174 ms: 0 candidates, 26799 repo-hours, 9 releases; waiting 515 ms; commit 783 ms)
2026-11-07T04:48:17Z [load_day 2026-08-02] 2026-08-02 hour 13: 168396 events in 4 files, snapshot 2502217953098951545 (task 3808 ms: download 1163 ms overlapping gunzip 192 ms, parse 769 ms, sort 137 ms, write 1606 ms, index 199 ms: 2 candidates, 30565 repo-hours, 8 releases; waiting 515 ms; commit 870 ms)
2026-11-07T04:48:20Z [load_day 2026-08-02] 2026-08-02 hour 14: 168989 events in 4 files, snapshot 220660963163296933 (task 3805 ms: download 1427 ms overlapping gunzip 201 ms, parse 805 ms, sort 138 ms, write 1600 ms, index 216 ms: 4 candidates, 31413 repo-hours, 11 releases; waiting 216 ms; commit 927 ms)
2026-11-07T04:48:21Z [load_day 2026-08-02] 2026-08-02 hour 15: 164082 events in 4 files, snapshot 2040781734746393202 (task 3728 ms: download 1511 ms overlapping gunzip 192 ms, parse 777 ms, sort 109 ms, write 1592 ms, index 232 ms: 3 candidates, 31430 repo-hours, 19 releases; waiting 518 ms; commit 1041 ms)
2026-11-07T04:48:24Z [load_day 2026-08-02] 2026-08-02 hour 16: 169386 events in 4 files, snapshot 4944687384175828935 (task 3496 ms: download 1048 ms overlapping gunzip 193 ms, parse 763 ms, sort 120 ms, write 1500 ms, index 269 ms: 1 candidates, 36227 repo-hours, 10 releases; waiting 369 ms; commit 916 ms)
2026-11-07T04:48:26Z [load_day 2026-08-02] 2026-08-02 hour 17: 167439 events in 4 files, snapshot 8144357025526889700 (task 3744 ms: download 1320 ms overlapping gunzip 203 ms, parse 799 ms, sort 104 ms, write 1485 ms, index 254 ms: 5 candidates, 36979 repo-hours, 12 releases; waiting 518 ms; commit 963 ms)
2026-11-07T04:48:28Z [load_day 2026-08-02] 2026-08-02 hour 18: 169187 events in 4 files, snapshot 6081745741677631686 (task 3501 ms: download 1202 ms overlapping gunzip 195 ms, parse 769 ms, sort 117 ms, write 1556 ms, index 304 ms: 2 candidates, 35074 repo-hours, 16 releases; waiting 268 ms; commit 803 ms)
2026-11-07T04:48:30Z [load_day 2026-08-02] 2026-08-02 hour 19: 167187 events in 4 files, snapshot 1288880806390627043 (task 3804 ms: download 1312 ms overlapping gunzip 200 ms, parse 790 ms, sort 115 ms, write 1580 ms, index 293 ms: 3 candidates, 48604 repo-hours, 18 releases; waiting 513 ms; commit 915 ms)
2026-11-07T04:48:33Z [load_day 2026-08-02] 2026-08-02 hour 20: 169184 events in 4 files, snapshot 719448198198137051 (task 3698 ms: download 1261 ms overlapping gunzip 197 ms, parse 793 ms, sort 120 ms, write 1449 ms, index 286 ms: 0 candidates, 49134 repo-hours, 18 releases; waiting 517 ms; commit 879 ms)
2026-11-07T04:48:35Z [load_day 2026-08-02] 2026-08-02 hour 21: 167680 events in 4 files, snapshot 1682292489865268036 (task 3600 ms: download 915 ms overlapping gunzip 185 ms, parse 731 ms, sort 112 ms, write 1452 ms, index 270 ms: 1 candidates, 44543 repo-hours, 19 releases; waiting 232 ms; commit 1083 ms)
2026-11-07T04:48:37Z [load_day 2026-08-02] 2026-08-02 hour 22: 172183 events in 4 files, snapshot 7236297418604862403 (task 3720 ms: download 1307 ms overlapping gunzip 201 ms, parse 765 ms, sort 121 ms, write 1543 ms, index 266 ms: 2 candidates, 46030 repo-hours, 13 releases; waiting 524 ms; commit 788 ms)
2026-11-07T04:48:39Z [load_day 2026-08-02] 2026-08-02 hour 23: 171880 events in 4 files, snapshot 136961139222307187 (task 3486 ms: download 1066 ms overlapping gunzip 197 ms, parse 775 ms, sort 119 ms, write 1483 ms, index 266 ms: 2 candidates, 41759 repo-hours, 9 releases; waiting 310 ms; commit 881 ms)
2026-11-07T04:48:43Z [load_day 2026-08-02] 2026-08-02: repo_hour merged from 24 files to 1 (850875 rows, 3994 ms)
2026-11-07T04:48:45Z [load_day 2026-08-02] 2026-08-02: index committed in 5795 ms (21 + 1 + 24 files)
2026-11-07T04:48:45Z [load_day 2026-08-02] 2026-08-02: 4081338 events in 24 hours
2026-11-07T04:48:45Z [load_day 2026-08-02] attempt 1 succeeded