orcaLog in

Runs · run 260

load_day 2026-08-23, attempt 1 succeeded

Host
4e84322b8c45:43123
Started
2026-11-07T04:26:37Z
Ended
2026-11-07T04:27:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/260/load_day/2026-08-23/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:26:37Z [load_day 2026-08-23] attempt 1 started
2026-11-07T04:26:44Z [load_day 2026-08-23] 2026-08-23 hour 0: 168587 events in 4 files, snapshot 5854881159031900021 (task 3700 ms: download 1437 ms overlapping gunzip 186 ms, parse 756 ms, sort 106 ms, write 1624 ms, index 174 ms: 1 candidates, 27429 repo-hours, 13 releases; waiting 530 ms; commit 853 ms)
2026-11-07T04:26:45Z [load_day 2026-08-23] 2026-08-23 hour 1: 170792 events in 4 files, snapshot 794242261676013132 (task 3792 ms: download 1117 ms overlapping gunzip 194 ms, parse 772 ms, sort 106 ms, write 1745 ms, index 234 ms: 0 candidates, 32656 repo-hours, 3 releases; waiting 503 ms; commit 791 ms)
2026-11-07T04:26:49Z [load_day 2026-08-23] 2026-08-23 hour 2: 172186 events in 4 files, snapshot 3806665072024786412 (task 3856 ms: download 1815 ms overlapping gunzip 211 ms, parse 834 ms, sort 109 ms, write 1653 ms, index 203 ms: 2 candidates, 25927 repo-hours, 10 releases; waiting 514 ms; commit 907 ms)
2026-11-07T04:26:50Z [load_day 2026-08-23] 2026-08-23 hour 3: 171395 events in 4 files, snapshot 1949983396369877065 (task 3599 ms: download 1799 ms overlapping gunzip 207 ms, parse 752 ms, sort 106 ms, write 1615 ms, index 144 ms: 0 candidates, 21046 repo-hours, 4 releases; waiting 405 ms; commit 931 ms)
2026-11-07T04:26:53Z [load_day 2026-08-23] 2026-08-23 hour 4: 169792 events in 4 files, snapshot 612151549644920405 (task 3691 ms: download 1170 ms overlapping gunzip 195 ms, parse 793 ms, sort 108 ms, write 1609 ms, index 141 ms: 2 candidates, 21047 repo-hours, 8 releases; waiting 552 ms; commit 857 ms)
2026-11-07T04:26:54Z [load_day 2026-08-23] 2026-08-23 hour 5: 171213 events in 4 files, snapshot 8080058761272464397 (task 3581 ms: download 1504 ms overlapping gunzip 196 ms, parse 795 ms, sort 108 ms, write 1595 ms, index 163 ms: 3 candidates, 22256 repo-hours, 5 releases; waiting 527 ms; commit 729 ms)
2026-11-07T04:26:58Z [load_day 2026-08-23] 2026-08-23 hour 6: 172327 events in 4 files, snapshot 2048387574600464564 (task 3626 ms: download 1366 ms overlapping gunzip 198 ms, parse 788 ms, sort 104 ms, write 1580 ms, index 156 ms: 8 candidates, 23471 repo-hours, 5 releases; waiting 536 ms; commit 884 ms)
2026-11-07T04:26:58Z [load_day 2026-08-23] 2026-08-23 hour 7: 166809 events in 4 files, snapshot 5396922082267641722 (task 3522 ms: download 1210 ms overlapping gunzip 188 ms, parse 764 ms, sort 99 ms, write 1614 ms, index 159 ms: 1 candidates, 22567 repo-hours, 4 releases; waiting 405 ms; commit 798 ms)
2026-11-07T04:27:02Z [load_day 2026-08-23] 2026-08-23 hour 8: 172920 events in 4 files, snapshot 2118591716584770570 (task 3884 ms: download 1462 ms overlapping gunzip 227 ms, parse 869 ms, sort 137 ms, write 1707 ms, index 182 ms: 2 candidates, 24824 repo-hours, 9 releases; waiting 364 ms; commit 932 ms)
2026-11-07T04:27:03Z [load_day 2026-08-23] 2026-08-23 hour 9: 172523 events in 4 files, snapshot 1385006029804112170 (task 3682 ms: download 1371 ms overlapping gunzip 197 ms, parse 770 ms, sort 111 ms, write 1584 ms, index 181 ms: 1 candidates, 25248 repo-hours, 28 releases; waiting 536 ms; commit 995 ms)
2026-11-07T04:27:06Z [load_day 2026-08-23] 2026-08-23 hour 10: 170910 events in 4 files, snapshot 660448606202878867 (task 3697 ms: download 1335 ms overlapping gunzip 195 ms, parse 780 ms, sort 114 ms, write 1575 ms, index 175 ms: 2 candidates, 27774 repo-hours, 6 releases; waiting 531 ms; commit 745 ms)
2026-11-07T04:27:07Z [load_day 2026-08-23] 2026-08-23 hour 11: 169187 events in 4 files, snapshot 8526438108034244924 (task 3514 ms: download 1384 ms overlapping gunzip 190 ms, parse 747 ms, sort 105 ms, write 1448 ms, index 191 ms: 4 candidates, 28888 repo-hours, 15 releases; waiting 532 ms; commit 760 ms)
2026-11-07T04:27:11Z [load_day 2026-08-23] 2026-08-23 hour 12: 169788 events in 4 files, snapshot 5198073825052079032 (task 4340 ms: download 1273 ms overlapping gunzip 189 ms, parse 764 ms, sort 101 ms, write 2161 ms, index 203 ms: 1 candidates, 32634 repo-hours, 7 releases; waiting 539 ms; commit 733 ms)
2026-11-07T04:27:12Z [load_day 2026-08-23] 2026-08-23 hour 13: 170495 events in 4 files, snapshot 2336638707460427812 (task 3540 ms: download 1625 ms overlapping gunzip 199 ms, parse 778 ms, sort 106 ms, write 1496 ms, index 220 ms: 1 candidates, 32916 repo-hours, 6 releases; waiting 508 ms; commit 758 ms)
2026-11-07T04:27:16Z [load_day 2026-08-23] 2026-08-23 hour 14: 171280 events in 4 files, snapshot 8071895008464729144 (task 3774 ms: download 1373 ms overlapping gunzip 204 ms, parse 848 ms, sort 107 ms, write 1587 ms, index 229 ms: 1 candidates, 31045 repo-hours, 13 releases; waiting 513 ms; commit 766 ms)
2026-11-07T04:27:16Z [load_day 2026-08-23] 2026-08-23 hour 15: 169892 events in 4 files, snapshot 2651266473942377688 (task 3593 ms: download 1470 ms overlapping gunzip 196 ms, parse 770 ms, sort 105 ms, write 1513 ms, index 199 ms: 0 candidates, 32278 repo-hours, 9 releases; waiting 521 ms; commit 826 ms)
2026-11-07T04:27:20Z [load_day 2026-08-23] 2026-08-23 hour 16: 164782 events in 4 files, snapshot 2371464587770342970 (task 3569 ms: download 1123 ms overlapping gunzip 189 ms, parse 753 ms, sort 117 ms, write 1515 ms, index 236 ms: 8 candidates, 33988 repo-hours, 16 releases; waiting 526 ms; commit 795 ms)
2026-11-07T04:27:20Z [load_day 2026-08-23] 2026-08-23 hour 17: 167194 events in 4 files, snapshot 676330916258686792 (task 3717 ms: download 1336 ms overlapping gunzip 192 ms, parse 733 ms, sort 102 ms, write 1579 ms, index 225 ms: 5 candidates, 34000 repo-hours, 19 releases; waiting 565 ms; commit 699 ms)
2026-11-07T04:27:24Z [load_day 2026-08-23] 2026-08-23 hour 18: 170788 events in 4 files, snapshot 2042139586781141776 (task 3895 ms: download 1419 ms overlapping gunzip 194 ms, parse 786 ms, sort 115 ms, write 1656 ms, index 263 ms: 0 candidates, 37559 repo-hours, 16 releases; waiting 532 ms; commit 760 ms)
2026-11-07T04:27:25Z [load_day 2026-08-23] 2026-08-23 hour 19: 167386 events in 4 files, snapshot 404517976303951318 (task 3734 ms: download 1497 ms overlapping gunzip 198 ms, parse 752 ms, sort 100 ms, write 1580 ms, index 260 ms: 0 candidates, 35782 repo-hours, 10 releases; waiting 537 ms; commit 761 ms)
2026-11-07T04:27:29Z [load_day 2026-08-23] 2026-08-23 hour 20: 169385 events in 4 files, snapshot 1476758231043939039 (task 3771 ms: download 1222 ms overlapping gunzip 204 ms, parse 793 ms, sort 117 ms, write 1717 ms, index 264 ms: 4 candidates, 35552 repo-hours, 6 releases; waiting 391 ms; commit 732 ms)
2026-11-07T04:27:29Z [load_day 2026-08-23] 2026-08-23 hour 21: 170572 events in 4 files, snapshot 747045767522200729 (task 3739 ms: download 1415 ms overlapping gunzip 193 ms, parse 749 ms, sort 102 ms, write 1601 ms, index 238 ms: 0 candidates, 35893 repo-hours, 8 releases; waiting 533 ms; commit 745 ms)
2026-11-07T04:27:33Z [load_day 2026-08-23] 2026-08-23 hour 22: 164700 events in 4 files, snapshot 1888959346944748387 (task 3570 ms: download 1354 ms overlapping gunzip 188 ms, parse 738 ms, sort 102 ms, write 1473 ms, index 227 ms: 6 candidates, 35562 repo-hours, 13 releases; waiting 543 ms; commit 732 ms)
2026-11-07T04:27:34Z [load_day 2026-08-23] 2026-08-23 hour 23: 168681 events in 4 files, snapshot 3189497715249832717 (task 3682 ms: download 1384 ms overlapping gunzip 203 ms, parse 778 ms, sort 106 ms, write 1535 ms, index 227 ms: 3 candidates, 35004 repo-hours, 10 releases; waiting 520 ms; commit 699 ms)
2026-11-07T04:27:37Z [load_day 2026-08-23] 2026-08-23: repo_hour merged from 24 files to 1 (715346 rows, 3441 ms)
2026-11-07T04:27:39Z [load_day 2026-08-23] 2026-08-23: index committed in 5299 ms (18 + 1 + 24 files)
2026-11-07T04:27:39Z [load_day 2026-08-23] 2026-08-23: 4073584 events in 24 hours
2026-11-07T04:27:39Z [load_day 2026-08-23] attempt 1 succeeded