orcaLog in

Runs · run 485

load_day 2026-06-09, attempt 1 succeeded

Host
4e84322b8c45:104393
Started
2026-11-07T05:56:41Z
Ended
2026-11-07T05:57:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/485/load_day/2026-06-09/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:56:41Z [load_day 2026-06-09] attempt 1 started
2026-11-07T05:56:48Z [load_day 2026-06-09] 2026-06-09 hour 0: 156305 events in 4 files, snapshot 1529310310623201496 (task 4597 ms: download 1889 ms overlapping gunzip 243 ms, parse 889 ms, sort 124 ms, write 2034 ms, index 459 ms: 9 candidates, 71331 repo-hours, 255 releases; waiting 520 ms; commit 961 ms)
2026-11-07T05:56:49Z [load_day 2026-06-09] 2026-06-09 hour 1: 158417 events in 4 files, snapshot 8639495266418047874 (task 4822 ms: download 2239 ms overlapping gunzip 265 ms, parse 973 ms, sort 113 ms, write 2133 ms, index 480 ms: 6 candidates, 75721 repo-hours, 213 releases; waiting 581 ms; commit 1009 ms)
2026-11-07T05:56:53Z [load_day 2026-06-09] 2026-06-09 hour 2: 163189 events in 4 files, snapshot 2500124435425015893 (task 4336 ms: download 1406 ms overlapping gunzip 223 ms, parse 810 ms, sort 118 ms, write 1763 ms, index 539 ms: 5 candidates, 84762 repo-hours, 93 releases; waiting 536 ms; commit 970 ms)
2026-11-07T05:56:55Z [load_day 2026-06-09] 2026-06-09 hour 3: 160792 events in 4 files, snapshot 5502732852366851174 (task 4236 ms: download 1313 ms overlapping gunzip 211 ms, parse 784 ms, sort 105 ms, write 1806 ms, index 500 ms: 8 candidates, 77565 repo-hours, 85 releases; waiting 527 ms; commit 1095 ms)
2026-11-07T05:56:58Z [load_day 2026-06-09] 2026-06-09 hour 4: 156172 events in 4 files, snapshot 5970923796575138146 (task 4139 ms: download 1228 ms overlapping gunzip 235 ms, parse 828 ms, sort 110 ms, write 1747 ms, index 485 ms: 12 candidates, 71129 repo-hours, 217 releases; waiting 512 ms; commit 1145 ms)
2026-11-07T05:57:00Z [load_day 2026-06-09] 2026-06-09 hour 5: 152254 events in 4 files, snapshot 1810283799310655271 (task 4025 ms: download 1386 ms overlapping gunzip 223 ms, parse 797 ms, sort 112 ms, write 1624 ms, index 474 ms: 5 candidates, 69282 repo-hours, 140 releases; waiting 516 ms; commit 1154 ms)
2026-11-07T05:57:03Z [load_day 2026-06-09] 2026-06-09 hour 6: 158587 events in 4 files, snapshot 1733364446767003687 (task 4027 ms: download 1186 ms overlapping gunzip 231 ms, parse 788 ms, sort 107 ms, write 1524 ms, index 505 ms: 9 candidates, 75868 repo-hours, 78 releases; waiting 529 ms; commit 1032 ms)
2026-11-07T05:57:04Z [load_day 2026-06-09] 2026-06-09 hour 7: 155102 events in 4 files, snapshot 283508356006063431 (task 3923 ms: download 1273 ms overlapping gunzip 233 ms, parse 815 ms, sort 98 ms, write 1437 ms, index 522 ms: 6 candidates, 74852 repo-hours, 57 releases; waiting 516 ms; commit 1061 ms)
2026-11-07T05:57:07Z [load_day 2026-06-09] 2026-06-09 hour 8: 156876 events in 4 files, snapshot 5419002157122171967 (task 4022 ms: download 1461 ms overlapping gunzip 225 ms, parse 769 ms, sort 100 ms, write 1517 ms, index 553 ms: 9 candidates, 81936 repo-hours, 49 releases; waiting 527 ms; commit 973 ms)
2026-11-07T05:57:08Z [load_day 2026-06-09] 2026-06-09 hour 9: 156672 events in 4 files, snapshot 4365027914631693509 (task 3977 ms: download 1366 ms overlapping gunzip 209 ms, parse 768 ms, sort 104 ms, write 1445 ms, index 579 ms: 7 candidates, 83990 repo-hours, 47 releases; waiting 551 ms; commit 915 ms)
2026-11-07T05:57:12Z [load_day 2026-06-09] 2026-06-09 hour 10: 161327 events in 4 files, snapshot 5292254016302335692 (task 4155 ms: download 1357 ms overlapping gunzip 221 ms, parse 799 ms, sort 101 ms, write 1623 ms, index 620 ms: 5 candidates, 85154 repo-hours, 83 releases; waiting 529 ms; commit 1092 ms)
2026-11-07T05:57:14Z [load_day 2026-06-09] 2026-06-09 hour 11: 159506 events in 4 files, snapshot 3910363787465465763 (task 4417 ms: download 2020 ms overlapping gunzip 212 ms, parse 770 ms, sort 108 ms, write 1634 ms, index 558 ms: 6 candidates, 82442 repo-hours, 74 releases; waiting 813 ms; commit 1073 ms)
2026-11-07T05:57:17Z [load_day 2026-06-09] 2026-06-09 hour 12: 163738 events in 4 files, snapshot 6302210576191109152 (task 4077 ms: download 1545 ms overlapping gunzip 228 ms, parse 843 ms, sort 108 ms, write 1544 ms, index 617 ms: 10 candidates, 86043 repo-hours, 66 releases; waiting 479 ms; commit 1134 ms)
2026-11-07T05:57:18Z [load_day 2026-06-09] 2026-06-09 hour 13: 156020 events in 4 files, snapshot 743311824293286500 (task 3913 ms: download 1412 ms overlapping gunzip 205 ms, parse 750 ms, sort 105 ms, write 1493 ms, index 547 ms: 15 candidates, 81447 repo-hours, 40 releases; waiting 539 ms; commit 1041 ms)
2026-11-07T05:57:22Z [load_day 2026-06-09] 2026-06-09 hour 14: 156998 events in 4 files, snapshot 3918492098185766954 (task 4249 ms: download 1570 ms overlapping gunzip 204 ms, parse 767 ms, sort 114 ms, write 1696 ms, index 602 ms: 5 candidates, 90524 repo-hours, 50 releases; waiting 541 ms; commit 923 ms)
2026-11-07T05:57:23Z [load_day 2026-06-09] 2026-06-09 hour 15: 159200 events in 4 files, snapshot 7465647644172581026 (task 4078 ms: download 1370 ms overlapping gunzip 203 ms, parse 745 ms, sort 107 ms, write 1630 ms, index 549 ms: 12 candidates, 83987 repo-hours, 48 releases; waiting 529 ms; commit 1248 ms)
2026-11-07T05:57:27Z [load_day 2026-06-09] 2026-06-09 hour 16: 159746 events in 4 files, snapshot 6386582801538777175 (task 4116 ms: download 1638 ms overlapping gunzip 201 ms, parse 766 ms, sort 101 ms, write 1636 ms, index 558 ms: 7 candidates, 82297 repo-hours, 40 releases; waiting 528 ms; commit 1053 ms)
2026-11-07T05:57:28Z [load_day 2026-06-09] 2026-06-09 hour 17: 159597 events in 4 files, snapshot 3477191936343100042 (task 4078 ms: download 1458 ms overlapping gunzip 206 ms, parse 761 ms, sort 103 ms, write 1605 ms, index 565 ms: 12 candidates, 80177 repo-hours, 48 releases; waiting 536 ms; commit 1113 ms)
2026-11-07T05:57:31Z [load_day 2026-06-09] 2026-06-09 hour 18: 158902 events in 4 files, snapshot 6153693816222657799 (task 4089 ms: download 1167 ms overlapping gunzip 208 ms, parse 754 ms, sort 113 ms, write 1589 ms, index 602 ms: 7 candidates, 80891 repo-hours, 39 releases; waiting 546 ms; commit 936 ms)
2026-11-07T05:57:33Z [load_day 2026-06-09] 2026-06-09 hour 19: 158476 events in 4 files, snapshot 4666925905974230589 (task 3535 ms: download 858 ms overlapping gunzip 203 ms, parse 757 ms, sort 105 ms, write 1542 ms, index 544 ms: 10 candidates, 78928 repo-hours, 77 releases; waiting 176 ms; commit 1066 ms)
2026-11-07T05:57:37Z [load_day 2026-06-09] 2026-06-09 hour 20: 155785 events in 4 files, snapshot 5950293348285781329 (task 4352 ms: download 1352 ms overlapping gunzip 254 ms, parse 917 ms, sort 122 ms, write 1698 ms, index 524 ms: 11 candidates, 77462 repo-hours, 76 releases; waiting 526 ms; commit 1120 ms)
2026-11-07T05:57:38Z [load_day 2026-06-09] 2026-06-09 hour 21: 161209 events in 4 files, snapshot 7304888145955707083 (task 4328 ms: download 1947 ms overlapping gunzip 220 ms, parse 802 ms, sort 116 ms, write 1804 ms, index 530 ms: 15 candidates, 73873 repo-hours, 76 releases; waiting 229 ms; commit 1107 ms)
2026-11-07T05:57:42Z [load_day 2026-06-09] 2026-06-09 hour 22: 156904 events in 4 files, snapshot 3114325596329564725 (task 4153 ms: download 1263 ms overlapping gunzip 260 ms, parse 843 ms, sort 130 ms, write 1663 ms, index 519 ms: 7 candidates, 70570 repo-hours, 117 releases; waiting 526 ms; commit 1227 ms)
2026-11-07T05:57:43Z [load_day 2026-06-09] 2026-06-09 hour 23: 158697 events in 4 files, snapshot 8846525898631611730 (task 4505 ms: download 1457 ms overlapping gunzip 290 ms, parse 1000 ms, sort 122 ms, write 1805 ms, index 446 ms: 9 candidates, 68729 repo-hours, 313 releases; waiting 542 ms; commit 906 ms)
2026-11-07T05:57:51Z [load_day 2026-06-09] 2026-06-09: repo_hour merged from 24 files to 1 (1888960 rows, 7824 ms)
2026-11-07T05:57:52Z [load_day 2026-06-09] 2026-06-09: index committed in 9478 ms (24 + 1 + 24 files)
2026-11-07T05:57:52Z [load_day 2026-06-09] 2026-06-09: 3800471 events in 24 hours
2026-11-07T05:57:52Z [load_day 2026-06-09] attempt 1 succeeded