orcaLog in

Runs · run 320

load_day 2026-08-03, attempt 1 succeeded

Host
4e84322b8c45:57091
Started
2026-11-07T04:46:41Z
Ended
2026-11-07T04:47:41Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/320/load_day/2026-08-03/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:46:41Z [load_day 2026-08-03] attempt 1 started
2026-11-07T04:46:48Z [load_day 2026-08-03] 2026-08-03 hour 0: 165375 events in 4 files, snapshot 8204760688217733745 (task 3880 ms: download 1205 ms overlapping gunzip 195 ms, parse 775 ms, sort 115 ms, write 1749 ms, index 244 ms: 0 candidates, 38989 repo-hours, 8 releases; waiting 501 ms; commit 789 ms)
2026-11-07T04:46:49Z [load_day 2026-08-03] 2026-08-03 hour 1: 169274 events in 4 files, snapshot 8580600995293120615 (task 3884 ms: download 1324 ms overlapping gunzip 195 ms, parse 771 ms, sort 119 ms, write 1598 ms, index 334 ms: 1 candidates, 52084 repo-hours, 14 releases; waiting 513 ms; commit 941 ms)
2026-11-07T04:46:52Z [load_day 2026-08-03] 2026-08-03 hour 2: 168791 events in 4 files, snapshot 7469557656952508156 (task 3808 ms: download 1847 ms overlapping gunzip 195 ms, parse 778 ms, sort 112 ms, write 1581 ms, index 323 ms: 3 candidates, 50243 repo-hours, 13 releases; waiting 532 ms; commit 798 ms)
2026-11-07T04:46:53Z [load_day 2026-08-03] 2026-08-03 hour 3: 168789 events in 4 files, snapshot 7997288307035448874 (task 3593 ms: download 1205 ms overlapping gunzip 186 ms, parse 769 ms, sort 113 ms, write 1445 ms, index 185 ms: 0 candidates, 29736 repo-hours, 12 releases; waiting 500 ms; commit 925 ms)
2026-11-07T04:46:56Z [load_day 2026-08-03] 2026-08-03 hour 4: 172892 events in 4 files, snapshot 3907546778606200295 (task 3668 ms: download 1277 ms overlapping gunzip 195 ms, parse 781 ms, sort 168 ms, write 1517 ms, index 172 ms: 2 candidates, 24627 repo-hours, 7 releases; waiting 530 ms; commit 909 ms)
2026-11-07T04:46:57Z [load_day 2026-08-03] 2026-08-03 hour 5: 171739 events in 4 files, snapshot 3278008849989248400 (task 3596 ms: download 1179 ms overlapping gunzip 188 ms, parse 761 ms, sort 107 ms, write 1563 ms, index 184 ms: 2 candidates, 22507 repo-hours, 6 releases; waiting 527 ms; commit 904 ms)
2026-11-07T04:47:01Z [load_day 2026-08-03] 2026-08-03 hour 6: 167257 events in 4 files, snapshot 615403251143342221 (task 3664 ms: download 1167 ms overlapping gunzip 188 ms, parse 764 ms, sort 107 ms, write 1563 ms, index 170 ms: 1 candidates, 25358 repo-hours, 3 releases; waiting 652 ms; commit 1010 ms)
2026-11-07T04:47:03Z [load_day 2026-08-03] 2026-08-03 hour 7: 160782 events in 4 files, snapshot 1846083627817337015 (task 3492 ms: download 1168 ms overlapping gunzip 185 ms, parse 732 ms, sort 107 ms, write 1477 ms, index 167 ms: 3 candidates, 25675 repo-hours, 10 releases; waiting 539 ms; commit 2206 ms)
2026-11-07T04:47:05Z [load_day 2026-08-03] 2026-08-03 hour 8: 157792 events in 4 files, snapshot 3627396613084410938 (task 3449 ms: download 1312 ms overlapping gunzip 183 ms, parse 711 ms, sort 109 ms, write 1446 ms, index 188 ms: 4 candidates, 27412 repo-hours, 6 releases; waiting 524 ms; commit 900 ms)
2026-11-07T04:47:06Z [load_day 2026-08-03] 2026-08-03 hour 9: 153688 events in 4 files, snapshot 6875634140173148066 (task 3453 ms: download 1292 ms overlapping gunzip 187 ms, parse 761 ms, sort 102 ms, write 1353 ms, index 192 ms: 1 candidates, 27330 repo-hours, 6 releases; waiting 526 ms; commit 895 ms)
2026-11-07T04:47:09Z [load_day 2026-08-03] 2026-08-03 hour 10: 155709 events in 4 files, snapshot 3285024139727583794 (task 3414 ms: download 1539 ms overlapping gunzip 195 ms, parse 734 ms, sort 101 ms, write 1304 ms, index 225 ms: 2 candidates, 34046 repo-hours, 11 releases; waiting 529 ms; commit 1054 ms)
2026-11-07T04:47:10Z [load_day 2026-08-03] 2026-08-03 hour 11: 158145 events in 4 files, snapshot 1177402541121276938 (task 3414 ms: download 1120 ms overlapping gunzip 184 ms, parse 747 ms, sort 110 ms, write 1357 ms, index 207 ms: 1 candidates, 29627 repo-hours, 5 releases; waiting 509 ms; commit 855 ms)
2026-11-07T04:47:13Z [load_day 2026-08-03] 2026-08-03 hour 12: 161212 events in 4 files, snapshot 3066831102561836139 (task 3439 ms: download 1100 ms overlapping gunzip 184 ms, parse 730 ms, sort 104 ms, write 1437 ms, index 179 ms: 0 candidates, 29845 repo-hours, 8 releases; waiting 531 ms; commit 1014 ms)
2026-11-07T04:47:14Z [load_day 2026-08-03] 2026-08-03 hour 13: 151180 events in 4 files, snapshot 7288520591833756219 (task 3265 ms: download 1280 ms overlapping gunzip 173 ms, parse 694 ms, sort 107 ms, write 1295 ms, index 171 ms: 1 candidates, 26973 repo-hours, 12 releases; waiting 526 ms; commit 786 ms)
2026-11-07T04:47:17Z [load_day 2026-08-03] 2026-08-03 hour 14: 135692 events in 3 files, snapshot 1946354366433072544 (task 3231 ms: download 1106 ms overlapping gunzip 171 ms, parse 677 ms, sort 92 ms, write 1213 ms, index 199 ms: 4 candidates, 31097 repo-hours, 13 releases; waiting 522 ms; commit 978 ms)
2026-11-07T04:47:18Z [load_day 2026-08-03] 2026-08-03 hour 15: 127116 events in 3 files, snapshot 6133590733304300587 (task 3132 ms: download 1198 ms overlapping gunzip 163 ms, parse 602 ms, sort 84 ms, write 1183 ms, index 184 ms: 2 candidates, 28229 repo-hours, 18 releases; waiting 513 ms; commit 888 ms)
2026-11-07T04:47:21Z [load_day 2026-08-03] 2026-08-03 hour 16: 123401 events in 3 files, snapshot 568235034942292429 (task 3065 ms: download 1134 ms overlapping gunzip 153 ms, parse 573 ms, sort 78 ms, write 1169 ms, index 250 ms: 1 candidates, 30956 repo-hours, 22 releases; waiting 539 ms; commit 807 ms)
2026-11-07T04:47:22Z [load_day 2026-08-03] 2026-08-03 hour 17: 135826 events in 3 files, snapshot 2573320870715666817 (task 3180 ms: download 1214 ms overlapping gunzip 168 ms, parse 670 ms, sort 88 ms, write 1225 ms, index 210 ms: 1 candidates, 30789 repo-hours, 20 releases; waiting 514 ms; commit 930 ms)
2026-11-07T04:47:25Z [load_day 2026-08-03] 2026-08-03 hour 18: 138675 events in 3 files, snapshot 6267992936392826344 (task 3188 ms: download 1091 ms overlapping gunzip 183 ms, parse 666 ms, sort 94 ms, write 1210 ms, index 220 ms: 1 candidates, 31973 repo-hours, 24 releases; waiting 526 ms; commit 916 ms)
2026-11-07T04:47:26Z [load_day 2026-08-03] 2026-08-03 hour 19: 146144 events in 3 files, snapshot 8771201874852324281 (task 3483 ms: download 1168 ms overlapping gunzip 182 ms, parse 697 ms, sort 113 ms, write 1294 ms, index 257 ms: 5 candidates, 38144 repo-hours, 12 releases; waiting 549 ms; commit 1129 ms)
2026-11-07T04:47:29Z [load_day 2026-08-03] 2026-08-03 hour 20: 157935 events in 4 files, snapshot 5880934401045968800 (task 3696 ms: download 1607 ms overlapping gunzip 186 ms, parse 742 ms, sort 105 ms, write 1515 ms, index 267 ms: 3 candidates, 36779 repo-hours, 17 releases; waiting 520 ms; commit 921 ms)
2026-11-07T04:47:31Z [load_day 2026-08-03] 2026-08-03 hour 21: 164389 events in 4 files, snapshot 4238618968547530321 (task 3639 ms: download 1398 ms overlapping gunzip 188 ms, parse 751 ms, sort 106 ms, write 1500 ms, index 276 ms: 6 candidates, 37069 repo-hours, 11 releases; waiting 509 ms; commit 1050 ms)
2026-11-07T04:47:34Z [load_day 2026-08-03] 2026-08-03 hour 22: 168778 events in 4 files, snapshot 4266358714729714664 (task 3739 ms: download 1363 ms overlapping gunzip 196 ms, parse 764 ms, sort 113 ms, write 1591 ms, index 251 ms: 1 candidates, 36982 repo-hours, 8 releases; waiting 518 ms; commit 1049 ms)
2026-11-07T04:47:35Z [load_day 2026-08-03] 2026-08-03 hour 23: 166558 events in 4 files, snapshot 6994823808855576361 (task 3765 ms: download 1178 ms overlapping gunzip 203 ms, parse 784 ms, sort 113 ms, write 1579 ms, index 239 ms: 0 candidates, 35531 repo-hours, 14 releases; waiting 515 ms; commit 1040 ms)
2026-11-07T04:47:39Z [load_day 2026-08-03] 2026-08-03: repo_hour merged from 24 files to 1 (782001 rows, 3784 ms)
2026-11-07T04:47:41Z [load_day 2026-08-03] 2026-08-03: index committed in 5950 ms (20 + 1 + 24 files)
2026-11-07T04:47:41Z [load_day 2026-08-03] 2026-08-03: 3747139 events in 24 hours
2026-11-07T04:47:41Z [load_day 2026-08-03] attempt 1 succeeded