orcaLog in

Runs · run 308

load_day 2026-08-07, attempt 1 succeeded

Host
4e84322b8c45:54417
Started
2026-11-07T04:41:52Z
Ended
2026-11-07T04:42:55Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/308/load_day/2026-08-07/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:41:52Z [load_day 2026-08-07] attempt 1 started
2026-11-07T04:41:58Z [load_day 2026-08-07] 2026-08-07 hour 0: 166568 events in 4 files, snapshot 7944468476313161611 (task 3468 ms: download 1072 ms overlapping gunzip 193 ms, parse 758 ms, sort 106 ms, write 1499 ms, index 261 ms: 2 candidates, 37413 repo-hours, 16 releases; waiting 377 ms; commit 778 ms)
2026-11-07T04:41:59Z [load_day 2026-08-07] 2026-08-07 hour 1: 166878 events in 4 files, snapshot 4615767757816237500 (task 3957 ms: download 1351 ms overlapping gunzip 192 ms, parse 762 ms, sort 109 ms, write 1550 ms, index 256 ms: 1 candidates, 36574 repo-hours, 11 releases; waiting 534 ms; commit 897 ms)
2026-11-07T04:42:02Z [load_day 2026-08-07] 2026-08-07 hour 2: 166026 events in 4 files, snapshot 5121191293156338889 (task 3766 ms: download 1443 ms overlapping gunzip 188 ms, parse 750 ms, sort 106 ms, write 1688 ms, index 307 ms: 2 candidates, 48935 repo-hours, 11 releases; waiting 512 ms; commit 866 ms)
2026-11-07T04:42:03Z [load_day 2026-08-07] 2026-08-07 hour 3: 168395 events in 4 files, snapshot 6122992796855718107 (task 3551 ms: download 1333 ms overlapping gunzip 188 ms, parse 753 ms, sort 116 ms, write 1553 ms, index 180 ms: 1 candidates, 28537 repo-hours, 2 releases; waiting 518 ms; commit 738 ms)
2026-11-07T04:42:08Z [load_day 2026-08-07] 2026-08-07 hour 4: 168008 events in 4 files, snapshot 4307316700572436421 (task 4135 ms: download 1350 ms overlapping gunzip 203 ms, parse 771 ms, sort 108 ms, write 1589 ms, index 167 ms: 2 candidates, 23223 repo-hours, 5 releases; waiting 532 ms; commit 1817 ms)
2026-11-07T04:42:09Z [load_day 2026-08-07] 2026-08-07 hour 5: 165640 events in 4 files, snapshot 7595990643683834939 (task 3434 ms: download 1277 ms overlapping gunzip 188 ms, parse 735 ms, sort 104 ms, write 1435 ms, index 161 ms: 0 candidates, 24320 repo-hours, 6 releases; waiting 523 ms; commit 750 ms)
2026-11-07T04:42:11Z [load_day 2026-08-07] 2026-08-07 hour 6: 149092 events in 3 files, snapshot 7734019957313184482 (task 3203 ms: download 1301 ms overlapping gunzip 168 ms, parse 660 ms, sort 102 ms, write 1268 ms, index 148 ms: 2 candidates, 21917 repo-hours, 11 releases; waiting 532 ms; commit 799 ms)
2026-11-07T04:42:13Z [load_day 2026-08-07] 2026-08-07 hour 7: 120883 events in 3 files, snapshot 9194945370771585418 (task 2987 ms: download 1143 ms overlapping gunzip 138 ms, parse 555 ms, sort 73 ms, write 1251 ms, index 155 ms: 1 candidates, 21870 repo-hours, 12 releases; waiting 526 ms; commit 931 ms)
2026-11-07T04:42:14Z [load_day 2026-08-07] 2026-08-07 hour 8: 78000 events in 2 files, snapshot 6545038797380488121 (task 2244 ms: download 871 ms overlapping gunzip 103 ms, parse 379 ms, sort 45 ms, write 773 ms, index 112 ms: 0 candidates, 17893 repo-hours, 16 releases; waiting 519 ms; commit 815 ms)
2026-11-07T04:42:15Z [load_day 2026-08-07] 2026-08-07 hour 9: 45278 events in 1 files, snapshot 6831938565162078605 (task 1660 ms: download 803 ms overlapping gunzip 60 ms, parse 237 ms, sort 27 ms, write 405 ms, index 93 ms: 0 candidates, 14501 repo-hours, 8 releases; waiting 547 ms; commit 805 ms)
2026-11-07T04:42:16Z [load_day 2026-08-07] 2026-08-07 hour 10: 44279 events in 1 files, snapshot 1248278049976621898 (task 1767 ms: download 848 ms overlapping gunzip 62 ms, parse 246 ms, sort 30 ms, write 402 ms, index 93 ms: 0 candidates, 14421 repo-hours, 14 releases; waiting 636 ms; commit 886 ms)
2026-11-07T04:42:17Z [load_day 2026-08-07] 2026-08-07 hour 11: 46943 events in 1 files, snapshot 1234225670202183415 (task 1699 ms: download 804 ms overlapping gunzip 63 ms, parse 248 ms, sort 27 ms, write 421 ms, index 98 ms: 0 candidates, 15479 repo-hours, 11 releases; waiting 541 ms; commit 617 ms)
2026-11-07T04:42:18Z [load_day 2026-08-07] 2026-08-07 hour 12: 47992 events in 1 files, snapshot 2140134231700651363 (task 1733 ms: download 815 ms overlapping gunzip 69 ms, parse 274 ms, sort 33 ms, write 419 ms, index 95 ms: 0 candidates, 15360 repo-hours, 14 releases; waiting 541 ms; commit 880 ms)
2026-11-07T04:42:20Z [load_day 2026-08-07] 2026-08-07 hour 13: 47311 events in 1 files, snapshot 7059918400672668311 (task 2227 ms: download 788 ms overlapping gunzip 63 ms, parse 247 ms, sort 31 ms, write 413 ms, index 107 ms: 2 candidates, 15483 repo-hours, 7 releases; waiting 528 ms; commit 1030 ms)
2026-11-07T04:42:21Z [load_day 2026-08-07] 2026-08-07 hour 14: 47605 events in 1 files, snapshot 7209026092704981902 (task 2023 ms: download 865 ms overlapping gunzip 89 ms, parse 315 ms, sort 41 ms, write 600 ms, index 105 ms: 0 candidates, 16755 repo-hours, 112 releases; waiting 549 ms; commit 908 ms)
2026-11-07T04:42:23Z [load_day 2026-08-07] 2026-08-07 hour 15: 37883 events in 1 files, snapshot 4572128379487889509 (task 2305 ms: download 1008 ms overlapping gunzip 114 ms, parse 376 ms, sort 38 ms, write 746 ms, index 118 ms: 3 candidates, 16870 repo-hours, 209 releases; waiting 593 ms; commit 876 ms)
2026-11-07T04:42:31Z [load_day 2026-08-07] 2026-08-07 hour 16: 78877 events in 2 files, snapshot 5256615622651716828 (task 8483 ms: download 3081 ms overlapping gunzip 636 ms, parse 1899 ms, sort 191 ms, write 4359 ms, index 250 ms: 1 candidates, 40997 repo-hours, 1842 releases; waiting 801 ms; commit 970 ms)
2026-11-07T04:42:36Z [load_day 2026-08-07] 2026-08-07 hour 17: 92009 events in 2 files, snapshot 1356160183503017477 (task 9308 ms: download 3728 ms overlapping gunzip 767 ms, parse 2292 ms, sort 192 ms, write 4565 ms, index 272 ms: 2 candidates, 44625 repo-hours, 2126 releases; waiting 903 ms; commit 3898 ms)
2026-11-07T04:42:38Z [load_day 2026-08-07] 2026-08-07 hour 18: 67228 events in 2 files, snapshot 732649169212415311 (task 6717 ms: download 2325 ms overlapping gunzip 423 ms, parse 1309 ms, sort 136 ms, write 3539 ms, index 225 ms: 4 candidates, 35163 repo-hours, 1328 releases; waiting 714 ms; commit 804 ms)
2026-11-07T04:42:42Z [load_day 2026-08-07] 2026-08-07 hour 19: 74542 events in 2 files, snapshot 1850074565804735031 (task 5369 ms: download 1808 ms overlapping gunzip 341 ms, parse 1043 ms, sort 118 ms, write 2651 ms, index 243 ms: 2 candidates, 37163 repo-hours, 901 releases; waiting 653 ms; commit 917 ms)
2026-11-07T04:42:43Z [load_day 2026-08-07] 2026-08-07 hour 20: 97951 events in 2 files, snapshot 786942551093156033 (task 3980 ms: download 1332 ms overlapping gunzip 312 ms, parse 868 ms, sort 133 ms, write 1777 ms, index 286 ms: 3 candidates, 42666 repo-hours, 338 releases; waiting 234 ms; commit 793 ms)
2026-11-07T04:42:46Z [load_day 2026-08-07] 2026-08-07 hour 21: 122739 events in 3 files, snapshot 1292117895916659713 (task 3622 ms: download 1306 ms overlapping gunzip 205 ms, parse 689 ms, sort 87 ms, write 1441 ms, index 313 ms: 5 candidates, 47436 repo-hours, 158 releases; waiting 559 ms; commit 958 ms)
2026-11-07T04:42:47Z [load_day 2026-08-07] 2026-08-07 hour 22: 135189 events in 3 files, snapshot 3292044515823449122 (task 3453 ms: download 1464 ms overlapping gunzip 178 ms, parse 644 ms, sort 85 ms, write 1403 ms, index 320 ms: 5 candidates, 48982 repo-hours, 53 releases; waiting 520 ms; commit 996 ms)
2026-11-07T04:42:50Z [load_day 2026-08-07] 2026-08-07 hour 23: 151876 events in 4 files, snapshot 8884966361641607110 (task 3264 ms: download 1344 ms overlapping gunzip 187 ms, parse 689 ms, sort 103 ms, write 1300 ms, index 299 ms: 2 candidates, 47318 repo-hours, 36 releases; waiting 401 ms; commit 885 ms)
2026-11-07T04:42:54Z [load_day 2026-08-07] 2026-08-07: repo_hour merged from 24 files to 1 (713901 rows, 3627 ms)
2026-11-07T04:42:55Z [load_day 2026-08-07] 2026-08-07: index committed in 5100 ms (17 + 1 + 24 files)
2026-11-07T04:42:55Z [load_day 2026-08-07] 2026-08-07: 2487192 events in 24 hours
2026-11-07T04:42:55Z [load_day 2026-08-07] attempt 1 succeeded