orcaLog in

Runs · run 365

load_day 2026-07-19, attempt 1 succeeded

Host
4e84322b8c45:69863
Started
2026-11-07T05:02:40Z
Ended
2026-11-07T05:03:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/365/load_day/2026-07-19/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:02:40Z [load_day 2026-07-19] attempt 1 started
2026-11-07T05:02:48Z [load_day 2026-07-19] 2026-07-19 hour 0: 162678 events in 4 files, snapshot 5482964973652188053 (task 4639 ms: download 1882 ms overlapping gunzip 259 ms, parse 947 ms, sort 129 ms, write 1989 ms, index 386 ms: 3 candidates, 60339 repo-hours, 264 releases; waiting 502 ms; commit 1084 ms)
2026-11-07T05:02:49Z [load_day 2026-07-19] 2026-07-19 hour 1: 166905 events in 4 files, snapshot 1069933873524484978 (task 4385 ms: download 1687 ms overlapping gunzip 216 ms, parse 827 ms, sort 120 ms, write 1848 ms, index 504 ms: 2 candidates, 71827 repo-hours, 75 releases; waiting 518 ms; commit 950 ms)
2026-11-07T05:02:53Z [load_day 2026-07-19] 2026-07-19 hour 2: 168446 events in 4 files, snapshot 5212938210208861788 (task 3893 ms: download 1264 ms overlapping gunzip 215 ms, parse 826 ms, sort 127 ms, write 1521 ms, index 371 ms: 2 candidates, 56635 repo-hours, 20 releases; waiting 515 ms; commit 937 ms)
2026-11-07T05:02:54Z [load_day 2026-07-19] 2026-07-19 hour 3: 171476 events in 4 files, snapshot 8608391533942904600 (task 3898 ms: download 1314 ms overlapping gunzip 197 ms, parse 767 ms, sort 106 ms, write 1499 ms, index 279 ms: 2 candidates, 40831 repo-hours, 19 releases; waiting 522 ms; commit 1071 ms)
2026-11-07T05:02:57Z [load_day 2026-07-19] 2026-07-19 hour 4: 169163 events in 4 files, snapshot 351072482325918745 (task 3776 ms: download 1418 ms overlapping gunzip 203 ms, parse 786 ms, sort 119 ms, write 1619 ms, index 269 ms: 4 candidates, 36610 repo-hours, 18 releases; waiting 524 ms; commit 1129 ms)
2026-11-07T05:02:58Z [load_day 2026-07-19] 2026-07-19 hour 5: 165474 events in 4 files, snapshot 5024933781747439071 (task 3524 ms: download 1118 ms overlapping gunzip 188 ms, parse 734 ms, sort 109 ms, write 1680 ms, index 289 ms: 5 candidates, 36111 repo-hours, 13 releases; waiting 241 ms; commit 1011 ms)
2026-11-07T05:03:02Z [load_day 2026-07-19] 2026-07-19 hour 6: 172278 events in 4 files, snapshot 3674331468160006942 (task 3953 ms: download 1572 ms overlapping gunzip 199 ms, parse 787 ms, sort 118 ms, write 1665 ms, index 227 ms: 3 candidates, 32400 repo-hours, 13 releases; waiting 529 ms; commit 992 ms)
2026-11-07T05:03:03Z [load_day 2026-07-19] 2026-07-19 hour 7: 170248 events in 4 files, snapshot 6128847617561406722 (task 3644 ms: download 1634 ms overlapping gunzip 186 ms, parse 754 ms, sort 113 ms, write 1562 ms, index 204 ms: 0 candidates, 29975 repo-hours, 23 releases; waiting 524 ms; commit 1139 ms)
2026-11-07T05:03:06Z [load_day 2026-07-19] 2026-07-19 hour 8: 172483 events in 4 files, snapshot 3530472816566125041 (task 3881 ms: download 1357 ms overlapping gunzip 192 ms, parse 785 ms, sort 123 ms, write 1671 ms, index 251 ms: 1 candidates, 31688 repo-hours, 10 releases; waiting 514 ms; commit 941 ms)
2026-11-07T05:03:07Z [load_day 2026-07-19] 2026-07-19 hour 9: 170778 events in 4 files, snapshot 5788776992704363965 (task 3652 ms: download 1301 ms overlapping gunzip 192 ms, parse 750 ms, sort 106 ms, write 1515 ms, index 251 ms: 2 candidates, 35509 repo-hours, 13 releases; waiting 531 ms; commit 941 ms)
2026-11-07T05:03:10Z [load_day 2026-07-19] 2026-07-19 hour 10: 172785 events in 4 files, snapshot 1825196884141949182 (task 3104 ms: download 346 ms overlapping gunzip 199 ms, parse 766 ms, sort 112 ms, write 1547 ms, index 282 ms: 4 candidates, 38005 repo-hours, 11 releases; waiting 14 ms; commit 908 ms)
2026-11-07T05:03:12Z [load_day 2026-07-19] 2026-07-19 hour 11: 169590 events in 4 files, snapshot 7028875664317582647 (task 3750 ms: download 1520 ms overlapping gunzip 213 ms, parse 808 ms, sort 117 ms, write 1547 ms, index 288 ms: 7 candidates, 41118 repo-hours, 23 releases; waiting 511 ms; commit 1176 ms)
2026-11-07T05:03:14Z [load_day 2026-07-19] 2026-07-19 hour 12: 167845 events in 4 files, snapshot 4237304436560951282 (task 3794 ms: download 1357 ms overlapping gunzip 201 ms, parse 785 ms, sort 103 ms, write 1515 ms, index 282 ms: 3 candidates, 39736 repo-hours, 19 releases; waiting 508 ms; commit 1015 ms)
2026-11-07T05:03:16Z [load_day 2026-07-19] 2026-07-19 hour 13: 170774 events in 4 files, snapshot 5232058587297024930 (task 3878 ms: download 1474 ms overlapping gunzip 200 ms, parse 766 ms, sort 111 ms, write 1657 ms, index 335 ms: 3 candidates, 52340 repo-hours, 22 releases; waiting 510 ms; commit 1106 ms)
2026-11-07T05:03:19Z [load_day 2026-07-19] 2026-07-19 hour 14: 165866 events in 4 files, snapshot 1433844071395796553 (task 3720 ms: download 1111 ms overlapping gunzip 192 ms, parse 743 ms, sort 102 ms, write 1619 ms, index 338 ms: 6 candidates, 50584 repo-hours, 25 releases; waiting 515 ms; commit 910 ms)
2026-11-07T05:03:21Z [load_day 2026-07-19] 2026-07-19 hour 15: 169569 events in 4 files, snapshot 1022081702375673538 (task 3799 ms: download 1337 ms overlapping gunzip 197 ms, parse 765 ms, sort 113 ms, write 1525 ms, index 367 ms: 7 candidates, 49250 repo-hours, 10 releases; waiting 516 ms; commit 915 ms)
2026-11-07T05:03:23Z [load_day 2026-07-19] 2026-07-19 hour 16: 166369 events in 4 files, snapshot 5063052535447696030 (task 3738 ms: download 1206 ms overlapping gunzip 194 ms, parse 749 ms, sort 104 ms, write 1545 ms, index 349 ms: 5 candidates, 51774 repo-hours, 21 releases; waiting 536 ms; commit 930 ms)
2026-11-07T05:03:25Z [load_day 2026-07-19] 2026-07-19 hour 17: 165876 events in 4 files, snapshot 5513271157430047090 (task 3688 ms: download 1455 ms overlapping gunzip 208 ms, parse 788 ms, sort 124 ms, write 1489 ms, index 314 ms: 4 candidates, 46777 repo-hours, 14 releases; waiting 539 ms; commit 874 ms)
2026-11-07T05:03:27Z [load_day 2026-07-19] 2026-07-19 hour 18: 165330 events in 4 files, snapshot 6439181332193120017 (task 3400 ms: download 985 ms overlapping gunzip 193 ms, parse 735 ms, sort 98 ms, write 1488 ms, index 328 ms: 1 candidates, 45814 repo-hours, 8 releases; waiting 239 ms; commit 973 ms)
2026-11-07T05:03:29Z [load_day 2026-07-19] 2026-07-19 hour 19: 166040 events in 4 files, snapshot 784156304586750428 (task 3597 ms: download 1234 ms overlapping gunzip 198 ms, parse 765 ms, sort 117 ms, write 1427 ms, index 305 ms: 1 candidates, 44709 repo-hours, 16 releases; waiting 469 ms; commit 892 ms)
2026-11-07T05:03:32Z [load_day 2026-07-19] 2026-07-19 hour 20: 166956 events in 4 files, snapshot 5286832746097135348 (task 3855 ms: download 1293 ms overlapping gunzip 193 ms, parse 755 ms, sort 110 ms, write 1588 ms, index 358 ms: 2 candidates, 45882 repo-hours, 18 releases; waiting 513 ms; commit 1024 ms)
2026-11-07T05:03:34Z [load_day 2026-07-19] 2026-07-19 hour 21: 168565 events in 4 files, snapshot 1729994998205288543 (task 3866 ms: download 2098 ms overlapping gunzip 203 ms, parse 783 ms, sort 118 ms, write 1617 ms, index 289 ms: 1 candidates, 43788 repo-hours, 18 releases; waiting 513 ms; commit 809 ms)
2026-11-07T05:03:36Z [load_day 2026-07-19] 2026-07-19 hour 22: 169852 events in 4 files, snapshot 3712375855810774888 (task 3770 ms: download 1433 ms overlapping gunzip 200 ms, parse 782 ms, sort 110 ms, write 1568 ms, index 311 ms: 1 candidates, 46250 repo-hours, 32 releases; waiting 518 ms; commit 991 ms)
2026-11-07T05:03:38Z [load_day 2026-07-19] 2026-07-19 hour 23: 174372 events in 4 files, snapshot 8224289075822894405 (task 3788 ms: download 1271 ms overlapping gunzip 205 ms, parse 777 ms, sort 112 ms, write 1545 ms, index 314 ms: 2 candidates, 47887 repo-hours, 22 releases; waiting 490 ms; commit 853 ms)
2026-11-07T05:03:43Z [load_day 2026-07-19] 2026-07-19: repo_hour merged from 24 files to 1 (1075839 rows, 4977 ms)
2026-11-07T05:03:45Z [load_day 2026-07-19] 2026-07-19: index committed in 6885 ms (23 + 1 + 24 files)
2026-11-07T05:03:45Z [load_day 2026-07-19] 2026-07-19: 4049718 events in 24 hours
2026-11-07T05:03:45Z [load_day 2026-07-19] attempt 1 succeeded