orcaLog in

Runs · run 344

load_day 2026-07-26, attempt 1 succeeded

Host
4e84322b8c45:63883
Started
2026-11-07T04:55:07Z
Ended
2026-11-07T04:56:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/344/load_day/2026-07-26/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:55:07Z [load_day 2026-07-26] attempt 1 started
2026-11-07T04:55:14Z [load_day 2026-07-26] 2026-07-26 hour 0: 166876 events in 4 files, snapshot 2760575459862726082 (task 4455 ms: download 1477 ms overlapping gunzip 388 ms, parse 1248 ms, sort 153 ms, write 1546 ms, index 261 ms: 0 candidates, 41835 repo-hours, 19 releases; waiting 508 ms; commit 925 ms)
2026-11-07T04:55:15Z [load_day 2026-07-26] 2026-07-26 hour 1: 170155 events in 4 files, snapshot 6405490415127900034 (task 3849 ms: download 1540 ms overlapping gunzip 203 ms, parse 800 ms, sort 114 ms, write 1566 ms, index 322 ms: 5 candidates, 51195 repo-hours, 17 releases; waiting 501 ms; commit 817 ms)
2026-11-07T04:55:18Z [load_day 2026-07-26] 2026-07-26 hour 2: 167561 events in 4 files, snapshot 5085083445311037047 (task 3603 ms: download 1172 ms overlapping gunzip 202 ms, parse 747 ms, sort 100 ms, write 1454 ms, index 327 ms: 3 candidates, 48380 repo-hours, 26 releases; waiting 389 ms; commit 724 ms)
2026-11-07T04:55:19Z [load_day 2026-07-26] 2026-07-26 hour 3: 169066 events in 4 files, snapshot 8518602096110568438 (task 3597 ms: download 1467 ms overlapping gunzip 198 ms, parse 767 ms, sort 109 ms, write 1434 ms, index 261 ms: 1 candidates, 39855 repo-hours, 16 releases; waiting 531 ms; commit 816 ms)
2026-11-07T04:55:23Z [load_day 2026-07-26] 2026-07-26 hour 4: 168057 events in 4 files, snapshot 8117232526706951683 (task 3494 ms: download 1157 ms overlapping gunzip 207 ms, parse 771 ms, sort 98 ms, write 1501 ms, index 186 ms: 1 candidates, 27679 repo-hours, 58 releases; waiting 521 ms; commit 1109 ms)
2026-11-07T04:55:24Z [load_day 2026-07-26] 2026-07-26 hour 5: 172413 events in 4 files, snapshot 6975076156302210532 (task 3894 ms: download 1198 ms overlapping gunzip 194 ms, parse 761 ms, sort 100 ms, write 1518 ms, index 189 ms: 3 candidates, 29159 repo-hours, 23 releases; waiting 509 ms; commit 763 ms)
2026-11-07T04:55:27Z [load_day 2026-07-26] 2026-07-26 hour 6: 172680 events in 4 files, snapshot 7077896784263907812 (task 3596 ms: download 1227 ms overlapping gunzip 201 ms, parse 790 ms, sort 122 ms, write 1535 ms, index 202 ms: 3 candidates, 31022 repo-hours, 18 releases; waiting 530 ms; commit 796 ms)
2026-11-07T04:55:28Z [load_day 2026-07-26] 2026-07-26 hour 7: 172581 events in 4 files, snapshot 7684215080730007673 (task 3408 ms: download 989 ms overlapping gunzip 191 ms, parse 756 ms, sort 108 ms, write 1523 ms, index 215 ms: 4 candidates, 25772 repo-hours, 9 releases; waiting 326 ms; commit 758 ms)
2026-11-07T04:55:32Z [load_day 2026-07-26] 2026-07-26 hour 8: 170129 events in 4 files, snapshot 1004760665643202154 (task 3648 ms: download 1423 ms overlapping gunzip 198 ms, parse 800 ms, sort 110 ms, write 1514 ms, index 177 ms: 6 candidates, 27048 repo-hours, 13 releases; waiting 542 ms; commit 1072 ms)
2026-11-07T04:55:33Z [load_day 2026-07-26] 2026-07-26 hour 9: 172385 events in 4 files, snapshot 7144798686614564372 (task 3675 ms: download 1350 ms overlapping gunzip 193 ms, parse 772 ms, sort 125 ms, write 1605 ms, index 193 ms: 1 candidates, 26994 repo-hours, 9 releases; waiting 520 ms; commit 966 ms)
2026-11-07T04:55:36Z [load_day 2026-07-26] 2026-07-26 hour 10: 169587 events in 4 files, snapshot 7303792502049660964 (task 3465 ms: download 1332 ms overlapping gunzip 193 ms, parse 774 ms, sort 107 ms, write 1450 ms, index 191 ms: 3 candidates, 29990 repo-hours, 8 releases; waiting 547 ms; commit 831 ms)
2026-11-07T04:55:37Z [load_day 2026-07-26] 2026-07-26 hour 11: 169283 events in 4 files, snapshot 2334090598331371776 (task 3700 ms: download 1249 ms overlapping gunzip 206 ms, parse 796 ms, sort 116 ms, write 1538 ms, index 203 ms: 2 candidates, 30483 repo-hours, 12 releases; waiting 517 ms; commit 883 ms)
2026-11-07T04:55:40Z [load_day 2026-07-26] 2026-07-26 hour 12: 171982 events in 4 files, snapshot 1989427447263326814 (task 3481 ms: download 1027 ms overlapping gunzip 191 ms, parse 758 ms, sort 104 ms, write 1619 ms, index 238 ms: 0 candidates, 29137 repo-hours, 11 releases; waiting 184 ms; commit 1129 ms)
2026-11-07T04:55:42Z [load_day 2026-07-26] 2026-07-26 hour 13: 170575 events in 4 files, snapshot 4609507930450186706 (task 3729 ms: download 1309 ms overlapping gunzip 188 ms, parse 756 ms, sort 103 ms, write 1607 ms, index 242 ms: 3 candidates, 34847 repo-hours, 10 releases; waiting 522 ms; commit 1987 ms)
2026-11-07T04:55:44Z [load_day 2026-07-26] 2026-07-26 hour 14: 167173 events in 4 files, snapshot 6598958272138194823 (task 3936 ms: download 1464 ms overlapping gunzip 221 ms, parse 847 ms, sort 105 ms, write 1608 ms, index 260 ms: 3 candidates, 35199 repo-hours, 13 releases; waiting 545 ms; commit 831 ms)
2026-11-07T04:55:45Z [load_day 2026-07-26] 2026-07-26 hour 15: 173580 events in 4 files, snapshot 815592285580699382 (task 3852 ms: download 1371 ms overlapping gunzip 196 ms, parse 780 ms, sort 107 ms, write 1662 ms, index 267 ms: 6 candidates, 39815 repo-hours, 10 releases; waiting 529 ms; commit 899 ms)
2026-11-07T04:55:49Z [load_day 2026-07-26] 2026-07-26 hour 16: 168903 events in 4 files, snapshot 6756676243516420063 (task 3752 ms: download 1514 ms overlapping gunzip 196 ms, parse 766 ms, sort 109 ms, write 1563 ms, index 287 ms: 2 candidates, 42583 repo-hours, 20 releases; waiting 537 ms; commit 805 ms)
2026-11-07T04:55:50Z [load_day 2026-07-26] 2026-07-26 hour 17: 164972 events in 4 files, snapshot 3502528077023160678 (task 3666 ms: download 1345 ms overlapping gunzip 192 ms, parse 739 ms, sort 103 ms, write 1453 ms, index 346 ms: 4 candidates, 48452 repo-hours, 14 releases; waiting 521 ms; commit 829 ms)
2026-11-07T04:55:53Z [load_day 2026-07-26] 2026-07-26 hour 18: 168973 events in 4 files, snapshot 8439251468093077570 (task 3638 ms: download 1225 ms overlapping gunzip 219 ms, parse 793 ms, sort 99 ms, write 1457 ms, index 299 ms: 2 candidates, 45107 repo-hours, 15 releases; waiting 423 ms; commit 860 ms)
2026-11-07T04:55:54Z [load_day 2026-07-26] 2026-07-26 hour 19: 165673 events in 4 files, snapshot 2216334200802175355 (task 3611 ms: download 1237 ms overlapping gunzip 198 ms, parse 749 ms, sort 105 ms, write 1430 ms, index 309 ms: 4 candidates, 46181 repo-hours, 23 releases; waiting 518 ms; commit 895 ms)
2026-11-07T04:55:57Z [load_day 2026-07-26] 2026-07-26 hour 20: 163496 events in 4 files, snapshot 4012145063143753142 (task 3557 ms: download 1465 ms overlapping gunzip 189 ms, parse 720 ms, sort 107 ms, write 1423 ms, index 291 ms: 10 candidates, 45975 repo-hours, 8 releases; waiting 522 ms; commit 913 ms)
2026-11-07T04:55:58Z [load_day 2026-07-26] 2026-07-26 hour 21: 168767 events in 4 files, snapshot 9222142980743183056 (task 3741 ms: download 1382 ms overlapping gunzip 213 ms, parse 781 ms, sort 104 ms, write 1512 ms, index 290 ms: 2 candidates, 46199 repo-hours, 12 releases; waiting 532 ms; commit 938 ms)
2026-11-07T04:56:01Z [load_day 2026-07-26] 2026-07-26 hour 22: 169278 events in 4 files, snapshot 4427634140449250896 (task 3820 ms: download 1371 ms overlapping gunzip 203 ms, parse 770 ms, sort 102 ms, write 1618 ms, index 312 ms: 5 candidates, 45415 repo-hours, 18 releases; waiting 517 ms; commit 995 ms)
2026-11-07T04:56:03Z [load_day 2026-07-26] 2026-07-26 hour 23: 170072 events in 4 files, snapshot 1844735892920001291 (task 3782 ms: download 1179 ms overlapping gunzip 197 ms, parse 762 ms, sort 108 ms, write 1634 ms, index 349 ms: 0 candidates, 45508 repo-hours, 17 releases; waiting 518 ms; commit 930 ms)
2026-11-07T04:56:07Z [load_day 2026-07-26] 2026-07-26: repo_hour merged from 24 files to 1 (913830 rows, 4457 ms)
2026-11-07T04:56:09Z [load_day 2026-07-26] 2026-07-26: index committed in 6179 ms (21 + 1 + 24 files)
2026-11-07T04:56:09Z [load_day 2026-07-26] 2026-07-26: 4064217 events in 24 hours
2026-11-07T04:56:09Z [load_day 2026-07-26] attempt 1 succeeded