orcaLog in

Runs · run 240

load_day 2026-08-30, attempt 1 succeeded

Host
4e84322b8c45:40089
Started
2026-11-07T04:21:29Z
Ended
2026-11-07T04:22:05Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/240/load_day/2026-08-30/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:21:29Z [load_day 2026-08-30] attempt 1 started
2026-11-07T04:21:34Z [load_day 2026-08-30] 2026-08-30 hour 0: 28234 events in 1 files, snapshot 4640910422710535772 (task 1953 ms: download 787 ms overlapping gunzip 65 ms, parse 235 ms, sort 17 ms, write 547 ms, index 78 ms: 0 candidates, 9525 repo-hours, 56 releases; waiting 532 ms; commit 831 ms)
2026-11-07T04:21:34Z [load_day 2026-08-30] 2026-08-30 hour 1: 31878 events in 1 files, snapshot 458444435766289775 (task 1851 ms: download 782 ms overlapping gunzip 66 ms, parse 229 ms, sort 19 ms, write 581 ms, index 87 ms: 0 candidates, 10508 repo-hours, 55 releases; waiting 530 ms; commit 709 ms)
2026-11-07T04:21:36Z [load_day 2026-08-30] 2026-08-30 hour 2: 35814 events in 1 files, snapshot 3037199855199721637 (task 1676 ms: download 791 ms overlapping gunzip 75 ms, parse 253 ms, sort 22 ms, write 429 ms, index 102 ms: 1 candidates, 11386 repo-hours, 45 releases; waiting 531 ms; commit 845 ms)
2026-11-07T04:21:37Z [load_day 2026-08-30] 2026-08-30 hour 3: 43544 events in 1 files, snapshot 6014570783341450595 (task 1817 ms: download 792 ms overlapping gunzip 71 ms, parse 258 ms, sort 27 ms, write 454 ms, index 84 ms: 0 candidates, 12343 repo-hours, 52 releases; waiting 557 ms; commit 833 ms)
2026-11-07T04:21:38Z [load_day 2026-08-30] 2026-08-30 hour 4: 51866 events in 2 files, snapshot 2956088451569796252 (task 1783 ms: download 827 ms overlapping gunzip 80 ms, parse 299 ms, sort 34 ms, write 514 ms, index 104 ms: 1 candidates, 12774 repo-hours, 28 releases; waiting 544 ms; commit 692 ms)
2026-11-07T04:21:39Z [load_day 2026-08-30] 2026-08-30 hour 5: 48339 events in 1 files, snapshot 8468022443495372384 (task 1643 ms: download 651 ms overlapping gunzip 70 ms, parse 278 ms, sort 31 ms, write 482 ms, index 84 ms: 0 candidates, 12926 repo-hours, 41 releases; waiting 384 ms; commit 735 ms)
2026-11-07T04:21:41Z [load_day 2026-08-30] 2026-08-30 hour 6: 42973 events in 1 files, snapshot 8618653975599152721 (task 1603 ms: download 803 ms overlapping gunzip 70 ms, parse 256 ms, sort 27 ms, write 414 ms, index 97 ms: 3 candidates, 12037 repo-hours, 49 releases; waiting 528 ms; commit 1002 ms)
2026-11-07T04:21:42Z [load_day 2026-08-30] 2026-08-30 hour 7: 37112 events in 1 files, snapshot 4728330285138208395 (task 1691 ms: download 793 ms overlapping gunzip 66 ms, parse 234 ms, sort 22 ms, write 459 ms, index 126 ms: 5 candidates, 12562 repo-hours, 50 releases; waiting 560 ms; commit 899 ms)
2026-11-07T04:21:43Z [load_day 2026-08-30] 2026-08-30 hour 8: 51955 events in 2 files, snapshot 8937139488427520233 (task 1554 ms: download 445 ms overlapping gunzip 73 ms, parse 259 ms, sort 35 ms, write 556 ms, index 84 ms: 0 candidates, 12716 repo-hours, 53 releases; waiting 209 ms; commit 758 ms)
2026-11-07T04:21:44Z [load_day 2026-08-30] 2026-08-30 hour 9: 50790 events in 2 files, snapshot 2925079349011736993 (task 1887 ms: download 837 ms overlapping gunzip 77 ms, parse 290 ms, sort 35 ms, write 514 ms, index 133 ms: 1 candidates, 12579 repo-hours, 45 releases; waiting 532 ms; commit 811 ms)
2026-11-07T04:21:45Z [load_day 2026-08-30] 2026-08-30 hour 10: 45084 events in 1 files, snapshot 9011999016491573948 (task 1763 ms: download 799 ms overlapping gunzip 77 ms, parse 286 ms, sort 29 ms, write 447 ms, index 93 ms: 2 candidates, 11770 repo-hours, 41 releases; waiting 527 ms; commit 761 ms)
2026-11-07T04:21:47Z [load_day 2026-08-30] 2026-08-30 hour 11: 45700 events in 1 files, snapshot 6191800277092990973 (task 1850 ms: download 885 ms overlapping gunzip 75 ms, parse 279 ms, sort 30 ms, write 473 ms, index 95 ms: 2 candidates, 12089 repo-hours, 30 releases; waiting 603 ms; commit 777 ms)
2026-11-07T04:21:47Z [load_day 2026-08-30] 2026-08-30 hour 12: 47206 events in 1 files, snapshot 6308523202489407297 (task 1858 ms: download 813 ms overlapping gunzip 75 ms, parse 274 ms, sort 34 ms, write 511 ms, index 108 ms: 1 candidates, 12943 repo-hours, 53 releases; waiting 526 ms; commit 806 ms)
2026-11-07T04:21:49Z [load_day 2026-08-30] 2026-08-30 hour 13: 48851 events in 1 files, snapshot 3505978895603781568 (task 1940 ms: download 853 ms overlapping gunzip 84 ms, parse 306 ms, sort 33 ms, write 601 ms, index 135 ms: 2 candidates, 13906 repo-hours, 68 releases; waiting 556 ms; commit 721 ms)
2026-11-07T04:21:50Z [load_day 2026-08-30] 2026-08-30 hour 14: 49379 events in 1 files, snapshot 6579154133559280714 (task 1904 ms: download 846 ms overlapping gunzip 99 ms, parse 376 ms, sort 36 ms, write 557 ms, index 94 ms: 0 candidates, 13866 repo-hours, 84 releases; waiting 550 ms; commit 650 ms)
2026-11-07T04:21:52Z [load_day 2026-08-30] 2026-08-30 hour 15: 45262 events in 1 files, snapshot 7959758213297708731 (task 1817 ms: download 816 ms overlapping gunzip 76 ms, parse 277 ms, sort 29 ms, write 494 ms, index 95 ms: 0 candidates, 14116 repo-hours, 64 releases; waiting 534 ms; commit 825 ms)
2026-11-07T04:21:53Z [load_day 2026-08-30] 2026-08-30 hour 16: 41795 events in 1 files, snapshot 5227314544764507078 (task 1814 ms: download 743 ms overlapping gunzip 73 ms, parse 260 ms, sort 26 ms, write 516 ms, index 107 ms: 2 candidates, 14041 repo-hours, 76 releases; waiting 477 ms; commit 822 ms)
2026-11-07T04:21:54Z [load_day 2026-08-30] 2026-08-30 hour 17: 40368 events in 1 files, snapshot 6428011883467287133 (task 1730 ms: download 790 ms overlapping gunzip 71 ms, parse 254 ms, sort 27 ms, write 441 ms, index 90 ms: 0 candidates, 13316 repo-hours, 49 releases; waiting 528 ms; commit 765 ms)
2026-11-07T04:21:55Z [load_day 2026-08-30] 2026-08-30 hour 18: 38777 events in 1 files, snapshot 1859305786487032902 (task 1774 ms: download 785 ms overlapping gunzip 73 ms, parse 270 ms, sort 26 ms, write 469 ms, index 87 ms: 0 candidates, 12797 repo-hours, 51 releases; waiting 516 ms; commit 1145 ms)
2026-11-07T04:21:56Z [load_day 2026-08-30] 2026-08-30 hour 19: 37833 events in 1 files, snapshot 20091515568572288 (task 1643 ms: download 614 ms overlapping gunzip 69 ms, parse 246 ms, sort 26 ms, write 434 ms, index 130 ms: 1 candidates, 12313 repo-hours, 44 releases; waiting 365 ms; commit 725 ms)
2026-11-07T04:21:57Z [load_day 2026-08-30] 2026-08-30 hour 20: 36317 events in 1 files, snapshot 6645211260707132625 (task 1703 ms: download 773 ms overlapping gunzip 60 ms, parse 225 ms, sort 24 ms, write 431 ms, index 103 ms: 0 candidates, 11847 repo-hours, 45 releases; waiting 546 ms; commit 803 ms)
2026-11-07T04:21:59Z [load_day 2026-08-30] 2026-08-30 hour 21: 36713 events in 1 files, snapshot 7755474809770026440 (task 1658 ms: download 787 ms overlapping gunzip 65 ms, parse 225 ms, sort 24 ms, write 405 ms, index 92 ms: 0 candidates, 11658 repo-hours, 33 releases; waiting 546 ms; commit 849 ms)
2026-11-07T04:22:00Z [load_day 2026-08-30] 2026-08-30 hour 22: 33732 events in 1 files, snapshot 9098625789393057359 (task 1556 ms: download 784 ms overlapping gunzip 59 ms, parse 209 ms, sort 21 ms, write 382 ms, index 106 ms: 2 candidates, 11188 repo-hours, 32 releases; waiting 557 ms; commit 771 ms)
2026-11-07T04:22:01Z [load_day 2026-08-30] 2026-08-30 hour 23: 30637 events in 1 files, snapshot 7851164439515182606 (task 1489 ms: download 753 ms overlapping gunzip 59 ms, parse 213 ms, sort 17 ms, write 367 ms, index 86 ms: 1 candidates, 10730 repo-hours, 33 releases; waiting 530 ms; commit 811 ms)
2026-11-07T04:22:03Z [load_day 2026-08-30] 2026-08-30: repo_hour merged from 24 files to 1 (295936 rows, 2117 ms)
2026-11-07T04:22:05Z [load_day 2026-08-30] 2026-08-30: index committed in 4049 ms (13 + 1 + 24 files)
2026-11-07T04:22:05Z [load_day 2026-08-30] 2026-08-30: 1000159 events in 24 hours
2026-11-07T04:22:05Z [load_day 2026-08-30] attempt 1 succeeded