orcaLog in

Runs · run 269

load_day 2026-08-20, attempt 1 succeeded

Host
4e84322b8c45:44977
Started
2026-11-07T04:29:12Z
Ended
2026-11-07T04:29:43Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/269/load_day/2026-08-20/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:29:12Z [load_day 2026-08-20] attempt 1 started
2026-11-07T04:29:16Z [load_day 2026-08-20] 2026-08-20 hour 0: 3087 events in 1 files, snapshot 6592898872990120971 (task 1128 ms: download 590 ms overlapping gunzip 19 ms, parse 62 ms, sort 1 ms, write 186 ms, index 48 ms: 1 candidates, 2577 repo-hours, 32 releases; waiting 520 ms; commit 702 ms)
2026-11-07T04:29:16Z [load_day 2026-08-20] 2026-08-20 hour 1: 16796 events in 1 files, snapshot 7287846930714129297 (task 1437 ms: download 714 ms overlapping gunzip 37 ms, parse 135 ms, sort 8 ms, write 289 ms, index 84 ms: 1 candidates, 8741 repo-hours, 36 releases; waiting 560 ms; commit 758 ms)
2026-11-07T04:29:18Z [load_day 2026-08-20] 2026-08-20 hour 2: 32220 events in 1 files, snapshot 5041218516654490675 (task 1511 ms: download 771 ms overlapping gunzip 60 ms, parse 212 ms, sort 19 ms, write 376 ms, index 83 ms: 0 candidates, 11754 repo-hours, 25 releases; waiting 539 ms; commit 763 ms)
2026-11-07T04:29:19Z [load_day 2026-08-20] 2026-08-20 hour 3: 54338 events in 2 files, snapshot 3603156923810987123 (task 1939 ms: download 823 ms overlapping gunzip 85 ms, parse 323 ms, sort 40 ms, write 554 ms, index 118 ms: 1 candidates, 15905 repo-hours, 30 releases; waiting 513 ms; commit 752 ms)
2026-11-07T04:29:21Z [load_day 2026-08-20] 2026-08-20 hour 4: 81143 events in 2 files, snapshot 8731941818359700896 (task 2301 ms: download 954 ms overlapping gunzip 110 ms, parse 407 ms, sort 54 ms, write 755 ms, index 119 ms: 1 candidates, 15931 repo-hours, 18 releases; waiting 514 ms; commit 749 ms)
2026-11-07T04:29:22Z [load_day 2026-08-20] 2026-08-20 hour 5: 82924 events in 2 files, snapshot 7308270719661963052 (task 2330 ms: download 898 ms overlapping gunzip 105 ms, parse 420 ms, sort 49 ms, write 770 ms, index 147 ms: 1 candidates, 14449 repo-hours, 18 releases; waiting 530 ms; commit 780 ms)
2026-11-07T04:29:23Z [load_day 2026-08-20] 2026-08-20 hour 6: 58760 events in 2 files, snapshot 6737157236829203751 (task 1987 ms: download 840 ms overlapping gunzip 83 ms, parse 327 ms, sort 38 ms, write 570 ms, index 103 ms: 1 candidates, 12925 repo-hours, 18 releases; waiting 538 ms; commit 786 ms)
2026-11-07T04:29:24Z [load_day 2026-08-20] 2026-08-20 hour 7: 46266 events in 1 files, snapshot 4357037682887976174 (task 1757 ms: download 794 ms overlapping gunzip 66 ms, parse 255 ms, sort 31 ms, write 423 ms, index 84 ms: 0 candidates, 12147 repo-hours, 18 releases; waiting 527 ms; commit 689 ms)
2026-11-07T04:29:26Z [load_day 2026-08-20] 2026-08-20 hour 8: 30333 events in 1 files, snapshot 763359888679872675 (task 1624 ms: download 752 ms overlapping gunzip 48 ms, parse 184 ms, sort 17 ms, write 353 ms, index 81 ms: 0 candidates, 10935 repo-hours, 35 releases; waiting 538 ms; commit 891 ms)
2026-11-07T04:29:26Z [load_day 2026-08-20] 2026-08-20 hour 9: 29634 events in 1 files, snapshot 1566148143473190554 (task 1518 ms: download 746 ms overlapping gunzip 50 ms, parse 180 ms, sort 16 ms, write 353 ms, index 93 ms: 2 candidates, 11408 repo-hours, 27 releases; waiting 538 ms; commit 721 ms)
2026-11-07T04:29:27Z [load_day 2026-08-20] 2026-08-20 hour 10: 27457 events in 1 files, snapshot 966678467978314654 (task 1082 ms: download 271 ms overlapping gunzip 41 ms, parse 149 ms, sort 15 ms, write 334 ms, index 73 ms: 0 candidates, 9964 repo-hours, 20 releases; waiting 187 ms; commit 667 ms)
2026-11-07T04:29:29Z [load_day 2026-08-20] 2026-08-20 hour 11: 25624 events in 1 files, snapshot 8128765164635563216 (task 1464 ms: download 732 ms overlapping gunzip 47 ms, parse 177 ms, sort 13 ms, write 319 ms, index 72 ms: 0 candidates, 9690 repo-hours, 22 releases; waiting 536 ms; commit 871 ms)
2026-11-07T04:29:29Z [load_day 2026-08-20] 2026-08-20 hour 12: 19058 events in 1 files, snapshot 6209880316612486416 (task 1409 ms: download 703 ms overlapping gunzip 38 ms, parse 133 ms, sort 9 ms, write 289 ms, index 76 ms: 0 candidates, 9034 repo-hours, 29 releases; waiting 546 ms; commit 816 ms)
2026-11-07T04:29:31Z [load_day 2026-08-20] 2026-08-20 hour 13: 13708 events in 1 files, snapshot 860165804641093668 (task 1328 ms: download 696 ms overlapping gunzip 33 ms, parse 114 ms, sort 6 ms, write 262 ms, index 72 ms: 1 candidates, 7278 repo-hours, 39 releases; waiting 561 ms; commit 1089 ms)
2026-11-07T04:29:32Z [load_day 2026-08-20] 2026-08-20 hour 14: 6600 events in 1 files, snapshot 921917014421034965 (task 1238 ms: download 619 ms overlapping gunzip 24 ms, parse 69 ms, sort 4 ms, write 226 ms, index 96 ms: 1 candidates, 4645 repo-hours, 42 releases; waiting 541 ms; commit 798 ms)
2026-11-07T04:29:32Z [load_day 2026-08-20] 2026-08-20 hour 15: 4298 events in 1 files, snapshot 9183752656594193290 (task 1165 ms: download 605 ms overlapping gunzip 23 ms, parse 63 ms, sort 2 ms, write 204 ms, index 37 ms: 0 candidates, 3455 repo-hours, 27 releases; waiting 529 ms; commit 640 ms)
2026-11-07T04:29:33Z [load_day 2026-08-20] 2026-08-20 hour 16: 2077 events in 1 files, snapshot 6250139320996074461 (task 1115 ms: download 579 ms overlapping gunzip 19 ms, parse 53 ms, sort 1 ms, write 180 ms, index 68 ms: 0 candidates, 1921 repo-hours, 37 releases; waiting 516 ms; commit 839 ms)
2026-11-07T04:29:34Z [load_day 2026-08-20] 2026-08-20 hour 17: 1548 events in 1 files, snapshot 267006104251309990 (task 1186 ms: download 612 ms overlapping gunzip 22 ms, parse 66 ms, sort 1 ms, write 255 ms, index 28 ms: 0 candidates, 1464 repo-hours, 47 releases; waiting 534 ms; commit 742 ms)
2026-11-07T04:29:35Z [load_day 2026-08-20] 2026-08-20 hour 18: 1610 events in 1 files, snapshot 468997051650229006 (task 1114 ms: download 602 ms overlapping gunzip 23 ms, parse 58 ms, sort 1 ms, write 186 ms, index 32 ms: 0 candidates, 1513 repo-hours, 45 releases; waiting 531 ms; commit 650 ms)
2026-11-07T04:29:37Z [load_day 2026-08-20] 2026-08-20 hour 19: 1249 events in 1 files, snapshot 5947508500197117996 (task 1109 ms: download 578 ms overlapping gunzip 19 ms, parse 52 ms, sort 1 ms, write 185 ms, index 32 ms: 0 candidates, 1180 repo-hours, 43 releases; waiting 516 ms; commit 1696 ms)
2026-11-07T04:29:37Z [load_day 2026-08-20] 2026-08-20 hour 20: 955 events in 1 files, snapshot 8434436764595768520 (task 1020 ms: download 542 ms overlapping gunzip 13 ms, parse 35 ms, sort 0 ms, write 152 ms, index 25 ms: 0 candidates, 894 repo-hours, 33 releases; waiting 502 ms; commit 679 ms)
2026-11-07T04:29:38Z [load_day 2026-08-20] 2026-08-20 hour 21: 803 events in 1 files, snapshot 6214543821097850091 (task 984 ms: download 529 ms overlapping gunzip 12 ms, parse 35 ms, sort 0 ms, write 141 ms, index 24 ms: 0 candidates, 752 repo-hours, 24 releases; waiting 490 ms; commit 622 ms)
2026-11-07T04:29:39Z [load_day 2026-08-20] 2026-08-20 hour 22: 697 events in 1 files, snapshot 879985535373176177 (task 1011 ms: download 505 ms overlapping gunzip 12 ms, parse 31 ms, sort 0 ms, write 131 ms, index 31 ms: 1 candidates, 654 repo-hours, 18 releases; waiting 472 ms; commit 733 ms)
2026-11-07T04:29:40Z [load_day 2026-08-20] 2026-08-20 hour 23: 757 events in 1 files, snapshot 6604059459688286084 (task 968 ms: download 525 ms overlapping gunzip 13 ms, parse 31 ms, sort 0 ms, write 128 ms, index 27 ms: 0 candidates, 704 repo-hours, 22 releases; waiting 491 ms; commit 639 ms)
2026-11-07T04:29:41Z [load_day 2026-08-20] 2026-08-20: repo_hour merged from 24 files to 1 (169920 rows, 1583 ms)
2026-11-07T04:29:43Z [load_day 2026-08-20] 2026-08-20: index committed in 3242 ms (10 + 1 + 24 files)
2026-11-07T04:29:43Z [load_day 2026-08-20] 2026-08-20: 541942 events in 24 hours
2026-11-07T04:29:43Z [load_day 2026-08-20] attempt 1 succeeded