orcaLog in

Runs · run 1418

load_day 2023-08-22, attempt 1 succeeded

Host
3c2b29713ce8:249717
Started
2026-11-08T00:06:16Z
Ended
2026-11-08T00:10:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1418/load_day/2023-08-22/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T00:06:16Z [load_day 2023-08-22] attempt 1 started
2026-11-08T00:06:18Z [load_day 2023-08-22] 2023-08-22: 2 hours in flight, about 1200 MB
2026-11-08T00:06:40Z [load_day 2023-08-22] 2023-08-22 hour 0: 167157 events in 4 files, snapshot 353231306973132797 (task 16341 ms: download 7637 ms overlapping gunzip 1066 ms, parse 4900 ms, sort 128 ms, write 8833 ms, index 599 ms: 9 candidates, 90370 repo-hours, 962 releases; waiting 481 ms; commit 3987 ms)
2026-11-08T00:06:46Z [load_day 2023-08-22] 2023-08-22 hour 1: 161783 events in 4 files, snapshot 6577955560028343847 (task 15156 ms: download 6204 ms overlapping gunzip 851 ms, parse 3780 ms, sort 149 ms, write 9077 ms, index 636 ms: 3 candidates, 89745 repo-hours, 774 releases; waiting 337 ms; commit 5298 ms)
2026-11-08T00:06:54Z [load_day 2023-08-22] 2023-08-22 hour 2: 136115 events in 3 files, snapshot 2578226057419844234 (task 13829 ms: download 5578 ms overlapping gunzip 920 ms, parse 4097 ms, sort 114 ms, write 7515 ms, index 385 ms: 6 candidates, 58895 repo-hours, 706 releases; waiting 515 ms; commit 2545 ms)
2026-11-08T00:06:58Z [load_day 2023-08-22] 2023-08-22 hour 3: 132058 events in 3 files, snapshot 742742757660027245 (task 13989 ms: download 6058 ms overlapping gunzip 880 ms, parse 3830 ms, sort 110 ms, write 7597 ms, index 580 ms: 3 candidates, 56433 repo-hours, 932 releases; waiting 494 ms; commit 2319 ms)
2026-11-08T00:07:06Z [load_day 2023-08-22] 2023-08-22 hour 4: 127797 events in 3 files, snapshot 5403203882214869831 (task 12151 ms: download 4994 ms overlapping gunzip 649 ms, parse 2909 ms, sort 81 ms, write 7219 ms, index 480 ms: 2 candidates, 53297 repo-hours, 653 releases; waiting 507 ms; commit 2066 ms)
2026-11-08T00:07:14Z [load_day 2023-08-22] 2023-08-22 hour 5: 138000 events in 3 files, snapshot 5777640319902580214 (task 14278 ms: download 5963 ms overlapping gunzip 850 ms, parse 3626 ms, sort 115 ms, write 8405 ms, index 488 ms: 3 candidates, 59215 repo-hours, 733 releases; waiting 480 ms; commit 3128 ms)
2026-11-08T00:07:26Z [load_day 2023-08-22] 2023-08-22 hour 6: 162481 events in 4 files, snapshot 8106106677950010350 (task 17724 ms: download 6735 ms overlapping gunzip 952 ms, parse 4098 ms, sort 168 ms, write 11192 ms, index 538 ms: 4 candidates, 75600 repo-hours, 945 releases; waiting 513 ms; commit 2213 ms)
2026-11-08T00:07:34Z [load_day 2023-08-22] 2023-08-22 hour 7: 162638 events in 4 files, snapshot 3584219900686344794 (task 19413 ms: download 11981 ms overlapping gunzip 1234 ms, parse 5543 ms, sort 149 ms, write 11170 ms, index 521 ms: 7 candidates, 73699 repo-hours, 932 releases; waiting 497 ms; commit 2954 ms)
2026-11-08T00:07:47Z [load_day 2023-08-22] 2023-08-22 hour 8: 172921 events in 4 files, snapshot 4621359699894375831 (task 20252 ms: download 12468 ms overlapping gunzip 1203 ms, parse 5203 ms, sort 171 ms, write 12115 ms, index 800 ms: 6 candidates, 79228 repo-hours, 1071 releases; waiting 501 ms; commit 2436 ms)
2026-11-08T00:08:05Z [load_day 2023-08-22] 2023-08-22 hour 9: 188434 events in 4 files, snapshot 8117288976756902644 (task 21423 ms: download 11601 ms overlapping gunzip 1346 ms, parse 5879 ms, sort 208 ms, write 12382 ms, index 799 ms: 5 candidates, 83392 repo-hours, 1231 releases; waiting 483 ms; commit 10718 ms)
2026-11-08T00:08:09Z [load_day 2023-08-22] 2023-08-22 hour 10: 181767 events in 4 files, snapshot 2776077126922473493 (task 20455 ms: download 10568 ms overlapping gunzip 1199 ms, parse 5186 ms, sort 203 ms, write 12321 ms, index 775 ms: 5 candidates, 81824 repo-hours, 1009 releases; waiting 521 ms; commit 2522 ms)
2026-11-08T00:08:18Z [load_day 2023-08-22] 2023-08-22 hour 11: 179318 events in 4 files, snapshot 4206716233599362209 (task 20044 ms: download 11738 ms overlapping gunzip 1150 ms, parse 5018 ms, sort 155 ms, write 12267 ms, index 692 ms: 3 candidates, 79055 repo-hours, 1018 releases; waiting 473 ms; commit 2305 ms)
2026-11-08T00:08:32Z [load_day 2023-08-22] 2023-08-22 hour 12: 234182 events in 5 files, snapshot 5073107230809627668 (task 22411 ms: download 14886 ms overlapping gunzip 1171 ms, parse 5321 ms, sort 149 ms, write 14126 ms, index 835 ms: 9 candidates, 111806 repo-hours, 1178 releases; waiting 530 ms; commit 2435 ms)
2026-11-08T00:08:43Z [load_day 2023-08-22] 2023-08-22 hour 13: 211918 events in 5 files, snapshot 2356779100405376253 (task 23335 ms: download 15269 ms overlapping gunzip 1331 ms, parse 5926 ms, sort 186 ms, write 13592 ms, index 1154 ms: 4 candidates, 107181 repo-hours, 1139 releases; waiting 648 ms; commit 3124 ms)
2026-11-08T00:08:55Z [load_day 2023-08-22] 2023-08-22 hour 14: 200179 events in 5 files, snapshot 2626417581339467512 (task 21623 ms: download 12465 ms overlapping gunzip 1161 ms, parse 5489 ms, sort 215 ms, write 13363 ms, index 599 ms: 2 candidates, 92272 repo-hours, 1298 releases; waiting 476 ms; commit 2389 ms)
2026-11-08T00:09:02Z [load_day 2023-08-22] 2023-08-22 hour 15: 186976 events in 4 files, snapshot 7904500843293480544 (task 18588 ms: download 11164 ms overlapping gunzip 1132 ms, parse 4704 ms, sort 121 ms, write 11278 ms, index 573 ms: 4 candidates, 85786 repo-hours, 1153 releases; waiting 348 ms; commit 2038 ms)
2026-11-08T00:09:12Z [load_day 2023-08-22] 2023-08-22 hour 16: 182712 events in 4 files, snapshot 4366392469460878260 (task 16207 ms: download 8890 ms overlapping gunzip 986 ms, parse 4318 ms, sort 123 ms, write 9185 ms, index 853 ms: 5 candidates, 82901 repo-hours, 1094 releases; waiting 356 ms; commit 2783 ms)
2026-11-08T00:09:21Z [load_day 2023-08-22] 2023-08-22 hour 17: 175140 events in 4 files, snapshot 5358746248010059537 (task 17565 ms: download 9122 ms overlapping gunzip 1018 ms, parse 4532 ms, sort 134 ms, write 10455 ms, index 677 ms: 7 candidates, 77644 repo-hours, 905 releases; waiting 411 ms; commit 2739 ms)
2026-11-08T00:09:33Z [load_day 2023-08-22] 2023-08-22 hour 18: 183203 events in 4 files, snapshot 3209990608148571224 (task 19325 ms: download 11078 ms overlapping gunzip 1174 ms, parse 5138 ms, sort 119 ms, write 11365 ms, index 662 ms: 10 candidates, 84041 repo-hours, 1043 releases; waiting 526 ms; commit 2653 ms)
2026-11-08T00:09:39Z [load_day 2023-08-22] 2023-08-22 hour 19: 167897 events in 4 files, snapshot 6445913195047284852 (task 16552 ms: download 9579 ms overlapping gunzip 942 ms, parse 4026 ms, sort 133 ms, write 10387 ms, index 553 ms: 6 candidates, 74642 repo-hours, 847 releases; waiting 218 ms; commit 2563 ms)
2026-11-08T00:09:55Z [load_day 2023-08-22] 2023-08-22 hour 20: 166257 events in 4 files, snapshot 756325160603414335 (task 18373 ms: download 11338 ms overlapping gunzip 1159 ms, parse 5164 ms, sort 230 ms, write 10064 ms, index 570 ms: 6 candidates, 72526 repo-hours, 955 releases; waiting 851 ms; commit 4312 ms)
2026-11-08T00:09:57Z [load_day 2023-08-22] 2023-08-22 hour 21: 150837 events in 4 files, snapshot 3561633211338755139 (task 16321 ms: download 7025 ms overlapping gunzip 961 ms, parse 4120 ms, sort 125 ms, write 9411 ms, index 853 ms: 13 candidates, 62975 repo-hours, 1032 releases; waiting 515 ms; commit 2554 ms)
2026-11-08T00:10:08Z [load_day 2023-08-22] 2023-08-22 hour 22: 135861 events in 3 files, snapshot 1339946868528996304 (task 14556 ms: download 6231 ms overlapping gunzip 1004 ms, parse 4362 ms, sort 83 ms, write 7971 ms, index 379 ms: 5 candidates, 56039 repo-hours, 749 releases; waiting 477 ms; commit 1980 ms)
2026-11-08T00:10:12Z [load_day 2023-08-22] 2023-08-22 hour 23: 126322 events in 3 files, snapshot 1997125247870687625 (task 13054 ms: download 6465 ms overlapping gunzip 778 ms, parse 3491 ms, sort 151 ms, write 7425 ms, index 399 ms: 5 candidates, 53196 repo-hours, 671 releases; waiting 502 ms; commit 2868 ms)
2026-11-08T00:10:21Z [load_day 2023-08-22] 2023-08-22: repo_hour merged from 24 files to 1 (1841762 rows, 9414 ms)
2026-11-08T00:10:25Z [load_day 2023-08-22] 2023-08-22: index committed in 12846 ms (24 + 1 + 24 files)
2026-11-08T00:10:25Z [load_day 2023-08-22] 2023-08-22: 4031953 events in 24 hours
2026-11-08T00:10:25Z [load_day 2023-08-22] attempt 1 succeeded