orcaLog in

Runs · run 386

load_day 2026-07-12, attempt 1 succeeded

Host
4e84322b8c45:75807
Started
2026-11-07T05:10:29Z
Ended
2026-11-07T05:11:32Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/386/load_day/2026-07-12/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:10:29Z [load_day 2026-07-12] attempt 1 started
2026-11-07T05:10:36Z [load_day 2026-07-12] 2026-07-12 hour 0: 167875 events in 4 files, snapshot 4873255597845718935 (task 3620 ms: download 1304 ms overlapping gunzip 200 ms, parse 793 ms, sort 112 ms, write 1441 ms, index 287 ms: 3 candidates, 40177 repo-hours, 15 releases; waiting 501 ms; commit 749 ms)
2026-11-07T05:10:37Z [load_day 2026-07-12] 2026-07-12 hour 1: 171176 events in 4 files, snapshot 8180422882987995263 (task 3952 ms: download 1384 ms overlapping gunzip 224 ms, parse 872 ms, sort 110 ms, write 1461 ms, index 315 ms: 5 candidates, 49327 repo-hours, 19 releases; waiting 516 ms; commit 1086 ms)
2026-11-07T05:10:41Z [load_day 2026-07-12] 2026-07-12 hour 2: 167438 events in 4 files, snapshot 7013372091100129299 (task 3752 ms: download 1195 ms overlapping gunzip 201 ms, parse 760 ms, sort 103 ms, write 1530 ms, index 385 ms: 2 candidates, 57938 repo-hours, 22 releases; waiting 514 ms; commit 1526 ms)
2026-11-07T05:10:42Z [load_day 2026-07-12] 2026-07-12 hour 3: 169285 events in 4 files, snapshot 5247863419933999635 (task 4056 ms: download 1313 ms overlapping gunzip 199 ms, parse 755 ms, sort 103 ms, write 1516 ms, index 708 ms: 4 candidates, 43262 repo-hours, 9 releases; waiting 525 ms; commit 1491 ms)
2026-11-07T05:10:45Z [load_day 2026-07-12] 2026-07-12 hour 4: 165785 events in 4 files, snapshot 1638928168745887139 (task 3526 ms: download 1230 ms overlapping gunzip 191 ms, parse 745 ms, sort 100 ms, write 1439 ms, index 233 ms: 3 candidates, 32520 repo-hours, 12 releases; waiting 515 ms; commit 875 ms)
2026-11-07T05:10:47Z [load_day 2026-07-12] 2026-07-12 hour 5: 169686 events in 4 files, snapshot 9016639743442035128 (task 3797 ms: download 1543 ms overlapping gunzip 200 ms, parse 771 ms, sort 101 ms, write 1420 ms, index 197 ms: 3 candidates, 29297 repo-hours, 10 releases; waiting 697 ms; commit 838 ms)
2026-11-07T05:10:49Z [load_day 2026-07-12] 2026-07-12 hour 6: 171981 events in 4 files, snapshot 4312457222651091778 (task 3491 ms: download 1307 ms overlapping gunzip 194 ms, parse 751 ms, sort 102 ms, write 1411 ms, index 209 ms: 4 candidates, 31107 repo-hours, 13 releases; waiting 528 ms; commit 898 ms)
2026-11-07T05:10:52Z [load_day 2026-07-12] 2026-07-12 hour 7: 169191 events in 4 files, snapshot 7844372207184125215 (task 3826 ms: download 1344 ms overlapping gunzip 195 ms, parse 756 ms, sort 103 ms, write 1506 ms, index 398 ms: 4 candidates, 32134 repo-hours, 11 releases; waiting 543 ms; commit 1010 ms)
2026-11-07T05:10:54Z [load_day 2026-07-12] 2026-07-12 hour 8: 166882 events in 4 files, snapshot 2357431961527017457 (task 3729 ms: download 1999 ms overlapping gunzip 191 ms, parse 747 ms, sort 98 ms, write 1587 ms, index 268 ms: 4 candidates, 31662 repo-hours, 16 releases; waiting 521 ms; commit 1085 ms)
2026-11-07T05:10:56Z [load_day 2026-07-12] 2026-07-12 hour 9: 171795 events in 4 files, snapshot 9148698764103418105 (task 3625 ms: download 1199 ms overlapping gunzip 203 ms, parse 795 ms, sort 110 ms, write 1466 ms, index 199 ms: 3 candidates, 29667 repo-hours, 0 releases; waiting 516 ms; commit 966 ms)
2026-11-07T05:10:58Z [load_day 2026-07-12] 2026-07-12 hour 10: 170889 events in 4 files, snapshot 3964240501258512224 (task 3555 ms: download 1385 ms overlapping gunzip 200 ms, parse 782 ms, sort 104 ms, write 1437 ms, index 206 ms: 3 candidates, 30892 repo-hours, 7 releases; waiting 526 ms; commit 881 ms)
2026-11-07T05:11:00Z [load_day 2026-07-12] 2026-07-12 hour 11: 171486 events in 4 files, snapshot 3095414903059643176 (task 3687 ms: download 1238 ms overlapping gunzip 200 ms, parse 785 ms, sort 104 ms, write 1515 ms, index 283 ms: 2 candidates, 36154 repo-hours, 11 releases; waiting 514 ms; commit 999 ms)
2026-11-07T05:11:02Z [load_day 2026-07-12] 2026-07-12 hour 12: 169891 events in 4 files, snapshot 6124345467253418775 (task 3540 ms: download 1202 ms overlapping gunzip 194 ms, parse 751 ms, sort 101 ms, write 1450 ms, index 213 ms: 0 candidates, 33307 repo-hours, 13 releases; waiting 519 ms; commit 989 ms)
2026-11-07T05:11:05Z [load_day 2026-07-12] 2026-07-12 hour 13: 164080 events in 4 files, snapshot 8276006773681640122 (task 3508 ms: download 1200 ms overlapping gunzip 182 ms, parse 734 ms, sort 96 ms, write 1458 ms, index 248 ms: 4 candidates, 34895 repo-hours, 18 releases; waiting 512 ms; commit 989 ms)
2026-11-07T05:11:06Z [load_day 2026-07-12] 2026-07-12 hour 14: 166593 events in 4 files, snapshot 1159119714630294221 (task 3510 ms: download 1433 ms overlapping gunzip 187 ms, parse 750 ms, sort 104 ms, write 1408 ms, index 251 ms: 4 candidates, 36293 repo-hours, 13 releases; waiting 520 ms; commit 971 ms)
2026-11-07T05:11:09Z [load_day 2026-07-12] 2026-07-12 hour 15: 167655 events in 4 files, snapshot 6630007616990526024 (task 3754 ms: download 1475 ms overlapping gunzip 195 ms, parse 760 ms, sort 104 ms, write 1540 ms, index 294 ms: 3 candidates, 39435 repo-hours, 20 releases; waiting 552 ms; commit 1023 ms)
2026-11-07T05:11:10Z [load_day 2026-07-12] 2026-07-12 hour 16: 172071 events in 4 files, snapshot 5247168136085166627 (task 3804 ms: download 1415 ms overlapping gunzip 192 ms, parse 766 ms, sort 102 ms, write 1593 ms, index 343 ms: 7 candidates, 38318 repo-hours, 14 releases; waiting 517 ms; commit 785 ms)
2026-11-07T05:11:13Z [load_day 2026-07-12] 2026-07-12 hour 17: 166083 events in 4 files, snapshot 5345477367705434526 (task 3236 ms: download 705 ms overlapping gunzip 178 ms, parse 698 ms, sort 99 ms, write 1481 ms, index 268 ms: 3 candidates, 38384 repo-hours, 10 releases; waiting 183 ms; commit 1002 ms)
2026-11-07T05:11:15Z [load_day 2026-07-12] 2026-07-12 hour 18: 168794 events in 4 files, snapshot 3303838659186840652 (task 3591 ms: download 1197 ms overlapping gunzip 191 ms, parse 782 ms, sort 98 ms, write 1517 ms, index 252 ms: 3 candidates, 37516 repo-hours, 12 releases; waiting 523 ms; commit 962 ms)
2026-11-07T05:11:17Z [load_day 2026-07-12] 2026-07-12 hour 19: 162540 events in 4 files, snapshot 45216866282643171 (task 3466 ms: download 1307 ms overlapping gunzip 187 ms, parse 734 ms, sort 97 ms, write 1359 ms, index 242 ms: 3 candidates, 35964 repo-hours, 11 releases; waiting 528 ms; commit 1123 ms)
2026-11-07T05:11:19Z [load_day 2026-07-12] 2026-07-12 hour 20: 163362 events in 4 files, snapshot 2682348141913852286 (task 3521 ms: download 1220 ms overlapping gunzip 187 ms, parse 728 ms, sort 100 ms, write 1378 ms, index 276 ms: 4 candidates, 35761 repo-hours, 11 releases; waiting 520 ms; commit 1004 ms)
2026-11-07T05:11:21Z [load_day 2026-07-12] 2026-07-12 hour 21: 167597 events in 4 files, snapshot 5105796784234096703 (task 3480 ms: download 1479 ms overlapping gunzip 187 ms, parse 749 ms, sort 105 ms, write 1463 ms, index 276 ms: 3 candidates, 35674 repo-hours, 14 releases; waiting 471 ms; commit 821 ms)
2026-11-07T05:11:23Z [load_day 2026-07-12] 2026-07-12 hour 22: 167373 events in 4 files, snapshot 7769745352994561716 (task 3597 ms: download 1335 ms overlapping gunzip 189 ms, parse 748 ms, sort 99 ms, write 1410 ms, index 291 ms: 4 candidates, 37194 repo-hours, 12 releases; waiting 540 ms; commit 938 ms)
2026-11-07T05:11:26Z [load_day 2026-07-12] 2026-07-12 hour 23: 172362 events in 4 files, snapshot 7923823387115967625 (task 3615 ms: download 1126 ms overlapping gunzip 198 ms, parse 759 ms, sort 104 ms, write 1443 ms, index 301 ms: 2 candidates, 39085 repo-hours, 18 releases; waiting 519 ms; commit 1169 ms)
2026-11-07T05:11:30Z [load_day 2026-07-12] 2026-07-12: repo_hour merged from 24 files to 1 (885963 rows, 4396 ms)
2026-11-07T05:11:32Z [load_day 2026-07-12] 2026-07-12: index committed in 6023 ms (23 + 1 + 23 files)
2026-11-07T05:11:32Z [load_day 2026-07-12] 2026-07-12: 4041870 events in 24 hours
2026-11-07T05:11:32Z [load_day 2026-07-12] attempt 1 succeeded