orcaLog in

Runs · run 17

load_day 2023-01-06, attempt 1 succeeded

Host
4e84322b8c45:6707
Started
2026-11-07T03:03:05Z
Ended
2026-11-07T03:06:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/17/load_day/2023-01-06/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:03:05Z [load_day 2023-01-06] attempt 1 started
2026-11-07T03:03:24Z [load_day 2023-01-06] 2023-01-06 hour 0: 171833 events in 4 files, snapshot 739627650948892239 (task 17000 ms: download 8321 ms overlapping gunzip 1456 ms, parse 6081 ms, sort 550 ms, write 6507 ms, index 462 ms: 6 candidates, 75707 repo-hours, 889 releases; waiting 1410 ms; commit 371 ms)
2026-11-07T03:03:25Z [load_day 2023-01-06] 2023-01-06 hour 1: 179330 events in 4 files, snapshot 3317615774898938767 (task 16985 ms: download 5422 ms overlapping gunzip 1542 ms, parse 6252 ms, sort 633 ms, write 7054 ms, index 501 ms: 3 candidates, 81928 repo-hours, 743 releases; waiting 661 ms; commit 324 ms)
2026-11-07T03:03:40Z [load_day 2023-01-06] 2023-01-06 hour 2: 150142 events in 4 files, snapshot 1191840235711787074 (task 15021 ms: download 4568 ms overlapping gunzip 1266 ms, parse 5111 ms, sort 599 ms, write 6750 ms, index 493 ms: 2 candidates, 72038 repo-hours, 610 releases; waiting 513 ms; commit 465 ms)
2026-11-07T03:03:43Z [load_day 2023-01-06] 2023-01-06 hour 3: 178513 events in 4 files, snapshot 3407720661157327083 (task 17450 ms: download 5106 ms overlapping gunzip 1594 ms, parse 6737 ms, sort 893 ms, write 6886 ms, index 498 ms: 5 candidates, 71432 repo-hours, 803 releases; waiting 549 ms; commit 652 ms)
2026-11-07T03:03:58Z [load_day 2023-01-06] 2023-01-06 hour 4: 175522 events in 4 files, snapshot 9003154403830356170 (task 17521 ms: download 4585 ms overlapping gunzip 1569 ms, parse 6803 ms, sort 720 ms, write 7235 ms, index 415 ms: 9 candidates, 69476 repo-hours, 633 releases; waiting 526 ms; commit 616 ms)
2026-11-07T03:04:00Z [load_day 2023-01-06] 2023-01-06 hour 5: 177480 events in 4 files, snapshot 3800718352670119010 (task 16525 ms: download 5521 ms overlapping gunzip 1502 ms, parse 6381 ms, sort 570 ms, write 6851 ms, index 419 ms: 2 candidates, 72226 repo-hours, 695 releases; waiting 523 ms; commit 579 ms)
2026-11-07T03:04:15Z [load_day 2023-01-06] 2023-01-06 hour 6: 180683 events in 4 files, snapshot 3782326226534262626 (task 15942 ms: download 4427 ms overlapping gunzip 1312 ms, parse 5953 ms, sort 438 ms, write 6858 ms, index 512 ms: 2 candidates, 78415 repo-hours, 737 releases; waiting 519 ms; commit 531 ms)
2026-11-07T03:04:15Z [load_day 2023-01-06] 2023-01-06 hour 7: 181797 events in 4 files, snapshot 1953273993405251891 (task 14703 ms: download 4636 ms overlapping gunzip 1279 ms, parse 5805 ms, sort 387 ms, write 5875 ms, index 470 ms: 5 candidates, 74793 repo-hours, 762 releases; waiting 542 ms; commit 458 ms)
2026-11-07T03:04:32Z [load_day 2023-01-06] 2023-01-06 hour 8: 186987 events in 4 files, snapshot 6653169032633881143 (task 16108 ms: download 4107 ms overlapping gunzip 1320 ms, parse 5937 ms, sort 468 ms, write 6991 ms, index 560 ms: 3 candidates, 80929 repo-hours, 852 releases; waiting 507 ms; commit 645 ms)
2026-11-07T03:04:33Z [load_day 2023-01-06] 2023-01-06 hour 9: 195562 events in 4 files, snapshot 6761880031645518732 (task 16489 ms: download 5992 ms overlapping gunzip 1397 ms, parse 6247 ms, sort 710 ms, write 6569 ms, index 485 ms: 5 candidates, 84023 repo-hours, 970 releases; waiting 784 ms; commit 499 ms)
2026-11-07T03:04:50Z [load_day 2023-01-06] 2023-01-06 hour 10: 193458 events in 4 files, snapshot 6604545411486010953 (task 17905 ms: download 8957 ms overlapping gunzip 1268 ms, parse 5822 ms, sort 718 ms, write 7444 ms, index 468 ms: 10 candidates, 83143 repo-hours, 875 releases; waiting 1547 ms; commit 533 ms)
2026-11-07T03:04:51Z [load_day 2023-01-06] 2023-01-06 hour 11: 193389 events in 4 files, snapshot 288285308302687623 (task 16464 ms: download 4409 ms overlapping gunzip 1274 ms, parse 5766 ms, sort 395 ms, write 7757 ms, index 494 ms: 5 candidates, 80373 repo-hours, 850 releases; waiting 502 ms; commit 604 ms)
2026-11-07T03:05:08Z [load_day 2023-01-06] 2023-01-06 hour 12: 219637 events in 5 files, snapshot 4370336653934700710 (task 17222 ms: download 4505 ms overlapping gunzip 1328 ms, parse 6026 ms, sort 423 ms, write 8042 ms, index 589 ms: 7 candidates, 105161 repo-hours, 945 releases; waiting 511 ms; commit 702 ms)
2026-11-07T03:05:09Z [load_day 2023-01-06] 2023-01-06 hour 13: 208680 events in 5 files, snapshot 8648109169886524139 (task 15966 ms: download 4167 ms overlapping gunzip 1218 ms, parse 5632 ms, sort 665 ms, write 6891 ms, index 562 ms: 4 candidates, 96291 repo-hours, 939 releases; waiting 620 ms; commit 711 ms)
2026-11-07T03:05:26Z [load_day 2023-01-06] 2023-01-06 hour 14: 198452 events in 4 files, snapshot 8429553387862959782 (task 18088 ms: download 5381 ms overlapping gunzip 1212 ms, parse 5529 ms, sort 497 ms, write 9272 ms, index 498 ms: 2 candidates, 82939 repo-hours, 1137 releases; waiting 716 ms; commit 525 ms)
2026-11-07T03:05:27Z [load_day 2023-01-06] 2023-01-06 hour 15: 196682 events in 4 files, snapshot 8051951520462409158 (task 15850 ms: download 5782 ms overlapping gunzip 1149 ms, parse 5303 ms, sort 500 ms, write 7130 ms, index 618 ms: 4 candidates, 84557 repo-hours, 1373 releases; waiting 841 ms; commit 452 ms)
2026-11-07T03:05:42Z [load_day 2023-01-06] 2023-01-06 hour 16: 182875 events in 4 files, snapshot 3668257278896696676 (task 15343 ms: download 3452 ms overlapping gunzip 1010 ms, parse 4739 ms, sort 373 ms, write 8024 ms, index 472 ms: 2 candidates, 80557 repo-hours, 1052 releases; waiting 502 ms; commit 426 ms)
2026-11-07T03:05:43Z [load_day 2023-01-06] 2023-01-06 hour 17: 185067 events in 4 files, snapshot 5906030481913949885 (task 14684 ms: download 3806 ms overlapping gunzip 937 ms, parse 4318 ms, sort 439 ms, write 7729 ms, index 448 ms: 5 candidates, 75884 repo-hours, 928 releases; waiting 518 ms; commit 458 ms)
2026-11-07T03:05:55Z [load_day 2023-01-06] 2023-01-06 hour 18: 191538 events in 4 files, snapshot 6758346369350023915 (task 12486 ms: download 3909 ms overlapping gunzip 988 ms, parse 4417 ms, sort 313 ms, write 5501 ms, index 481 ms: 5 candidates, 78375 repo-hours, 901 releases; waiting 517 ms; commit 564 ms)
2026-11-07T03:05:56Z [load_day 2023-01-06] 2023-01-06 hour 19: 185338 events in 4 files, snapshot 2053255366483504047 (task 12243 ms: download 4538 ms overlapping gunzip 991 ms, parse 4517 ms, sort 308 ms, write 5018 ms, index 417 ms: 1 candidates, 67404 repo-hours, 977 releases; waiting 714 ms; commit 413 ms)
2026-11-07T03:06:09Z [load_day 2023-01-06] 2023-01-06 hour 20: 187612 events in 4 files, snapshot 4717046178587306992 (task 12623 ms: download 4016 ms overlapping gunzip 963 ms, parse 4347 ms, sort 275 ms, write 5768 ms, index 438 ms: 4 candidates, 71537 repo-hours, 1005 releases; waiting 513 ms; commit 711 ms)
2026-11-07T03:06:09Z [load_day 2023-01-06] 2023-01-06 hour 21: 172734 events in 4 files, snapshot 8100376694179869934 (task 12240 ms: download 3288 ms overlapping gunzip 1013 ms, parse 4705 ms, sort 306 ms, write 5049 ms, index 385 ms: 4 candidates, 64053 repo-hours, 871 releases; waiting 512 ms; commit 510 ms)
2026-11-07T03:06:21Z [load_day 2023-01-06] 2023-01-06 hour 22: 150913 events in 4 files, snapshot 4906597363606802802 (task 11578 ms: download 3297 ms overlapping gunzip 802 ms, parse 3642 ms, sort 353 ms, write 5433 ms, index 344 ms: 5 candidates, 58889 repo-hours, 763 releases; waiting 714 ms; commit 690 ms)
2026-11-07T03:06:21Z [load_day 2023-01-06] 2023-01-06 hour 23: 131185 events in 3 files, snapshot 1506216024600065394 (task 9708 ms: download 2642 ms overlapping gunzip 724 ms, parse 3190 ms, sort 248 ms, write 4128 ms, index 554 ms: 8 candidates, 53203 repo-hours, 699 releases; waiting 596 ms; commit 474 ms)
2026-11-07T03:06:29Z [load_day 2023-01-06] 2023-01-06: repo_hour merged from 24 files to 1 (1843333 rows, 7379 ms)
2026-11-07T03:06:30Z [load_day 2023-01-06] 2023-01-06: index committed in 9052 ms (24 + 1 + 24 files)
2026-11-07T03:06:30Z [load_day 2023-01-06] 2023-01-06: 4375409 events in 24 hours
2026-11-07T03:06:30Z [load_day 2023-01-06] attempt 1 succeeded