orcaLog in

Runs · run 26

load_day 2023-01-09, attempt 1 succeeded

Host
4e84322b8c45:9333
Started
2026-11-07T03:10:58Z
Ended
2026-11-07T03:14:11Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/26/load_day/2023-01-09/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:10:58Z [load_day 2023-01-09] attempt 1 started
2026-11-07T03:11:09Z [load_day 2023-01-09] 2023-01-09 hour 0: 132241 events in 3 files, snapshot 8974875763646375529 (task 9096 ms: download 2756 ms overlapping gunzip 665 ms, parse 3087 ms, sort 285 ms, write 3943 ms, index 364 ms: 1 candidates, 63375 repo-hours, 894 releases; waiting 470 ms; commit 721 ms)
2026-11-07T03:11:12Z [load_day 2023-01-09] 2023-01-09 hour 1: 153797 events in 4 files, snapshot 4844145795158315837 (task 11630 ms: download 3913 ms overlapping gunzip 937 ms, parse 4054 ms, sort 411 ms, write 4952 ms, index 439 ms: 3 candidates, 72574 repo-hours, 780 releases; waiting 503 ms; commit 722 ms)
2026-11-07T03:11:20Z [load_day 2023-01-09] 2023-01-09 hour 2: 140019 events in 3 files, snapshot 1399965585521106560 (task 10444 ms: download 2945 ms overlapping gunzip 829 ms, parse 3747 ms, sort 354 ms, write 4323 ms, index 355 ms: 5 candidates, 62646 repo-hours, 651 releases; waiting 505 ms; commit 522 ms)
2026-11-07T03:11:23Z [load_day 2023-01-09] 2023-01-09 hour 3: 148055 events in 3 files, snapshot 6837681893289967664 (task 10283 ms: download 2694 ms overlapping gunzip 857 ms, parse 3786 ms, sort 301 ms, write 4258 ms, index 335 ms: 0 candidates, 53978 repo-hours, 832 releases; waiting 449 ms; commit 648 ms)
2026-11-07T03:11:32Z [load_day 2023-01-09] 2023-01-09 hour 4: 148726 events in 3 files, snapshot 8657297471562648950 (task 10656 ms: download 2938 ms overlapping gunzip 894 ms, parse 3943 ms, sort 327 ms, write 4396 ms, index 300 ms: 4 candidates, 51457 repo-hours, 641 releases; waiting 503 ms; commit 523 ms)
2026-11-07T03:11:33Z [load_day 2023-01-09] 2023-01-09 hour 5: 149262 events in 3 files, snapshot 5285792992071554943 (task 10002 ms: download 3103 ms overlapping gunzip 838 ms, parse 3783 ms, sort 300 ms, write 3931 ms, index 325 ms: 5 candidates, 54687 repo-hours, 782 releases; waiting 532 ms; commit 828 ms)
2026-11-07T03:11:44Z [load_day 2023-01-09] 2023-01-09 hour 6: 164727 events in 4 files, snapshot 1502093782795271721 (task 12047 ms: download 3178 ms overlapping gunzip 956 ms, parse 4182 ms, sort 322 ms, write 5272 ms, index 492 ms: 3 candidates, 66587 repo-hours, 768 releases; waiting 504 ms; commit 623 ms)
2026-11-07T03:11:47Z [load_day 2023-01-09] 2023-01-09 hour 7: 176861 events in 4 files, snapshot 4250303370695318053 (task 13070 ms: download 3184 ms overlapping gunzip 1096 ms, parse 4870 ms, sort 375 ms, write 5501 ms, index 416 ms: 4 candidates, 67549 repo-hours, 790 releases; waiting 499 ms; commit 626 ms)
2026-11-07T03:12:00Z [load_day 2023-01-09] 2023-01-09 hour 8: 185508 events in 4 files, snapshot 4423515749972841287 (task 14686 ms: download 5410 ms overlapping gunzip 1170 ms, parse 5164 ms, sort 341 ms, write 6256 ms, index 465 ms: 11 candidates, 75383 repo-hours, 927 releases; waiting 925 ms; commit 530 ms)
2026-11-07T03:12:03Z [load_day 2023-01-09] 2023-01-09 hour 9: 196204 events in 4 files, snapshot 3050065476309825285 (task 15358 ms: download 4408 ms overlapping gunzip 1236 ms, parse 5466 ms, sort 364 ms, write 6911 ms, index 494 ms: 5 candidates, 79627 repo-hours, 1056 releases; waiting 574 ms; commit 544 ms)
2026-11-07T03:12:16Z [load_day 2023-01-09] 2023-01-09 hour 10: 195942 events in 4 files, snapshot 4672694150976241534 (task 15695 ms: download 4145 ms overlapping gunzip 1232 ms, parse 5666 ms, sort 405 ms, write 7060 ms, index 505 ms: 8 candidates, 78573 repo-hours, 951 releases; waiting 519 ms; commit 433 ms)
2026-11-07T03:12:22Z [load_day 2023-01-09] 2023-01-09 hour 11: 203306 events in 5 files, snapshot 6537964087615820912 (task 18457 ms: download 5139 ms overlapping gunzip 1586 ms, parse 6308 ms, sort 425 ms, write 8470 ms, index 834 ms: 5 candidates, 82577 repo-hours, 897 releases; waiting 510 ms; commit 510 ms)
2026-11-07T03:12:36Z [load_day 2023-01-09] 2023-01-09 hour 12: 203617 events in 5 files, snapshot 301215094782878170 (task 19346 ms: download 5333 ms overlapping gunzip 1687 ms, parse 6650 ms, sort 605 ms, write 9081 ms, index 525 ms: 9 candidates, 92092 repo-hours, 966 releases; waiting 531 ms; commit 1032 ms)
2026-11-07T03:12:39Z [load_day 2023-01-09] 2023-01-09 hour 13: 209919 events in 5 files, snapshot 1939608356315891552 (task 16617 ms: download 5043 ms overlapping gunzip 1186 ms, parse 5261 ms, sort 423 ms, write 8074 ms, index 608 ms: 4 candidates, 85540 repo-hours, 1078 releases; waiting 784 ms; commit 572 ms)
2026-11-07T03:12:55Z [load_day 2023-01-09] 2023-01-09 hour 14: 219625 events in 5 files, snapshot 8228065267966894022 (task 18164 ms: download 5397 ms overlapping gunzip 1445 ms, parse 6245 ms, sort 623 ms, write 7844 ms, index 744 ms: 6 candidates, 96225 repo-hours, 1007 releases; waiting 599 ms; commit 443 ms)
2026-11-07T03:12:57Z [load_day 2023-01-09] 2023-01-09 hour 15: 216854 events in 5 files, snapshot 362984302620385391 (task 17890 ms: download 4781 ms overlapping gunzip 1387 ms, parse 6215 ms, sort 416 ms, write 8470 ms, index 543 ms: 5 candidates, 92596 repo-hours, 1285 releases; waiting 520 ms; commit 496 ms)
2026-11-07T03:13:12Z [load_day 2023-01-09] 2023-01-09 hour 16: 203219 events in 5 files, snapshot 71350525519681294 (task 16215 ms: download 4226 ms overlapping gunzip 1220 ms, parse 5516 ms, sort 578 ms, write 7552 ms, index 489 ms: 5 candidates, 87449 repo-hours, 1012 releases; waiting 524 ms; commit 594 ms)
2026-11-07T03:13:14Z [load_day 2023-01-09] 2023-01-09 hour 17: 190251 events in 4 files, snapshot 8459582368613525091 (task 15647 ms: download 3820 ms overlapping gunzip 1218 ms, parse 5477 ms, sort 497 ms, write 7197 ms, index 472 ms: 4 candidates, 80300 repo-hours, 841 releases; waiting 506 ms; commit 747 ms)
2026-11-07T03:13:29Z [load_day 2023-01-09] 2023-01-09 hour 18: 203399 events in 5 files, snapshot 777213313132456331 (task 16740 ms: download 5862 ms overlapping gunzip 1256 ms, parse 5498 ms, sort 446 ms, write 7448 ms, index 529 ms: 14 candidates, 84824 repo-hours, 1058 releases; waiting 1162 ms; commit 495 ms)
2026-11-07T03:13:30Z [load_day 2023-01-09] 2023-01-09 hour 19: 204062 events in 5 files, snapshot 1665587498192012705 (task 16119 ms: download 4562 ms overlapping gunzip 1410 ms, parse 6175 ms, sort 450 ms, write 6865 ms, index 462 ms: 7 candidates, 79284 repo-hours, 1538 releases; waiting 502 ms; commit 594 ms)
2026-11-07T03:13:44Z [load_day 2023-01-09] 2023-01-09 hour 20: 194851 events in 4 files, snapshot 3489794462467102602 (task 14722 ms: download 4101 ms overlapping gunzip 1190 ms, parse 5222 ms, sort 427 ms, write 6555 ms, index 460 ms: 6 candidates, 76327 repo-hours, 1438 releases; waiting 518 ms; commit 657 ms)
2026-11-07T03:13:46Z [load_day 2023-01-09] 2023-01-09 hour 21: 194126 events in 4 files, snapshot 8340735689625745367 (task 15747 ms: download 4918 ms overlapping gunzip 1324 ms, parse 5805 ms, sort 459 ms, write 6548 ms, index 559 ms: 4 candidates, 73014 repo-hours, 1396 releases; waiting 695 ms; commit 573 ms)
2026-11-07T03:14:02Z [load_day 2023-01-09] 2023-01-09 hour 22: 195466 events in 4 files, snapshot 4140988958262134430 (task 16592 ms: download 5351 ms overlapping gunzip 1396 ms, parse 6172 ms, sort 418 ms, write 7364 ms, index 433 ms: 6 candidates, 73061 repo-hours, 958 releases; waiting 512 ms; commit 744 ms)
2026-11-07T03:14:02Z [load_day 2023-01-09] 2023-01-09 hour 23: 163879 events in 4 files, snapshot 7601525642859496743 (task 14233 ms: download 4300 ms overlapping gunzip 1222 ms, parse 5373 ms, sort 327 ms, write 6007 ms, index 490 ms: 1 candidates, 61593 repo-hours, 686 releases; waiting 501 ms; commit 683 ms)
2026-11-07T03:14:10Z [load_day 2023-01-09] 2023-01-09: repo_hour merged from 24 files to 1 (1791318 rows, 7383 ms)
2026-11-07T03:14:11Z [load_day 2023-01-09] 2023-01-09: index committed in 8995 ms (23 + 1 + 24 files)
2026-11-07T03:14:11Z [load_day 2023-01-09] 2023-01-09: 4393916 events in 24 hours
2026-11-07T03:14:11Z [load_day 2023-01-09] attempt 1 succeeded