orcaLog in

Runs · run 1577

load_day 2023-10-02, attempt 1 succeeded

Host
3c2b29713ce8:391287
Started
2026-11-08T01:22:33Z
Ended
2026-11-08T01:27:03Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1577/load_day/2023-10-02/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T01:22:33Z [load_day 2023-10-02] attempt 1 started
2026-11-08T01:22:35Z [load_day 2023-10-02] 2023-10-02: 2 hours in flight, about 1200 MB
2026-11-08T01:22:53Z [load_day 2023-10-02] 2023-10-02 hour 0: 146364 events in 3 files, snapshot 9020575355399655725 (task 14004 ms: download 5807 ms overlapping gunzip 682 ms, parse 3248 ms, sort 114 ms, write 8393 ms, index 708 ms: 11 candidates, 77024 repo-hours, 815 releases; waiting 602 ms; commit 2481 ms)
2026-11-08T01:22:56Z [load_day 2023-10-02] 2023-10-02 hour 1: 151254 events in 4 files, snapshot 4120396819622965418 (task 15660 ms: download 6474 ms overlapping gunzip 949 ms, parse 4590 ms, sort 174 ms, write 8523 ms, index 603 ms: 10 candidates, 81366 repo-hours, 619 releases; waiting 509 ms; commit 3403 ms)
2026-11-08T01:23:07Z [load_day 2023-10-02] 2023-10-02 hour 2: 124420 events in 3 files, snapshot 4710987727342691768 (task 12320 ms: download 5486 ms overlapping gunzip 844 ms, parse 3246 ms, sort 80 ms, write 6931 ms, index 344 ms: 5 candidates, 48363 repo-hours, 522 releases; waiting 576 ms; commit 3887 ms)
2026-11-08T01:23:10Z [load_day 2023-10-02] 2023-10-02 hour 3: 122725 events in 3 files, snapshot 3965140825550057240 (task 12568 ms: download 5111 ms overlapping gunzip 655 ms, parse 2763 ms, sort 96 ms, write 7489 ms, index 788 ms: 3 candidates, 48435 repo-hours, 697 releases; waiting 510 ms; commit 2843 ms)
2026-11-08T01:23:22Z [load_day 2023-10-02] 2023-10-02 hour 4: 129573 events in 3 files, snapshot 754915848659262602 (task 13910 ms: download 6227 ms overlapping gunzip 968 ms, parse 3716 ms, sort 83 ms, write 7901 ms, index 360 ms: 1 candidates, 49931 repo-hours, 592 releases; waiting 539 ms; commit 3525 ms)
2026-11-08T01:23:28Z [load_day 2023-10-02] 2023-10-02 hour 5: 137733 events in 3 files, snapshot 3730188979346556961 (task 14813 ms: download 6031 ms overlapping gunzip 817 ms, parse 3528 ms, sort 94 ms, write 8871 ms, index 700 ms: 10 candidates, 54686 repo-hours, 755 releases; waiting 522 ms; commit 4020 ms)
2026-11-08T01:23:41Z [load_day 2023-10-02] 2023-10-02 hour 6: 161953 events in 4 files, snapshot 6556276336689711757 (task 18211 ms: download 11113 ms overlapping gunzip 1202 ms, parse 5066 ms, sort 149 ms, write 10241 ms, index 705 ms: 9 candidates, 68156 repo-hours, 782 releases; waiting 527 ms; commit 3766 ms)
2026-11-08T01:23:47Z [load_day 2023-10-02] 2023-10-02 hour 7: 174049 events in 4 files, snapshot 6799594879988398510 (task 19719 ms: download 11393 ms overlapping gunzip 1145 ms, parse 5127 ms, sort 131 ms, write 11949 ms, index 590 ms: 3 candidates, 70215 repo-hours, 898 releases; waiting 550 ms; commit 2781 ms)
2026-11-08T01:24:03Z [load_day 2023-10-02] 2023-10-02 hour 8: 181488 events in 4 files, snapshot 6540290593359963436 (task 21028 ms: download 11707 ms overlapping gunzip 1233 ms, parse 5353 ms, sort 153 ms, write 12702 ms, index 607 ms: 10 candidates, 75485 repo-hours, 991 releases; waiting 531 ms; commit 2914 ms)
2026-11-08T01:24:15Z [load_day 2023-10-02] 2023-10-02 hour 9: 192194 events in 4 files, snapshot 5209654996748931238 (task 20518 ms: download 12184 ms overlapping gunzip 1254 ms, parse 5621 ms, sort 185 ms, write 12146 ms, index 517 ms: 10 candidates, 79335 repo-hours, 1063 releases; waiting 547 ms; commit 8542 ms)
2026-11-08T01:24:21Z [load_day 2023-10-02] 2023-10-02 hour 10: 193363 events in 4 files, snapshot 1584961808502027868 (task 18244 ms: download 10689 ms overlapping gunzip 1114 ms, parse 4854 ms, sort 123 ms, write 10822 ms, index 544 ms: 6 candidates, 79296 repo-hours, 882 releases; waiting 530 ms; commit 2219 ms)
2026-11-08T01:24:28Z [load_day 2023-10-02] 2023-10-02 hour 11: 191498 events in 4 files, snapshot 1936998407344693607 (task 17742 ms: download 10207 ms overlapping gunzip 1104 ms, parse 4588 ms, sort 131 ms, write 10481 ms, index 553 ms: 15 candidates, 79092 repo-hours, 864 releases; waiting 520 ms; commit 2730 ms)
2026-11-08T01:24:46Z [load_day 2023-10-02] 2023-10-02 hour 12: 243575 events in 5 files, snapshot 580166782038805237 (task 23316 ms: download 14829 ms overlapping gunzip 1280 ms, parse 5719 ms, sort 166 ms, write 14447 ms, index 886 ms: 23 candidates, 113689 repo-hours, 951 releases; waiting 516 ms; commit 2366 ms)
2026-11-08T01:24:54Z [load_day 2023-10-02] 2023-10-02 hour 13: 228521 events in 5 files, snapshot 2225716498759607864 (task 25493 ms: download 17379 ms overlapping gunzip 1488 ms, parse 6694 ms, sort 173 ms, write 15626 ms, index 849 ms: 17 candidates, 108942 repo-hours, 1121 releases; waiting 385 ms; commit 3115 ms)
2026-11-08T01:25:14Z [load_day 2023-10-02] 2023-10-02 hour 14: 217855 events in 5 files, snapshot 863446868302506197 (task 26906 ms: download 17796 ms overlapping gunzip 1607 ms, parse 6924 ms, sort 148 ms, write 16631 ms, index 668 ms: 4 candidates, 94691 repo-hours, 1140 releases; waiting 540 ms; commit 2544 ms)
2026-11-08T01:25:19Z [load_day 2023-10-02] 2023-10-02 hour 15: 193397 events in 4 files, snapshot 8689965725449760273 (task 23634 ms: download 12722 ms overlapping gunzip 1260 ms, parse 5414 ms, sort 163 ms, write 15290 ms, index 718 ms: 14 candidates, 89334 repo-hours, 1042 releases; waiting 501 ms; commit 2910 ms)
2026-11-08T01:25:38Z [load_day 2023-10-02] 2023-10-02 hour 16: 200216 events in 5 files, snapshot 3425739805304840702 (task 23246 ms: download 13065 ms overlapping gunzip 1493 ms, parse 6433 ms, sort 159 ms, write 13277 ms, index 697 ms: 6 candidates, 88691 repo-hours, 956 releases; waiting 845 ms; commit 2777 ms)
2026-11-08T01:25:43Z [load_day 2023-10-02] 2023-10-02 hour 17: 200010 events in 5 files, snapshot 7438692409655005436 (task 23100 ms: download 13495 ms overlapping gunzip 1362 ms, parse 6091 ms, sort 181 ms, write 13751 ms, index 924 ms: 9 candidates, 86097 repo-hours, 952 releases; waiting 496 ms; commit 2590 ms)
2026-11-08T01:26:04Z [load_day 2023-10-02] 2023-10-02 hour 18: 212366 events in 5 files, snapshot 256279304099182189 (task 24404 ms: download 17266 ms overlapping gunzip 1367 ms, parse 5760 ms, sort 258 ms, write 15266 ms, index 930 ms: 12 candidates, 93028 repo-hours, 1191 releases; waiting 514 ms; commit 2858 ms)
2026-11-08T01:26:09Z [load_day 2023-10-02] 2023-10-02 hour 19: 199245 events in 4 files, snapshot 3815805363254359483 (task 23511 ms: download 13349 ms overlapping gunzip 1156 ms, parse 5119 ms, sort 246 ms, write 15231 ms, index 828 ms: 15 candidates, 82692 repo-hours, 1024 releases; waiting 665 ms; commit 4468 ms)
2026-11-08T01:26:27Z [load_day 2023-10-02] 2023-10-02 hour 20: 191015 events in 4 files, snapshot 8855671218809965491 (task 21232 ms: download 12501 ms overlapping gunzip 1188 ms, parse 5187 ms, sort 211 ms, write 13093 ms, index 746 ms: 8 candidates, 78295 repo-hours, 950 releases; waiting 522 ms; commit 2700 ms)
2026-11-08T01:26:32Z [load_day 2023-10-02] 2023-10-02 hour 21: 178736 events in 4 files, snapshot 4927139885996002483 (task 20575 ms: download 12503 ms overlapping gunzip 1320 ms, parse 5782 ms, sort 150 ms, write 11675 ms, index 779 ms: 10 candidates, 72396 repo-hours, 943 releases; waiting 563 ms; commit 4755 ms)
2026-11-08T01:26:46Z [load_day 2023-10-02] 2023-10-02 hour 22: 165454 events in 4 files, snapshot 3087697427448112851 (task 18759 ms: download 12282 ms overlapping gunzip 1119 ms, parse 4875 ms, sort 121 ms, write 11188 ms, index 420 ms: 11 candidates, 64015 repo-hours, 917 releases; waiting 728 ms; commit 2410 ms)
2026-11-08T01:26:52Z [load_day 2023-10-02] 2023-10-02 hour 23: 151944 events in 4 files, snapshot 3093375976881204762 (task 16103 ms: download 7599 ms overlapping gunzip 982 ms, parse 4295 ms, sort 103 ms, write 9517 ms, index 405 ms: 7 candidates, 60548 repo-hours, 664 releases; waiting 563 ms; commit 6148 ms)
2026-11-08T01:27:01Z [load_day 2023-10-02] 2023-10-02: repo_hour merged from 24 files to 1 (1843802 rows, 8470 ms)
2026-11-08T01:27:03Z [load_day 2023-10-02] 2023-10-02: index committed in 10584 ms (24 + 1 + 24 files)
2026-11-08T01:27:03Z [load_day 2023-10-02] 2023-10-02: 4288948 events in 24 hours
2026-11-08T01:27:03Z [load_day 2023-10-02] attempt 1 succeeded