orcaLog in

Runs · run 413

load_day 2026-07-03, attempt 1 succeeded

Host
4e84322b8c45:83537
Started
2026-11-07T05:20:30Z
Ended
2026-11-07T05:21:40Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/413/load_day/2026-07-03/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:20:30Z [load_day 2026-07-03] attempt 1 started
2026-11-07T05:20:38Z [load_day 2026-07-03] 2026-07-03 hour 0: 164636 events in 4 files, snapshot 1550995889966459673 (task 4395 ms: download 1339 ms overlapping gunzip 248 ms, parse 936 ms, sort 137 ms, write 1767 ms, index 537 ms: 2 candidates, 65812 repo-hours, 120 releases; waiting 498 ms; commit 839 ms)
2026-11-07T05:20:39Z [load_day 2026-07-03] 2026-07-03 hour 1: 160678 events in 4 files, snapshot 2081141195455439956 (task 4089 ms: download 1246 ms overlapping gunzip 205 ms, parse 774 ms, sort 101 ms, write 1714 ms, index 464 ms: 7 candidates, 71448 repo-hours, 68 releases; waiting 512 ms; commit 845 ms)
2026-11-07T05:20:43Z [load_day 2026-07-03] 2026-07-03 hour 2: 167397 events in 4 files, snapshot 2799787257608749697 (task 4255 ms: download 1499 ms overlapping gunzip 219 ms, parse 830 ms, sort 106 ms, write 1730 ms, index 527 ms: 10 candidates, 85200 repo-hours, 59 releases; waiting 517 ms; commit 888 ms)
2026-11-07T05:20:44Z [load_day 2026-07-03] 2026-07-03 hour 3: 160717 events in 4 files, snapshot 2630254643159711804 (task 3887 ms: download 1405 ms overlapping gunzip 201 ms, parse 756 ms, sort 99 ms, write 1558 ms, index 485 ms: 6 candidates, 79303 repo-hours, 76 releases; waiting 490 ms; commit 841 ms)
2026-11-07T05:20:48Z [load_day 2026-07-03] 2026-07-03 hour 4: 160586 events in 4 files, snapshot 508542657783385881 (task 4048 ms: download 1378 ms overlapping gunzip 226 ms, parse 799 ms, sort 109 ms, write 1607 ms, index 498 ms: 8 candidates, 71414 repo-hours, 113 releases; waiting 511 ms; commit 867 ms)
2026-11-07T05:20:49Z [load_day 2026-07-03] 2026-07-03 hour 5: 165032 events in 4 files, snapshot 7174841968923241785 (task 3956 ms: download 1375 ms overlapping gunzip 220 ms, parse 787 ms, sort 114 ms, write 1495 ms, index 491 ms: 4 candidates, 71572 repo-hours, 74 releases; waiting 539 ms; commit 782 ms)
2026-11-07T05:20:53Z [load_day 2026-07-03] 2026-07-03 hour 6: 163843 events in 4 files, snapshot 7205705785618035345 (task 4003 ms: download 1633 ms overlapping gunzip 203 ms, parse 751 ms, sort 105 ms, write 1564 ms, index 551 ms: 3 candidates, 74536 repo-hours, 47 releases; waiting 524 ms; commit 945 ms)
2026-11-07T05:20:53Z [load_day 2026-07-03] 2026-07-03 hour 7: 166636 events in 4 files, snapshot 592259096092027616 (task 3919 ms: download 1344 ms overlapping gunzip 212 ms, parse 769 ms, sort 107 ms, write 1535 ms, index 475 ms: 0 candidates, 71161 repo-hours, 44 releases; waiting 535 ms; commit 802 ms)
2026-11-07T05:20:57Z [load_day 2026-07-03] 2026-07-03 hour 8: 161515 events in 4 files, snapshot 3414214772794078456 (task 3992 ms: download 1422 ms overlapping gunzip 208 ms, parse 757 ms, sort 108 ms, write 1552 ms, index 476 ms: 8 candidates, 70870 repo-hours, 25 releases; waiting 530 ms; commit 844 ms)
2026-11-07T05:20:58Z [load_day 2026-07-03] 2026-07-03 hour 9: 165451 events in 4 files, snapshot 4270766429487324144 (task 3889 ms: download 1166 ms overlapping gunzip 202 ms, parse 785 ms, sort 105 ms, write 1469 ms, index 464 ms: 5 candidates, 66914 repo-hours, 28 releases; waiting 515 ms; commit 928 ms)
2026-11-07T05:21:01Z [load_day 2026-07-03] 2026-07-03 hour 10: 158147 events in 4 files, snapshot 8883462306929056960 (task 3546 ms: download 1155 ms overlapping gunzip 209 ms, parse 746 ms, sort 101 ms, write 1324 ms, index 420 ms: 8 candidates, 64315 repo-hours, 28 releases; waiting 515 ms; commit 1160 ms)
2026-11-07T05:21:03Z [load_day 2026-07-03] 2026-07-03 hour 11: 160962 events in 4 files, snapshot 8525348642193807954 (task 3926 ms: download 1318 ms overlapping gunzip 198 ms, parse 738 ms, sort 107 ms, write 1458 ms, index 553 ms: 5 candidates, 72668 repo-hours, 30 releases; waiting 534 ms; commit 1031 ms)
2026-11-07T05:21:05Z [load_day 2026-07-03] 2026-07-03 hour 12: 167063 events in 4 files, snapshot 3540965003303394589 (task 3459 ms: download 392 ms overlapping gunzip 194 ms, parse 724 ms, sort 108 ms, write 1679 ms, index 533 ms: 5 candidates, 77328 repo-hours, 24 releases; waiting 18 ms; commit 967 ms)
2026-11-07T05:21:07Z [load_day 2026-07-03] 2026-07-03 hour 13: 157459 events in 4 files, snapshot 7697519500261876026 (task 3726 ms: download 1180 ms overlapping gunzip 192 ms, parse 716 ms, sort 109 ms, write 1381 ms, index 527 ms: 7 candidates, 80997 repo-hours, 22 releases; waiting 533 ms; commit 1030 ms)
2026-11-07T05:21:10Z [load_day 2026-07-03] 2026-07-03 hour 14: 165460 events in 4 files, snapshot 5553462837380059067 (task 4305 ms: download 1641 ms overlapping gunzip 199 ms, parse 742 ms, sort 100 ms, write 1545 ms, index 616 ms: 10 candidates, 79304 repo-hours, 14 releases; waiting 810 ms; commit 902 ms)
2026-11-07T05:21:12Z [load_day 2026-07-03] 2026-07-03 hour 15: 161629 events in 4 files, snapshot 153573570258394339 (task 3996 ms: download 1607 ms overlapping gunzip 214 ms, parse 774 ms, sort 101 ms, write 1415 ms, index 492 ms: 5 candidates, 75326 repo-hours, 17 releases; waiting 625 ms; commit 776 ms)
2026-11-07T05:21:15Z [load_day 2026-07-03] 2026-07-03 hour 16: 162188 events in 4 files, snapshot 7188302002204492713 (task 3852 ms: download 1610 ms overlapping gunzip 195 ms, parse 746 ms, sort 97 ms, write 1483 ms, index 520 ms: 5 candidates, 72977 repo-hours, 26 releases; waiting 515 ms; commit 1097 ms)
2026-11-07T05:21:16Z [load_day 2026-07-03] 2026-07-03 hour 17: 162259 events in 4 files, snapshot 7590764259567106796 (task 3935 ms: download 1396 ms overlapping gunzip 198 ms, parse 738 ms, sort 105 ms, write 1445 ms, index 597 ms: 9 candidates, 74411 repo-hours, 18 releases; waiting 533 ms; commit 927 ms)
2026-11-07T05:21:19Z [load_day 2026-07-03] 2026-07-03 hour 18: 163348 events in 4 files, snapshot 1249061760488304516 (task 3759 ms: download 1176 ms overlapping gunzip 201 ms, parse 761 ms, sort 104 ms, write 1417 ms, index 501 ms: 4 candidates, 72397 repo-hours, 25 releases; waiting 543 ms; commit 935 ms)
2026-11-07T05:21:21Z [load_day 2026-07-03] 2026-07-03 hour 19: 162698 events in 4 files, snapshot 4779334116965895389 (task 3976 ms: download 1188 ms overlapping gunzip 207 ms, parse 779 ms, sort 120 ms, write 1561 ms, index 486 ms: 6 candidates, 74699 repo-hours, 29 releases; waiting 514 ms; commit 960 ms)
2026-11-07T05:21:23Z [load_day 2026-07-03] 2026-07-03 hour 20: 162704 events in 4 files, snapshot 2981163789341827203 (task 3878 ms: download 1251 ms overlapping gunzip 202 ms, parse 746 ms, sort 101 ms, write 1496 ms, index 499 ms: 4 candidates, 69433 repo-hours, 30 releases; waiting 533 ms; commit 960 ms)
2026-11-07T05:21:26Z [load_day 2026-07-03] 2026-07-03 hour 21: 163720 events in 4 files, snapshot 7135352186701647217 (task 3960 ms: download 1238 ms overlapping gunzip 214 ms, parse 789 ms, sort 108 ms, write 1587 ms, index 506 ms: 8 candidates, 66985 repo-hours, 71 releases; waiting 528 ms; commit 1211 ms)
2026-11-07T05:21:28Z [load_day 2026-07-03] 2026-07-03 hour 22: 165148 events in 4 files, snapshot 4972028236737347626 (task 4322 ms: download 1487 ms overlapping gunzip 236 ms, parse 859 ms, sort 117 ms, write 1726 ms, index 550 ms: 6 candidates, 67563 repo-hours, 188 releases; waiting 537 ms; commit 1104 ms)
2026-11-07T05:21:31Z [load_day 2026-07-03] 2026-07-03 hour 23: 156516 events in 4 files, snapshot 125807577033228198 (task 4588 ms: download 1611 ms overlapping gunzip 281 ms, parse 1014 ms, sort 114 ms, write 1940 ms, index 401 ms: 10 candidates, 64644 repo-hours, 507 releases; waiting 508 ms; commit 898 ms)
2026-11-07T05:21:38Z [load_day 2026-07-03] 2026-07-03: repo_hour merged from 24 files to 1 (1741277 rows, 7073 ms)
2026-11-07T05:21:40Z [load_day 2026-07-03] 2026-07-03: index committed in 8745 ms (23 + 1 + 24 files)
2026-11-07T05:21:40Z [load_day 2026-07-03] 2026-07-03: 3905792 events in 24 hours
2026-11-07T05:21:40Z [load_day 2026-07-03] attempt 1 succeeded