orcaLog in

Runs · run 648

load_day 2026-04-16, attempt 1 succeeded

Host
4e84322b8c45:158322
Started
2026-11-07T12:50:52Z
Ended
2026-11-07T12:52:19Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/648/load_day/2026-04-16/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T12:50:52Z [load_day 2026-04-16] attempt 1 started
2026-11-07T12:51:01Z [load_day 2026-04-16] 2026-04-16 hour 0: 154924 events in 4 files, snapshot 8511722303238820495 (task 6364 ms: download 2010 ms overlapping gunzip 396 ms, parse 1348 ms, sort 201 ms, write 3087 ms, index 516 ms: 8 candidates, 74479 repo-hours, 812 releases; waiting 511 ms; commit 1126 ms)
2026-11-07T12:51:03Z [load_day 2026-04-16] 2026-04-16 hour 1: 157869 events in 4 files, snapshot 6063136712306794995 (task 6060 ms: download 2029 ms overlapping gunzip 350 ms, parse 1185 ms, sort 159 ms, write 3001 ms, index 556 ms: 8 candidates, 85478 repo-hours, 471 releases; waiting 501 ms; commit 1291 ms)
2026-11-07T12:51:08Z [load_day 2026-04-16] 2026-04-16 hour 2: 157929 events in 4 files, snapshot 8225008544802912211 (task 5596 ms: download 1733 ms overlapping gunzip 356 ms, parse 1202 ms, sort 158 ms, write 2322 ms, index 686 ms: 8 candidates, 89468 repo-hours, 418 releases; waiting 559 ms; commit 1284 ms)
2026-11-07T12:51:10Z [load_day 2026-04-16] 2026-04-16 hour 3: 154717 events in 4 files, snapshot 5272022455508593556 (task 6435 ms: download 2284 ms overlapping gunzip 427 ms, parse 1465 ms, sort 178 ms, write 2933 ms, index 559 ms: 8 candidates, 81700 repo-hours, 499 releases; waiting 553 ms; commit 1220 ms)
2026-11-07T12:51:15Z [load_day 2026-04-16] 2026-04-16 hour 4: 154959 events in 4 files, snapshot 1274374891643158469 (task 6458 ms: download 2062 ms overlapping gunzip 418 ms, parse 1401 ms, sort 186 ms, write 2986 ms, index 666 ms: 8 candidates, 75220 repo-hours, 679 releases; waiting 477 ms; commit 1159 ms)
2026-11-07T12:51:17Z [load_day 2026-04-16] 2026-04-16 hour 5: 155287 events in 4 files, snapshot 7462109141103834888 (task 6525 ms: download 2070 ms overlapping gunzip 447 ms, parse 1467 ms, sort 167 ms, write 2978 ms, index 580 ms: 14 candidates, 77064 repo-hours, 644 releases; waiting 526 ms; commit 1635 ms)
2026-11-07T12:51:21Z [load_day 2026-04-16] 2026-04-16 hour 6: 154557 events in 4 files, snapshot 3772973691262432850 (task 5307 ms: download 1681 ms overlapping gunzip 313 ms, parse 1042 ms, sort 121 ms, write 2340 ms, index 650 ms: 13 candidates, 83203 repo-hours, 439 releases; waiting 536 ms; commit 1061 ms)
2026-11-07T12:51:23Z [load_day 2026-04-16] 2026-04-16 hour 7: 154652 events in 4 files, snapshot 8609686890013277666 (task 5023 ms: download 1677 ms overlapping gunzip 304 ms, parse 1007 ms, sort 143 ms, write 2240 ms, index 564 ms: 7 candidates, 86758 repo-hours, 409 releases; waiting 542 ms; commit 1669 ms)
2026-11-07T12:51:27Z [load_day 2026-04-16] 2026-04-16 hour 8: 155827 events in 4 files, snapshot 3105605948148276119 (task 4920 ms: download 1807 ms overlapping gunzip 331 ms, parse 1045 ms, sort 121 ms, write 2008 ms, index 537 ms: 6 candidates, 84153 repo-hours, 247 releases; waiting 544 ms; commit 1271 ms)
2026-11-07T12:51:28Z [load_day 2026-04-16] 2026-04-16 hour 9: 157017 events in 4 files, snapshot 5724453222021135326 (task 4353 ms: download 1073 ms overlapping gunzip 292 ms, parse 963 ms, sort 118 ms, write 1818 ms, index 604 ms: 7 candidates, 86268 repo-hours, 192 releases; waiting 238 ms; commit 1121 ms)
2026-11-07T12:51:32Z [load_day 2026-04-16] 2026-04-16 hour 10: 161392 events in 4 files, snapshot 1037328600961152480 (task 4799 ms: download 1600 ms overlapping gunzip 300 ms, parse 1065 ms, sort 128 ms, write 1906 ms, index 697 ms: 5 candidates, 86634 repo-hours, 145 releases; waiting 405 ms; commit 1325 ms)
2026-11-07T12:51:33Z [load_day 2026-04-16] 2026-04-16 hour 11: 159312 events in 4 files, snapshot 37837424443603156 (task 4888 ms: download 1667 ms overlapping gunzip 325 ms, parse 1148 ms, sort 147 ms, write 1872 ms, index 601 ms: 10 candidates, 85944 repo-hours, 196 releases; waiting 528 ms; commit 1234 ms)
2026-11-07T12:51:38Z [load_day 2026-04-16] 2026-04-16 hour 12: 158907 events in 4 files, snapshot 5985138833661034129 (task 4907 ms: download 1633 ms overlapping gunzip 254 ms, parse 862 ms, sort 109 ms, write 2100 ms, index 651 ms: 7 candidates, 91062 repo-hours, 184 releases; waiting 539 ms; commit 1079 ms)
2026-11-07T12:51:39Z [load_day 2026-04-16] 2026-04-16 hour 13: 160870 events in 4 files, snapshot 3858641093313783629 (task 4555 ms: download 1527 ms overlapping gunzip 250 ms, parse 881 ms, sort 132 ms, write 1776 ms, index 662 ms: 6 candidates, 98935 repo-hours, 84 releases; waiting 525 ms; commit 1237 ms)
2026-11-07T12:51:43Z [load_day 2026-04-16] 2026-04-16 hour 14: 158899 events in 4 files, snapshot 7014849227283048624 (task 4458 ms: download 1468 ms overlapping gunzip 221 ms, parse 795 ms, sort 112 ms, write 1788 ms, index 631 ms: 8 candidates, 90981 repo-hours, 111 releases; waiting 612 ms; commit 1215 ms)
2026-11-07T12:51:44Z [load_day 2026-04-16] 2026-04-16 hour 15: 157427 events in 4 files, snapshot 283591444400844496 (task 4433 ms: download 1465 ms overlapping gunzip 231 ms, parse 873 ms, sort 140 ms, write 1687 ms, index 636 ms: 9 candidates, 89797 repo-hours, 114 releases; waiting 547 ms; commit 1425 ms)
2026-11-07T12:51:48Z [load_day 2026-04-16] 2026-04-16 hour 16: 159132 events in 4 files, snapshot 85110023669798044 (task 4200 ms: download 986 ms overlapping gunzip 258 ms, parse 859 ms, sort 126 ms, write 1901 ms, index 614 ms: 4 candidates, 88188 repo-hours, 144 releases; waiting 221 ms; commit 1306 ms)
2026-11-07T12:51:50Z [load_day 2026-04-16] 2026-04-16 hour 17: 159701 events in 4 files, snapshot 6512369427504071037 (task 4834 ms: download 1470 ms overlapping gunzip 280 ms, parse 959 ms, sort 164 ms, write 2005 ms, index 616 ms: 9 candidates, 88236 repo-hours, 183 releases; waiting 535 ms; commit 1237 ms)
2026-11-07T12:51:53Z [load_day 2026-04-16] 2026-04-16 hour 18: 158686 events in 4 files, snapshot 5040251441582705199 (task 4447 ms: download 1398 ms overlapping gunzip 248 ms, parse 860 ms, sort 135 ms, write 1983 ms, index 648 ms: 5 candidates, 86999 repo-hours, 275 releases; waiting 250 ms; commit 1242 ms)
2026-11-07T12:51:55Z [load_day 2026-04-16] 2026-04-16 hour 19: 158640 events in 4 files, snapshot 3682552692657585132 (task 4653 ms: download 1206 ms overlapping gunzip 277 ms, parse 960 ms, sort 136 ms, write 2097 ms, index 657 ms: 11 candidates, 85987 repo-hours, 272 releases; waiting 309 ms; commit 1293 ms)
2026-11-07T12:51:59Z [load_day 2026-04-16] 2026-04-16 hour 20: 158190 events in 4 files, snapshot 4243137318713956053 (task 5039 ms: download 1436 ms overlapping gunzip 294 ms, parse 1009 ms, sort 161 ms, write 2323 ms, index 587 ms: 7 candidates, 83155 repo-hours, 344 releases; waiting 384 ms; commit 1276 ms)
2026-11-07T12:52:02Z [load_day 2026-04-16] 2026-04-16 hour 21: 153136 events in 4 files, snapshot 7542493356185226687 (task 5533 ms: download 2064 ms overlapping gunzip 353 ms, parse 1170 ms, sort 150 ms, write 2467 ms, index 565 ms: 5 candidates, 79751 repo-hours, 619 releases; waiting 530 ms; commit 1351 ms)
2026-11-07T12:52:06Z [load_day 2026-04-16] 2026-04-16 hour 22: 154131 events in 4 files, snapshot 1542879702314696735 (task 6672 ms: download 2275 ms overlapping gunzip 407 ms, parse 1377 ms, sort 176 ms, write 2806 ms, index 533 ms: 6 candidates, 75265 repo-hours, 660 releases; waiting 1039 ms; commit 1242 ms)
2026-11-07T12:52:09Z [load_day 2026-04-16] 2026-04-16 hour 23: 151635 events in 4 files, snapshot 3089093346748520738 (task 6306 ms: download 2054 ms overlapping gunzip 403 ms, parse 1377 ms, sort 168 ms, write 2832 ms, index 514 ms: 3 candidates, 73963 repo-hours, 795 releases; waiting 728 ms; commit 1238 ms)
2026-11-07T12:52:17Z [load_day 2026-04-16] 2026-04-16: repo_hour merged from 24 files to 1 (2028688 rows, 8447 ms)
2026-11-07T12:52:19Z [load_day 2026-04-16] 2026-04-16: index committed in 10044 ms (24 + 1 + 24 files)
2026-11-07T12:52:19Z [load_day 2026-04-16] 2026-04-16: 3767796 events in 24 hours
2026-11-07T12:52:19Z [load_day 2026-04-16] attempt 1 succeeded