orcaLog in

Runs · run 696

load_day 2026-03-31, attempt 1 succeeded

Host
4e84322b8c45:171962
Started
2026-11-07T13:17:25Z
Ended
2026-11-07T13:19:00Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/696/load_day/2026-03-31/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T13:17:25Z [load_day 2026-03-31] attempt 1 started
2026-11-07T13:17:36Z [load_day 2026-03-31] 2026-03-31 hour 0: 150748 events in 4 files, snapshot 6682549422673041722 (task 6444 ms: download 1535 ms overlapping gunzip 425 ms, parse 1421 ms, sort 211 ms, write 3391 ms, index 489 ms: 11 candidates, 74156 repo-hours, 869 releases; waiting 193 ms; commit 1237 ms)
2026-11-07T13:17:37Z [load_day 2026-03-31] 2026-03-31 hour 1: 161633 events in 4 files, snapshot 6609537612361272661 (task 6433 ms: download 2162 ms overlapping gunzip 387 ms, parse 1296 ms, sort 186 ms, write 3007 ms, index 591 ms: 11 candidates, 92986 repo-hours, 573 releases; waiting 637 ms; commit 1196 ms)
2026-11-07T13:17:42Z [load_day 2026-03-31] 2026-03-31 hour 2: 160262 events in 4 files, snapshot 999999004618371028 (task 5516 ms: download 1799 ms overlapping gunzip 386 ms, parse 1211 ms, sort 140 ms, write 2463 ms, index 630 ms: 15 candidates, 95019 repo-hours, 399 releases; waiting 400 ms; commit 1471 ms)
2026-11-07T13:17:44Z [load_day 2026-03-31] 2026-03-31 hour 3: 156612 events in 4 files, snapshot 2183109503248655381 (task 6314 ms: download 2658 ms overlapping gunzip 496 ms, parse 1583 ms, sort 152 ms, write 2625 ms, index 537 ms: 7 candidates, 78259 repo-hours, 623 releases; waiting 620 ms; commit 1578 ms)
2026-11-07T13:17:51Z [load_day 2026-03-31] 2026-03-31 hour 4: 152762 events in 4 files, snapshot 7793076317480832066 (task 7931 ms: download 2621 ms overlapping gunzip 603 ms, parse 1806 ms, sort 295 ms, write 3733 ms, index 489 ms: 7 candidates, 68029 repo-hours, 643 releases; waiting 702 ms; commit 1438 ms)
2026-11-07T13:17:52Z [load_day 2026-03-31] 2026-03-31 hour 5: 161582 events in 4 files, snapshot 2604638897727022251 (task 6776 ms: download 2363 ms overlapping gunzip 521 ms, parse 1604 ms, sort 166 ms, write 2940 ms, index 525 ms: 8 candidates, 80224 repo-hours, 452 releases; waiting 631 ms; commit 1476 ms)
2026-11-07T13:17:59Z [load_day 2026-03-31] 2026-03-31 hour 6: 159818 events in 4 files, snapshot 3313250409972978695 (task 6975 ms: download 2398 ms overlapping gunzip 529 ms, parse 1622 ms, sort 152 ms, write 3068 ms, index 554 ms: 7 candidates, 83597 repo-hours, 306 releases; waiting 715 ms; commit 1446 ms)
2026-11-07T13:18:00Z [load_day 2026-03-31] 2026-03-31 hour 7: 156170 events in 4 files, snapshot 1190827635905042847 (task 5614 ms: download 1992 ms overlapping gunzip 394 ms, parse 1214 ms, sort 175 ms, write 2386 ms, index 565 ms: 7 candidates, 84807 repo-hours, 165 releases; waiting 558 ms; commit 1274 ms)
2026-11-07T13:18:05Z [load_day 2026-03-31] 2026-03-31 hour 8: 156567 events in 4 files, snapshot 7472859363679112304 (task 5537 ms: download 1948 ms overlapping gunzip 344 ms, parse 1066 ms, sort 176 ms, write 2485 ms, index 583 ms: 7 candidates, 85765 repo-hours, 174 releases; waiting 607 ms; commit 1386 ms)
2026-11-07T13:18:06Z [load_day 2026-03-31] 2026-03-31 hour 9: 159778 events in 4 files, snapshot 2632846369893416813 (task 5460 ms: download 1945 ms overlapping gunzip 315 ms, parse 1034 ms, sort 131 ms, write 2475 ms, index 597 ms: 8 candidates, 87941 repo-hours, 187 releases; waiting 604 ms; commit 1268 ms)
2026-11-07T13:18:10Z [load_day 2026-03-31] 2026-03-31 hour 10: 158318 events in 4 files, snapshot 6706782797559347884 (task 5017 ms: download 1756 ms overlapping gunzip 358 ms, parse 1141 ms, sort 156 ms, write 2103 ms, index 632 ms: 5 candidates, 84663 repo-hours, 194 releases; waiting 316 ms; commit 1231 ms)
2026-11-07T13:18:12Z [load_day 2026-03-31] 2026-03-31 hour 11: 157498 events in 4 files, snapshot 6793945288069027181 (task 4717 ms: download 1852 ms overlapping gunzip 306 ms, parse 959 ms, sort 136 ms, write 1852 ms, index 604 ms: 12 candidates, 87623 repo-hours, 125 releases; waiting 553 ms; commit 1494 ms)
2026-11-07T13:18:16Z [load_day 2026-03-31] 2026-03-31 hour 12: 163309 events in 4 files, snapshot 3486137947726705002 (task 4679 ms: download 1659 ms overlapping gunzip 260 ms, parse 879 ms, sort 136 ms, write 1905 ms, index 639 ms: 13 candidates, 94631 repo-hours, 75 releases; waiting 544 ms; commit 1245 ms)
2026-11-07T13:18:17Z [load_day 2026-03-31] 2026-03-31 hour 13: 158521 events in 4 files, snapshot 924749870333763062 (task 4505 ms: download 1646 ms overlapping gunzip 252 ms, parse 913 ms, sort 119 ms, write 1705 ms, index 664 ms: 13 candidates, 98304 repo-hours, 53 releases; waiting 551 ms; commit 1243 ms)
2026-11-07T13:18:21Z [load_day 2026-03-31] 2026-03-31 hour 14: 157390 events in 4 files, snapshot 5008416939303965836 (task 4525 ms: download 1616 ms overlapping gunzip 260 ms, parse 876 ms, sort 128 ms, write 1778 ms, index 627 ms: 12 candidates, 92737 repo-hours, 62 releases; waiting 540 ms; commit 1301 ms)
2026-11-07T13:18:22Z [load_day 2026-03-31] 2026-03-31 hour 15: 154622 events in 4 files, snapshot 436324957334669918 (task 4408 ms: download 1753 ms overlapping gunzip 267 ms, parse 917 ms, sort 111 ms, write 1623 ms, index 579 ms: 11 candidates, 88478 repo-hours, 71 releases; waiting 495 ms; commit 1325 ms)
2026-11-07T13:18:27Z [load_day 2026-03-31] 2026-03-31 hour 16: 157847 events in 4 files, snapshot 3132163550090892351 (task 4734 ms: download 1782 ms overlapping gunzip 267 ms, parse 933 ms, sort 131 ms, write 1863 ms, index 611 ms: 13 candidates, 88630 repo-hours, 48 releases; waiting 600 ms; commit 1494 ms)
2026-11-07T13:18:28Z [load_day 2026-03-31] 2026-03-31 hour 17: 161504 events in 4 files, snapshot 7921272874836294891 (task 4949 ms: download 1732 ms overlapping gunzip 314 ms, parse 1002 ms, sort 124 ms, write 1995 ms, index 645 ms: 6 candidates, 87524 repo-hours, 97 releases; waiting 540 ms; commit 1338 ms)
2026-11-07T13:18:32Z [load_day 2026-03-31] 2026-03-31 hour 18: 159422 events in 4 files, snapshot 3580481426056756896 (task 5221 ms: download 1914 ms overlapping gunzip 326 ms, parse 1039 ms, sort 117 ms, write 2175 ms, index 618 ms: 8 candidates, 88337 repo-hours, 131 releases; waiting 589 ms; commit 1322 ms)
2026-11-07T13:18:34Z [load_day 2026-03-31] 2026-03-31 hour 19: 163507 events in 4 files, snapshot 6752933586201320201 (task 5365 ms: download 2242 ms overlapping gunzip 395 ms, parse 1199 ms, sort 160 ms, write 2020 ms, index 625 ms: 14 candidates, 88506 repo-hours, 168 releases; waiting 625 ms; commit 1246 ms)
2026-11-07T13:18:39Z [load_day 2026-03-31] 2026-03-31 hour 20: 159423 events in 4 files, snapshot 7214705129435734498 (task 5831 ms: download 2042 ms overlapping gunzip 382 ms, parse 1198 ms, sort 129 ms, write 2543 ms, index 543 ms: 7 candidates, 84410 repo-hours, 242 releases; waiting 799 ms; commit 1435 ms)
2026-11-07T13:18:41Z [load_day 2026-03-31] 2026-03-31 hour 21: 157472 events in 4 files, snapshot 7716479516599150777 (task 6012 ms: download 2209 ms overlapping gunzip 431 ms, parse 1330 ms, sort 167 ms, write 2689 ms, index 558 ms: 14 candidates, 82325 repo-hours, 450 releases; waiting 558 ms; commit 1231 ms)
2026-11-07T13:18:46Z [load_day 2026-03-31] 2026-03-31 hour 22: 155462 events in 4 files, snapshot 7458332547315657324 (task 6154 ms: download 2256 ms overlapping gunzip 429 ms, parse 1340 ms, sort 171 ms, write 2789 ms, index 521 ms: 6 candidates, 80546 repo-hours, 643 releases; waiting 604 ms; commit 1383 ms)
2026-11-07T13:18:50Z [load_day 2026-03-31] 2026-03-31 hour 23: 145029 events in 3 files, snapshot 1536207743019902578 (task 6339 ms: download 2794 ms overlapping gunzip 486 ms, parse 1621 ms, sort 168 ms, write 2638 ms, index 470 ms: 8 candidates, 72629 repo-hours, 949 releases; waiting 661 ms; commit 3344 ms)
2026-11-07T13:18:58Z [load_day 2026-03-31] 2026-03-31: repo_hour merged from 24 files to 1 (2050126 rows, 8382 ms)
2026-11-07T13:19:00Z [load_day 2026-03-31] 2026-03-31: index committed in 10304 ms (24 + 1 + 24 files)
2026-11-07T13:19:00Z [load_day 2026-03-31] 2026-03-31: 3785256 events in 24 hours
2026-11-07T13:19:00Z [load_day 2026-03-31] attempt 1 succeeded