orcaLog in

Runs · run 512

load_day 2026-05-31, attempt 1 succeeded

Host
4e84322b8c45:111673
Started
2026-11-07T06:07:38Z
Ended
2026-11-07T06:08:55Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/512/load_day/2026-05-31/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:07:38Z [load_day 2026-05-31] attempt 1 started
2026-11-07T06:07:47Z [load_day 2026-05-31] 2026-05-31 hour 0: 147332 events in 3 files, snapshot 2927177851035098361 (task 5751 ms: download 1817 ms overlapping gunzip 387 ms, parse 1368 ms, sort 252 ms, write 2516 ms, index 386 ms: 6 candidates, 61237 repo-hours, 943 releases; waiting 520 ms; commit 1244 ms)
2026-11-07T06:07:48Z [load_day 2026-05-31] 2026-05-31 hour 1: 146927 events in 3 files, snapshot 1323441933453371089 (task 5646 ms: download 1663 ms overlapping gunzip 363 ms, parse 1205 ms, sort 136 ms, write 2875 ms, index 384 ms: 13 candidates, 62603 repo-hours, 741 releases; waiting 333 ms; commit 1114 ms)
2026-11-07T06:07:52Z [load_day 2026-05-31] 2026-05-31 hour 2: 158868 events in 4 files, snapshot 1426352213553894401 (task 4642 ms: download 1401 ms overlapping gunzip 290 ms, parse 991 ms, sort 111 ms, write 1994 ms, index 503 ms: 5 candidates, 80015 repo-hours, 436 releases; waiting 524 ms; commit 1067 ms)
2026-11-07T06:07:54Z [load_day 2026-05-31] 2026-05-31 hour 3: 155514 events in 4 files, snapshot 8712955328006677756 (task 4948 ms: download 1741 ms overlapping gunzip 353 ms, parse 1171 ms, sort 127 ms, write 2023 ms, index 455 ms: 6 candidates, 74396 repo-hours, 609 releases; waiting 548 ms; commit 1064 ms)
2026-11-07T06:07:58Z [load_day 2026-05-31] 2026-05-31 hour 4: 159004 events in 4 files, snapshot 97069866381263930 (task 4786 ms: download 1800 ms overlapping gunzip 298 ms, parse 1100 ms, sort 124 ms, write 1950 ms, index 498 ms: 2 candidates, 76835 repo-hours, 473 releases; waiting 519 ms; commit 1012 ms)
2026-11-07T06:08:00Z [load_day 2026-05-31] 2026-05-31 hour 5: 151036 events in 4 files, snapshot 4772104966686434890 (task 5048 ms: download 1622 ms overlapping gunzip 364 ms, parse 1189 ms, sort 144 ms, write 2072 ms, index 450 ms: 9 candidates, 64334 repo-hours, 605 releases; waiting 518 ms; commit 1148 ms)
2026-11-07T06:08:04Z [load_day 2026-05-31] 2026-05-31 hour 6: 154103 events in 4 files, snapshot 4761507893712449010 (task 5217 ms: download 1831 ms overlapping gunzip 354 ms, parse 1220 ms, sort 151 ms, write 2200 ms, index 447 ms: 2 candidates, 68019 repo-hours, 643 releases; waiting 535 ms; commit 1131 ms)
2026-11-07T06:08:05Z [load_day 2026-05-31] 2026-05-31 hour 7: 156999 events in 4 files, snapshot 3224726654935933405 (task 4918 ms: download 1699 ms overlapping gunzip 367 ms, parse 1163 ms, sort 126 ms, write 1969 ms, index 435 ms: 1 candidates, 68114 repo-hours, 463 releases; waiting 538 ms; commit 1098 ms)
2026-11-07T06:08:08Z [load_day 2026-05-31] 2026-05-31 hour 8: 159281 events in 4 files, snapshot 9085577984968199964 (task 4223 ms: download 1378 ms overlapping gunzip 259 ms, parse 897 ms, sort 114 ms, write 1718 ms, index 487 ms: 6 candidates, 74363 repo-hours, 188 releases; waiting 533 ms; commit 923 ms)
2026-11-07T06:08:10Z [load_day 2026-05-31] 2026-05-31 hour 9: 158889 events in 4 files, snapshot 2569749770478411267 (task 4331 ms: download 1649 ms overlapping gunzip 247 ms, parse 850 ms, sort 113 ms, write 1729 ms, index 467 ms: 10 candidates, 73623 repo-hours, 239 releases; waiting 590 ms; commit 993 ms)
2026-11-07T06:08:13Z [load_day 2026-05-31] 2026-05-31 hour 10: 158786 events in 4 files, snapshot 1458989169420113794 (task 4066 ms: download 1411 ms overlapping gunzip 245 ms, parse 830 ms, sort 109 ms, write 1642 ms, index 485 ms: 7 candidates, 73402 repo-hours, 203 releases; waiting 419 ms; commit 955 ms)
2026-11-07T06:08:15Z [load_day 2026-05-31] 2026-05-31 hour 11: 163068 events in 4 files, snapshot 8671213360804323399 (task 4386 ms: download 1509 ms overlapping gunzip 237 ms, parse 834 ms, sort 160 ms, write 1635 ms, index 588 ms: 4 candidates, 76370 repo-hours, 167 releases; waiting 667 ms; commit 1066 ms)
2026-11-07T06:08:18Z [load_day 2026-05-31] 2026-05-31 hour 12: 166790 events in 4 files, snapshot 7387217522579649911 (task 4231 ms: download 1478 ms overlapping gunzip 234 ms, parse 844 ms, sort 115 ms, write 1670 ms, index 540 ms: 4 candidates, 77800 repo-hours, 174 releases; waiting 522 ms; commit 1043 ms)
2026-11-07T06:08:21Z [load_day 2026-05-31] 2026-05-31 hour 13: 162521 events in 4 files, snapshot 7211321358038447564 (task 4011 ms: download 1281 ms overlapping gunzip 202 ms, parse 757 ms, sort 102 ms, write 1501 ms, index 616 ms: 8 candidates, 89776 repo-hours, 69 releases; waiting 535 ms; commit 1738 ms)
2026-11-07T06:08:23Z [load_day 2026-05-31] 2026-05-31 hour 14: 162811 events in 4 files, snapshot 8008110183508870791 (task 4155 ms: download 1161 ms overlapping gunzip 229 ms, parse 829 ms, sort 132 ms, write 1583 ms, index 561 ms: 10 candidates, 79098 repo-hours, 50 releases; waiting 531 ms; commit 994 ms)
2026-11-07T06:08:25Z [load_day 2026-05-31] 2026-05-31 hour 15: 162394 events in 4 files, snapshot 8470932868818076012 (task 4013 ms: download 1380 ms overlapping gunzip 225 ms, parse 812 ms, sort 104 ms, write 1498 ms, index 542 ms: 7 candidates, 82342 repo-hours, 74 releases; waiting 520 ms; commit 1335 ms)
2026-11-07T06:08:28Z [load_day 2026-05-31] 2026-05-31 hour 16: 163138 events in 4 files, snapshot 7758610936057055184 (task 4112 ms: download 1228 ms overlapping gunzip 216 ms, parse 800 ms, sort 131 ms, write 1585 ms, index 558 ms: 9 candidates, 78153 repo-hours, 56 releases; waiting 510 ms; commit 928 ms)
2026-11-07T06:08:29Z [load_day 2026-05-31] 2026-05-31 hour 17: 160487 events in 4 files, snapshot 4265295482631178366 (task 4041 ms: download 1559 ms overlapping gunzip 223 ms, parse 826 ms, sort 110 ms, write 1488 ms, index 504 ms: 2 candidates, 78889 repo-hours, 89 releases; waiting 521 ms; commit 895 ms)
2026-11-07T06:08:32Z [load_day 2026-05-31] 2026-05-31 hour 18: 160715 events in 4 files, snapshot 5596021858342187386 (task 4107 ms: download 1291 ms overlapping gunzip 227 ms, parse 816 ms, sort 109 ms, write 1662 ms, index 525 ms: 4 candidates, 76989 repo-hours, 154 releases; waiting 526 ms; commit 974 ms)
2026-11-07T06:08:34Z [load_day 2026-05-31] 2026-05-31 hour 19: 159735 events in 4 files, snapshot 4829926605460393234 (task 4248 ms: download 1875 ms overlapping gunzip 245 ms, parse 868 ms, sort 138 ms, write 1633 ms, index 504 ms: 7 candidates, 77511 repo-hours, 169 releases; waiting 525 ms; commit 1046 ms)
2026-11-07T06:08:37Z [load_day 2026-05-31] 2026-05-31 hour 20: 155052 events in 4 files, snapshot 3571820218981674190 (task 4546 ms: download 2315 ms overlapping gunzip 263 ms, parse 940 ms, sort 132 ms, write 1750 ms, index 525 ms: 7 candidates, 69481 repo-hours, 259 releases; waiting 576 ms; commit 911 ms)
2026-11-07T06:08:40Z [load_day 2026-05-31] 2026-05-31 hour 21: 157669 events in 4 files, snapshot 252650594982919283 (task 4858 ms: download 1848 ms overlapping gunzip 283 ms, parse 995 ms, sort 114 ms, write 1993 ms, index 501 ms: 8 candidates, 72529 repo-hours, 397 releases; waiting 539 ms; commit 996 ms)
2026-11-07T06:08:43Z [load_day 2026-05-31] 2026-05-31 hour 22: 162291 events in 4 files, snapshot 8189795515293190677 (task 4766 ms: download 1541 ms overlapping gunzip 300 ms, parse 1018 ms, sort 136 ms, write 2010 ms, index 455 ms: 4 candidates, 68821 repo-hours, 381 releases; waiting 504 ms; commit 1074 ms)
2026-11-07T06:08:46Z [load_day 2026-05-31] 2026-05-31 hour 23: 152899 events in 4 files, snapshot 3852795180020415222 (task 4887 ms: download 1494 ms overlapping gunzip 347 ms, parse 1184 ms, sort 138 ms, write 2044 ms, index 423 ms: 3 candidates, 66132 repo-hours, 658 releases; waiting 416 ms; commit 1148 ms)
2026-11-07T06:08:53Z [load_day 2026-05-31] 2026-05-31: repo_hour merged from 24 files to 1 (1770832 rows, 7154 ms)
2026-11-07T06:08:55Z [load_day 2026-05-31] 2026-05-31: index committed in 9386 ms (24 + 1 + 24 files)
2026-11-07T06:08:55Z [load_day 2026-05-31] 2026-05-31: 3796309 events in 24 hours
2026-11-07T06:08:55Z [load_day 2026-05-31] attempt 1 succeeded