orcaLog in

Runs · run 515

load_day 2026-05-30, attempt 1 succeeded

Host
4e84322b8c45:112534
Started
2026-11-07T06:08:56Z
Ended
2026-11-07T06:10:15Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/515/load_day/2026-05-30/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:08:56Z [load_day 2026-05-30] attempt 1 started
2026-11-07T06:09:04Z [load_day 2026-05-30] 2026-05-30 hour 0: 149560 events in 3 files, snapshot 2898703525398714980 (task 5541 ms: download 1910 ms overlapping gunzip 333 ms, parse 1142 ms, sort 159 ms, write 2691 ms, index 396 ms: 4 candidates, 64464 repo-hours, 679 releases; waiting 489 ms; commit 960 ms)
2026-11-07T06:09:05Z [load_day 2026-05-30] 2026-05-30 hour 1: 150970 events in 4 files, snapshot 3397396685756204592 (task 5538 ms: download 1852 ms overlapping gunzip 318 ms, parse 1109 ms, sort 164 ms, write 2525 ms, index 472 ms: 6 candidates, 70825 repo-hours, 523 releases; waiting 579 ms; commit 928 ms)
2026-11-07T06:09:10Z [load_day 2026-05-30] 2026-05-30 hour 2: 156823 events in 4 files, snapshot 7828916796388169550 (task 4870 ms: download 1909 ms overlapping gunzip 279 ms, parse 982 ms, sort 132 ms, write 2135 ms, index 503 ms: 6 candidates, 81191 repo-hours, 307 releases; waiting 531 ms; commit 1127 ms)
2026-11-07T06:09:11Z [load_day 2026-05-30] 2026-05-30 hour 3: 157392 events in 4 files, snapshot 5643623958949817751 (task 4948 ms: download 1515 ms overlapping gunzip 309 ms, parse 1065 ms, sort 129 ms, write 2199 ms, index 492 ms: 3 candidates, 77271 repo-hours, 402 releases; waiting 544 ms; commit 995 ms)
2026-11-07T06:09:16Z [load_day 2026-05-30] 2026-05-30 hour 4: 148330 events in 3 files, snapshot 1228635351367967550 (task 4917 ms: download 1607 ms overlapping gunzip 330 ms, parse 1130 ms, sort 113 ms, write 2001 ms, index 509 ms: 7 candidates, 68697 repo-hours, 526 releases; waiting 524 ms; commit 1091 ms)
2026-11-07T06:09:17Z [load_day 2026-05-30] 2026-05-30 hour 5: 147311 events in 3 files, snapshot 2384370943499103169 (task 5474 ms: download 2468 ms overlapping gunzip 417 ms, parse 1291 ms, sort 140 ms, write 2177 ms, index 491 ms: 6 candidates, 65723 repo-hours, 704 releases; waiting 634 ms; commit 1007 ms)
2026-11-07T06:09:21Z [load_day 2026-05-30] 2026-05-30 hour 6: 153503 events in 4 files, snapshot 6922317687321109385 (task 4710 ms: download 1078 ms overlapping gunzip 353 ms, parse 1130 ms, sort 136 ms, write 2102 ms, index 535 ms: 6 candidates, 71729 repo-hours, 645 releases; waiting 203 ms; commit 1016 ms)
2026-11-07T06:09:22Z [load_day 2026-05-30] 2026-05-30 hour 7: 156151 events in 4 files, snapshot 1184861553741596875 (task 4437 ms: download 1440 ms overlapping gunzip 280 ms, parse 942 ms, sort 110 ms, write 1790 ms, index 466 ms: 9 candidates, 72489 repo-hours, 340 releases; waiting 569 ms; commit 944 ms)
2026-11-07T06:09:26Z [load_day 2026-05-30] 2026-05-30 hour 8: 158191 events in 4 files, snapshot 2872755146972803237 (task 4655 ms: download 1640 ms overlapping gunzip 291 ms, parse 991 ms, sort 142 ms, write 1841 ms, index 565 ms: 12 candidates, 78612 repo-hours, 357 releases; waiting 522 ms; commit 1003 ms)
2026-11-07T06:09:29Z [load_day 2026-05-30] 2026-05-30 hour 9: 154811 events in 4 files, snapshot 4779367481054008408 (task 5231 ms: download 2933 ms overlapping gunzip 297 ms, parse 1020 ms, sort 136 ms, write 2149 ms, index 553 ms: 12 candidates, 76776 repo-hours, 496 releases; waiting 686 ms; commit 1357 ms)
2026-11-07T06:09:31Z [load_day 2026-05-30] 2026-05-30 hour 10: 158752 events in 4 files, snapshot 1507459460849928355 (task 4778 ms: download 1971 ms overlapping gunzip 284 ms, parse 981 ms, sort 116 ms, write 1965 ms, index 566 ms: 9 candidates, 76822 repo-hours, 488 releases; waiting 531 ms; commit 960 ms)
2026-11-07T06:09:34Z [load_day 2026-05-30] 2026-05-30 hour 11: 160827 events in 4 files, snapshot 75734703623422815 (task 4951 ms: download 1770 ms overlapping gunzip 285 ms, parse 954 ms, sort 110 ms, write 1935 ms, index 514 ms: 5 candidates, 78619 repo-hours, 248 releases; waiting 834 ms; commit 991 ms)
2026-11-07T06:09:36Z [load_day 2026-05-30] 2026-05-30 hour 12: 160090 events in 4 files, snapshot 3152600019791517049 (task 3940 ms: download 1418 ms overlapping gunzip 218 ms, parse 787 ms, sort 102 ms, write 1476 ms, index 490 ms: 5 candidates, 74758 repo-hours, 131 releases; waiting 547 ms; commit 1031 ms)
2026-11-07T06:09:39Z [load_day 2026-05-30] 2026-05-30 hour 13: 167329 events in 4 files, snapshot 8670844135635268398 (task 4130 ms: download 1408 ms overlapping gunzip 203 ms, parse 790 ms, sort 103 ms, write 1596 ms, index 587 ms: 9 candidates, 90970 repo-hours, 40 releases; waiting 542 ms; commit 1081 ms)
2026-11-07T06:09:41Z [load_day 2026-05-30] 2026-05-30 hour 14: 162012 events in 4 files, snapshot 3005178854765792359 (task 3962 ms: download 1585 ms overlapping gunzip 210 ms, parse 771 ms, sort 101 ms, write 1555 ms, index 509 ms: 5 candidates, 79642 repo-hours, 75 releases; waiting 529 ms; commit 989 ms)
2026-11-07T06:09:44Z [load_day 2026-05-30] 2026-05-30 hour 15: 159378 events in 4 files, snapshot 1645341099971135805 (task 4097 ms: download 1301 ms overlapping gunzip 220 ms, parse 833 ms, sort 104 ms, write 1538 ms, index 564 ms: 5 candidates, 78318 repo-hours, 108 releases; waiting 535 ms; commit 994 ms)
2026-11-07T06:09:45Z [load_day 2026-05-30] 2026-05-30 hour 16: 161528 events in 4 files, snapshot 54179478936951973 (task 4166 ms: download 1452 ms overlapping gunzip 230 ms, parse 813 ms, sort 103 ms, write 1620 ms, index 527 ms: 8 candidates, 80005 repo-hours, 125 releases; waiting 530 ms; commit 1114 ms)
2026-11-07T06:09:49Z [load_day 2026-05-30] 2026-05-30 hour 17: 160737 events in 4 files, snapshot 8672418591465049181 (task 4304 ms: download 1685 ms overlapping gunzip 237 ms, parse 902 ms, sort 134 ms, write 1602 ms, index 532 ms: 5 candidates, 77996 repo-hours, 146 releases; waiting 586 ms; commit 1210 ms)
2026-11-07T06:09:50Z [load_day 2026-05-30] 2026-05-30 hour 18: 156082 events in 4 files, snapshot 5656850200381647948 (task 4260 ms: download 1638 ms overlapping gunzip 249 ms, parse 869 ms, sort 121 ms, write 1696 ms, index 470 ms: 9 candidates, 71703 repo-hours, 240 releases; waiting 571 ms; commit 889 ms)
2026-11-07T06:09:54Z [load_day 2026-05-30] 2026-05-30 hour 19: 162721 events in 4 files, snapshot 3946905807950012465 (task 4647 ms: download 1390 ms overlapping gunzip 293 ms, parse 944 ms, sort 127 ms, write 1913 ms, index 528 ms: 8 candidates, 76954 repo-hours, 233 releases; waiting 522 ms; commit 1058 ms)
2026-11-07T06:09:56Z [load_day 2026-05-30] 2026-05-30 hour 20: 157311 events in 4 files, snapshot 1148112875379192830 (task 4524 ms: download 1192 ms overlapping gunzip 310 ms, parse 1040 ms, sort 112 ms, write 1980 ms, index 481 ms: 7 candidates, 74517 repo-hours, 367 releases; waiting 273 ms; commit 1148 ms)
2026-11-07T06:10:00Z [load_day 2026-05-30] 2026-05-30 hour 21: 155326 events in 4 files, snapshot 6193720479857227406 (task 5025 ms: download 1724 ms overlapping gunzip 337 ms, parse 1099 ms, sort 121 ms, write 2204 ms, index 493 ms: 5 candidates, 70637 repo-hours, 529 releases; waiting 538 ms; commit 1179 ms)
2026-11-07T06:10:01Z [load_day 2026-05-30] 2026-05-30 hour 22: 147611 events in 3 files, snapshot 3768963158191209601 (task 5086 ms: download 1804 ms overlapping gunzip 366 ms, parse 1176 ms, sort 137 ms, write 2066 ms, index 448 ms: 6 candidates, 67140 repo-hours, 707 releases; waiting 545 ms; commit 1050 ms)
2026-11-07T06:10:06Z [load_day 2026-05-30] 2026-05-30 hour 23: 151494 events in 4 files, snapshot 7763411790832470544 (task 5152 ms: download 1754 ms overlapping gunzip 344 ms, parse 1164 ms, sort 156 ms, write 2209 ms, index 420 ms: 6 candidates, 66125 repo-hours, 714 releases; waiting 550 ms; commit 1084 ms)
2026-11-07T06:10:13Z [load_day 2026-05-30] 2026-05-30: repo_hour merged from 24 files to 1 (1791983 rows, 7022 ms)
2026-11-07T06:10:15Z [load_day 2026-05-30] 2026-05-30: index committed in 8784 ms (24 + 1 + 24 files)
2026-11-07T06:10:15Z [load_day 2026-05-30] 2026-05-30: 3754240 events in 24 hours
2026-11-07T06:10:15Z [load_day 2026-05-30] attempt 1 succeeded