orcaLog in

Runs · run 602

load_day 2026-05-01, attempt 1 succeeded

Host
4e84322b8c45:135800
Started
2026-11-07T06:51:23Z
Ended
2026-11-07T06:52:42Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/602/load_day/2026-05-01/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:51:23Z [load_day 2026-05-01] attempt 1 started
2026-11-07T06:51:32Z [load_day 2026-05-01] 2026-05-01 hour 0: 93463 events in 2 files, snapshot 1534718534005870573 (task 4700 ms: download 2098 ms overlapping gunzip 266 ms, parse 899 ms, sort 104 ms, write 2033 ms, index 323 ms: 7 candidates, 47695 repo-hours, 493 releases; waiting 696 ms; commit 1158 ms)
2026-11-07T06:51:33Z [load_day 2026-05-01] 2026-05-01 hour 1: 87052 events in 2 files, snapshot 7014364327230754039 (task 4010 ms: download 1534 ms overlapping gunzip 226 ms, parse 765 ms, sort 93 ms, write 1830 ms, index 318 ms: 8 candidates, 46355 repo-hours, 428 releases; waiting 453 ms; commit 1279 ms)
2026-11-07T06:51:36Z [load_day 2026-05-01] 2026-05-01 hour 2: 92859 events in 2 files, snapshot 7244975903005714668 (task 3482 ms: download 1420 ms overlapping gunzip 197 ms, parse 649 ms, sort 83 ms, write 1351 ms, index 372 ms: 7 candidates, 54382 repo-hours, 316 releases; waiting 548 ms; commit 1203 ms)
2026-11-07T06:51:37Z [load_day 2026-05-01] 2026-05-01 hour 3: 94986 events in 2 files, snapshot 6156535153175222708 (task 2793 ms: download 1092 ms overlapping gunzip 131 ms, parse 529 ms, sort 69 ms, write 973 ms, index 295 ms: 6 candidates, 46059 repo-hours, 127 releases; waiting 506 ms; commit 1093 ms)
2026-11-07T06:51:42Z [load_day 2026-05-01] 2026-05-01 hour 4: 145588 events in 3 files, snapshot 7029643894395398486 (task 5192 ms: download 1915 ms overlapping gunzip 334 ms, parse 1147 ms, sort 118 ms, write 2327 ms, index 446 ms: 10 candidates, 65686 repo-hours, 735 releases; waiting 538 ms; commit 1272 ms)
2026-11-07T06:51:43Z [load_day 2026-05-01] 2026-05-01 hour 5: 148776 events in 3 files, snapshot 3844653701884642214 (task 5470 ms: download 1881 ms overlapping gunzip 359 ms, parse 1206 ms, sort 187 ms, write 2402 ms, index 443 ms: 7 candidates, 68729 repo-hours, 702 releases; waiting 539 ms; commit 1190 ms)
2026-11-07T06:51:48Z [load_day 2026-05-01] 2026-05-01 hour 6: 153461 events in 4 files, snapshot 5323325896220972311 (task 5551 ms: download 2274 ms overlapping gunzip 352 ms, parse 1119 ms, sort 151 ms, write 2590 ms, index 475 ms: 8 candidates, 73802 repo-hours, 726 releases; waiting 596 ms; commit 1323 ms)
2026-11-07T06:51:50Z [load_day 2026-05-01] 2026-05-01 hour 7: 152756 events in 4 files, snapshot 1933128600518721816 (task 5707 ms: download 1644 ms overlapping gunzip 378 ms, parse 1192 ms, sort 214 ms, write 2589 ms, index 482 ms: 7 candidates, 73801 repo-hours, 682 releases; waiting 535 ms; commit 1247 ms)
2026-11-07T06:51:54Z [load_day 2026-05-01] 2026-05-01 hour 8: 152074 events in 4 files, snapshot 227183041927026803 (task 5102 ms: download 1680 ms overlapping gunzip 340 ms, parse 1086 ms, sort 128 ms, write 2197 ms, index 492 ms: 6 candidates, 75344 repo-hours, 546 releases; waiting 549 ms; commit 1324 ms)
2026-11-07T06:51:55Z [load_day 2026-05-01] 2026-05-01 hour 9: 157037 events in 4 files, snapshot 4557977190326096998 (task 4407 ms: download 1684 ms overlapping gunzip 257 ms, parse 870 ms, sort 115 ms, write 1673 ms, index 451 ms: 10 candidates, 69704 repo-hours, 191 releases; waiting 637 ms; commit 1101 ms)
2026-11-07T06:51:59Z [load_day 2026-05-01] 2026-05-01 hour 10: 157558 events in 4 files, snapshot 4550674148268448438 (task 4460 ms: download 1725 ms overlapping gunzip 256 ms, parse 977 ms, sort 110 ms, write 1808 ms, index 495 ms: 8 candidates, 72304 repo-hours, 272 releases; waiting 525 ms; commit 1149 ms)
2026-11-07T06:52:00Z [load_day 2026-05-01] 2026-05-01 hour 11: 160170 events in 4 files, snapshot 6890036882924428042 (task 4187 ms: download 1233 ms overlapping gunzip 267 ms, parse 909 ms, sort 132 ms, write 1847 ms, index 517 ms: 7 candidates, 77382 repo-hours, 288 releases; waiting 248 ms; commit 954 ms)
2026-11-07T06:52:04Z [load_day 2026-05-01] 2026-05-01 hour 12: 153453 events in 4 files, snapshot 4086293727442668934 (task 4801 ms: download 1968 ms overlapping gunzip 303 ms, parse 1003 ms, sort 131 ms, write 2011 ms, index 513 ms: 10 candidates, 78978 repo-hours, 354 releases; waiting 536 ms; commit 1006 ms)
2026-11-07T06:52:05Z [load_day 2026-05-01] 2026-05-01 hour 13: 163959 events in 4 files, snapshot 2510715901795116707 (task 4574 ms: download 1607 ms overlapping gunzip 228 ms, parse 832 ms, sort 114 ms, write 1958 ms, index 572 ms: 9 candidates, 89861 repo-hours, 92 releases; waiting 532 ms; commit 1072 ms)
2026-11-07T06:52:09Z [load_day 2026-05-01] 2026-05-01 hour 14: 155658 events in 4 files, snapshot 1134362605904000691 (task 4071 ms: download 1389 ms overlapping gunzip 230 ms, parse 825 ms, sort 110 ms, write 1648 ms, index 498 ms: 12 candidates, 79883 repo-hours, 110 releases; waiting 504 ms; commit 1211 ms)
2026-11-07T06:52:10Z [load_day 2026-05-01] 2026-05-01 hour 15: 159145 events in 4 files, snapshot 4131354042979854557 (task 4454 ms: download 1366 ms overlapping gunzip 225 ms, parse 849 ms, sort 121 ms, write 1673 ms, index 569 ms: 16 candidates, 79798 repo-hours, 123 releases; waiting 529 ms; commit 1135 ms)
2026-11-07T06:52:14Z [load_day 2026-05-01] 2026-05-01 hour 16: 159314 events in 4 files, snapshot 5583726812633437821 (task 4001 ms: download 1245 ms overlapping gunzip 211 ms, parse 848 ms, sort 121 ms, write 1480 ms, index 493 ms: 11 candidates, 71842 repo-hours, 51 releases; waiting 546 ms; commit 1048 ms)
2026-11-07T06:52:15Z [load_day 2026-05-01] 2026-05-01 hour 17: 164718 events in 4 files, snapshot 3848527481587549780 (task 4277 ms: download 1486 ms overlapping gunzip 252 ms, parse 875 ms, sort 123 ms, write 1627 ms, index 533 ms: 11 candidates, 79732 repo-hours, 131 releases; waiting 545 ms; commit 987 ms)
2026-11-07T06:52:19Z [load_day 2026-05-01] 2026-05-01 hour 18: 155319 events in 4 files, snapshot 4379129281931148999 (task 4416 ms: download 1385 ms overlapping gunzip 260 ms, parse 909 ms, sort 113 ms, write 1779 ms, index 540 ms: 13 candidates, 79046 repo-hours, 168 releases; waiting 541 ms; commit 1211 ms)
2026-11-07T06:52:21Z [load_day 2026-05-01] 2026-05-01 hour 19: 158351 events in 4 files, snapshot 8470396889688249020 (task 4801 ms: download 1781 ms overlapping gunzip 301 ms, parse 1021 ms, sort 109 ms, write 1982 ms, index 543 ms: 9 candidates, 78472 repo-hours, 240 releases; waiting 513 ms; commit 1126 ms)
2026-11-07T06:52:25Z [load_day 2026-05-01] 2026-05-01 hour 20: 156103 events in 4 files, snapshot 2050952742401639841 (task 5172 ms: download 1780 ms overlapping gunzip 346 ms, parse 1130 ms, sort 124 ms, write 2243 ms, index 489 ms: 8 candidates, 73559 repo-hours, 390 releases; waiting 537 ms; commit 1181 ms)
2026-11-07T06:52:27Z [load_day 2026-05-01] 2026-05-01 hour 21: 151106 events in 4 files, snapshot 5168135431807167963 (task 5129 ms: download 1659 ms overlapping gunzip 374 ms, parse 1169 ms, sort 112 ms, write 2166 ms, index 473 ms: 16 candidates, 73627 repo-hours, 511 releases; waiting 524 ms; commit 1235 ms)
2026-11-07T06:52:32Z [load_day 2026-05-01] 2026-05-01 hour 22: 149241 events in 3 files, snapshot 2229277103047642813 (task 6475 ms: download 2302 ms overlapping gunzip 393 ms, parse 1214 ms, sort 130 ms, write 3231 ms, index 531 ms: 2 candidates, 70531 repo-hours, 600 releases; waiting 648 ms; commit 1314 ms)
2026-11-07T06:52:34Z [load_day 2026-05-01] 2026-05-01 hour 23: 146065 events in 3 files, snapshot 7707251052365727106 (task 5891 ms: download 1990 ms overlapping gunzip 368 ms, parse 1225 ms, sort 122 ms, write 2956 ms, index 462 ms: 8 candidates, 66277 repo-hours, 768 releases; waiting 471 ms; commit 1079 ms)
2026-11-07T06:52:40Z [load_day 2026-05-01] 2026-05-01: repo_hour merged from 24 files to 1 (1692849 rows, 6825 ms)
2026-11-07T06:52:42Z [load_day 2026-05-01] 2026-05-01: index committed in 8453 ms (24 + 1 + 24 files)
2026-11-07T06:52:42Z [load_day 2026-05-01] 2026-05-01: 3468212 events in 24 hours
2026-11-07T06:52:42Z [load_day 2026-05-01] attempt 1 succeeded