orcaLog in

Runs · run 657

load_day 2026-04-13, attempt 1 succeeded

Host
4e84322b8c45:160886
Started
2026-11-07T12:55:19Z
Ended
2026-11-07T12:56:50Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/657/load_day/2026-04-13/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T12:55:19Z [load_day 2026-04-13] attempt 1 started
2026-11-07T12:55:30Z [load_day 2026-04-13] 2026-04-13 hour 0: 151397 events in 4 files, snapshot 2438351395901116994 (task 7231 ms: download 2234 ms overlapping gunzip 474 ms, parse 1582 ms, sort 326 ms, write 3551 ms, index 453 ms: 7 candidates, 66945 repo-hours, 857 releases; waiting 513 ms; commit 1351 ms)
2026-11-07T12:55:31Z [load_day 2026-04-13] 2026-04-13 hour 1: 151304 events in 4 files, snapshot 65221062848524731 (task 7585 ms: download 2377 ms overlapping gunzip 469 ms, parse 1664 ms, sort 190 ms, write 3864 ms, index 535 ms: 5 candidates, 79219 repo-hours, 736 releases; waiting 546 ms; commit 1273 ms)
2026-11-07T12:55:37Z [load_day 2026-04-13] 2026-04-13 hour 2: 157846 events in 4 files, snapshot 548619545074768233 (task 6341 ms: download 1770 ms overlapping gunzip 421 ms, parse 1398 ms, sort 168 ms, write 3166 ms, index 582 ms: 3 candidates, 84341 repo-hours, 646 releases; waiting 302 ms; commit 1370 ms)
2026-11-07T12:55:38Z [load_day 2026-04-13] 2026-04-13 hour 3: 154336 events in 4 files, snapshot 3007550851867071371 (task 6032 ms: download 2122 ms overlapping gunzip 378 ms, parse 1243 ms, sort 168 ms, write 2809 ms, index 487 ms: 8 candidates, 72652 repo-hours, 590 releases; waiting 602 ms; commit 1436 ms)
2026-11-07T12:55:44Z [load_day 2026-04-13] 2026-04-13 hour 4: 151868 events in 4 files, snapshot 4094878512806807062 (task 6623 ms: download 2350 ms overlapping gunzip 462 ms, parse 1467 ms, sort 155 ms, write 3133 ms, index 507 ms: 8 candidates, 71925 repo-hours, 747 releases; waiting 569 ms; commit 1308 ms)
2026-11-07T12:55:46Z [load_day 2026-04-13] 2026-04-13 hour 5: 153206 events in 4 files, snapshot 8241025530496131430 (task 6873 ms: download 3004 ms overlapping gunzip 441 ms, parse 1441 ms, sort 149 ms, write 3322 ms, index 510 ms: 9 candidates, 74598 repo-hours, 693 releases; waiting 658 ms; commit 1208 ms)
2026-11-07T12:55:51Z [load_day 2026-04-13] 2026-04-13 hour 6: 155478 events in 4 files, snapshot 7191617221779879025 (task 6482 ms: download 2052 ms overlapping gunzip 413 ms, parse 1363 ms, sort 143 ms, write 3131 ms, index 536 ms: 6 candidates, 78144 repo-hours, 524 releases; waiting 593 ms; commit 1287 ms)
2026-11-07T12:55:53Z [load_day 2026-04-13] 2026-04-13 hour 7: 157066 events in 4 files, snapshot 7164360533039131983 (task 6400 ms: download 2058 ms overlapping gunzip 404 ms, parse 1360 ms, sort 198 ms, write 2974 ms, index 561 ms: 9 candidates, 81827 repo-hours, 490 releases; waiting 551 ms; commit 1240 ms)
2026-11-07T12:55:57Z [load_day 2026-04-13] 2026-04-13 hour 8: 155743 events in 4 files, snapshot 6497388731902219329 (task 5338 ms: download 1753 ms overlapping gunzip 352 ms, parse 1212 ms, sort 140 ms, write 2341 ms, index 594 ms: 14 candidates, 79586 repo-hours, 347 releases; waiting 385 ms; commit 1084 ms)
2026-11-07T12:55:59Z [load_day 2026-04-13] 2026-04-13 hour 9: 155874 events in 4 files, snapshot 9041978151798077119 (task 5778 ms: download 2146 ms overlapping gunzip 393 ms, parse 1210 ms, sort 154 ms, write 2370 ms, index 621 ms: 13 candidates, 83245 repo-hours, 398 releases; waiting 581 ms; commit 1217 ms)
2026-11-07T12:56:04Z [load_day 2026-04-13] 2026-04-13 hour 10: 158130 events in 4 files, snapshot 8767541816192077324 (task 5665 ms: download 1743 ms overlapping gunzip 363 ms, parse 1277 ms, sort 206 ms, write 2417 ms, index 640 ms: 7 candidates, 81642 repo-hours, 337 releases; waiting 530 ms; commit 1316 ms)
2026-11-07T12:56:06Z [load_day 2026-04-13] 2026-04-13 hour 11: 156838 events in 4 files, snapshot 609853439742332627 (task 5758 ms: download 2145 ms overlapping gunzip 362 ms, parse 1218 ms, sort 139 ms, write 2421 ms, index 690 ms: 6 candidates, 84283 repo-hours, 390 releases; waiting 606 ms; commit 1312 ms)
2026-11-07T12:56:09Z [load_day 2026-04-13] 2026-04-13 hour 12: 156706 events in 4 files, snapshot 4878117807002477711 (task 5119 ms: download 1678 ms overlapping gunzip 313 ms, parse 1082 ms, sort 153 ms, write 2101 ms, index 615 ms: 8 candidates, 87889 repo-hours, 271 releases; waiting 547 ms; commit 1296 ms)
2026-11-07T12:56:11Z [load_day 2026-04-13] 2026-04-13 hour 13: 160726 events in 4 files, snapshot 194604320632751571 (task 4824 ms: download 1461 ms overlapping gunzip 279 ms, parse 1019 ms, sort 120 ms, write 2116 ms, index 691 ms: 11 candidates, 97103 repo-hours, 166 releases; waiting 290 ms; commit 1221 ms)
2026-11-07T12:56:15Z [load_day 2026-04-13] 2026-04-13 hour 14: 161904 events in 4 files, snapshot 7102664159021138617 (task 4620 ms: download 1413 ms overlapping gunzip 256 ms, parse 909 ms, sort 135 ms, write 1901 ms, index 608 ms: 9 candidates, 90837 repo-hours, 95 releases; waiting 545 ms; commit 1257 ms)
2026-11-07T12:56:17Z [load_day 2026-04-13] 2026-04-13 hour 15: 161247 events in 4 files, snapshot 6510344487300628285 (task 4360 ms: download 1322 ms overlapping gunzip 243 ms, parse 839 ms, sort 110 ms, write 1935 ms, index 624 ms: 15 candidates, 90549 repo-hours, 120 releases; waiting 317 ms; commit 1365 ms)
2026-11-07T12:56:20Z [load_day 2026-04-13] 2026-04-13 hour 16: 162395 events in 4 files, snapshot 1021630722603281002 (task 4494 ms: download 1610 ms overlapping gunzip 223 ms, parse 819 ms, sort 118 ms, write 1758 ms, index 725 ms: 12 candidates, 91966 repo-hours, 81 releases; waiting 533 ms; commit 1300 ms)
2026-11-07T12:56:21Z [load_day 2026-04-13] 2026-04-13 hour 17: 160461 events in 4 files, snapshot 8533439784540798299 (task 4265 ms: download 1452 ms overlapping gunzip 245 ms, parse 834 ms, sort 110 ms, write 1596 ms, index 662 ms: 15 candidates, 90876 repo-hours, 78 releases; waiting 539 ms; commit 1164 ms)
2026-11-07T12:56:25Z [load_day 2026-04-13] 2026-04-13 hour 18: 158211 events in 4 files, snapshot 2499560020070648983 (task 4452 ms: download 1991 ms overlapping gunzip 248 ms, parse 880 ms, sort 114 ms, write 1783 ms, index 672 ms: 10 candidates, 86179 repo-hours, 100 releases; waiting 485 ms; commit 1259 ms)
2026-11-07T12:56:27Z [load_day 2026-04-13] 2026-04-13 hour 19: 158720 events in 4 files, snapshot 6267640922647433313 (task 4587 ms: download 1465 ms overlapping gunzip 251 ms, parse 851 ms, sort 115 ms, write 1717 ms, index 594 ms: 8 candidates, 87417 repo-hours, 108 releases; waiting 514 ms; commit 1301 ms)
2026-11-07T12:56:30Z [load_day 2026-04-13] 2026-04-13 hour 20: 163957 events in 4 files, snapshot 5117742923486722647 (task 4508 ms: download 1474 ms overlapping gunzip 251 ms, parse 937 ms, sort 130 ms, write 1745 ms, index 575 ms: 6 candidates, 80404 repo-hours, 137 releases; waiting 556 ms; commit 1329 ms)
2026-11-07T12:56:33Z [load_day 2026-04-13] 2026-04-13 hour 21: 152776 events in 4 files, snapshot 5681693371109509805 (task 5645 ms: download 2832 ms overlapping gunzip 312 ms, parse 1062 ms, sort 153 ms, write 2320 ms, index 583 ms: 5 candidates, 78851 repo-hours, 357 releases; waiting 906 ms; commit 1306 ms)
2026-11-07T12:56:37Z [load_day 2026-04-13] 2026-04-13 hour 22: 152677 events in 4 files, snapshot 4347249987709401501 (task 5726 ms: download 2099 ms overlapping gunzip 403 ms, parse 1351 ms, sort 161 ms, write 2538 ms, index 547 ms: 7 candidates, 78148 repo-hours, 550 releases; waiting 361 ms; commit 1242 ms)
2026-11-07T12:56:40Z [load_day 2026-04-13] 2026-04-13 hour 23: 150111 events in 4 files, snapshot 1429063055815327269 (task 5795 ms: download 2158 ms overlapping gunzip 407 ms, parse 1398 ms, sort 179 ms, write 2483 ms, index 503 ms: 6 candidates, 75025 repo-hours, 638 releases; waiting 524 ms; commit 1245 ms)
2026-11-07T12:56:48Z [load_day 2026-04-13] 2026-04-13: repo_hour merged from 24 files to 1 (1973651 rows, 8325 ms)
2026-11-07T12:56:50Z [load_day 2026-04-13] 2026-04-13: index committed in 10420 ms (24 + 1 + 24 files)
2026-11-07T12:56:50Z [load_day 2026-04-13] 2026-04-13: 3758977 events in 24 hours
2026-11-07T12:56:50Z [load_day 2026-04-13] attempt 1 succeeded