orcaLog in

Runs · run 690

load_day 2026-04-02, attempt 1 succeeded

Host
4e84322b8c45:170223
Started
2026-11-07T13:13:57Z
Ended
2026-11-07T13:15:44Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/690/load_day/2026-04-02/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T13:13:57Z [load_day 2026-04-02] attempt 1 started
2026-11-07T13:14:07Z [load_day 2026-04-02] 2026-04-02 hour 0: 149041 events in 3 files, snapshot 2064851244561224681 (task 6331 ms: download 2198 ms overlapping gunzip 443 ms, parse 1457 ms, sort 187 ms, write 2909 ms, index 485 ms: 9 candidates, 70790 repo-hours, 785 releases; waiting 501 ms; commit 1089 ms)
2026-11-07T13:14:08Z [load_day 2026-04-02] 2026-04-02 hour 1: 160373 events in 4 files, snapshot 934078475420371960 (task 6212 ms: download 2236 ms overlapping gunzip 339 ms, parse 1180 ms, sort 160 ms, write 2726 ms, index 589 ms: 11 candidates, 90807 repo-hours, 404 releases; waiting 861 ms; commit 1372 ms)
2026-11-07T13:14:14Z [load_day 2026-04-02] 2026-04-02 hour 2: 162859 events in 4 files, snapshot 3080127165528507894 (task 6316 ms: download 1912 ms overlapping gunzip 396 ms, parse 1265 ms, sort 166 ms, write 3049 ms, index 589 ms: 13 candidates, 92920 repo-hours, 344 releases; waiting 542 ms; commit 1123 ms)
2026-11-07T13:14:19Z [load_day 2026-04-02] 2026-04-02 hour 3: 161974 events in 4 files, snapshot 3703322051652491680 (task 9736 ms: download 2588 ms overlapping gunzip 699 ms, parse 2219 ms, sort 181 ms, write 5237 ms, index 559 ms: 10 candidates, 75283 repo-hours, 512 releases; waiting 562 ms; commit 1323 ms)
2026-11-07T13:14:25Z [load_day 2026-04-02] 2026-04-02 hour 4: 156505 events in 4 files, snapshot 1699670849876538513 (task 10664 ms: download 3037 ms overlapping gunzip 787 ms, parse 2335 ms, sort 215 ms, write 5820 ms, index 506 ms: 14 candidates, 68322 repo-hours, 525 releases; waiting 602 ms; commit 1227 ms)
2026-11-07T13:14:27Z [load_day 2026-04-02] 2026-04-02 hour 5: 159873 events in 4 files, snapshot 1376564574563504878 (task 7815 ms: download 2692 ms overlapping gunzip 592 ms, parse 1853 ms, sort 192 ms, write 3709 ms, index 523 ms: 8 candidates, 78219 repo-hours, 433 releases; waiting 625 ms; commit 1253 ms)
2026-11-07T13:14:34Z [load_day 2026-04-02] 2026-04-02 hour 6: 157864 events in 4 files, snapshot 5309133038479352107 (task 7595 ms: download 2546 ms overlapping gunzip 603 ms, parse 1847 ms, sort 196 ms, write 3458 ms, index 543 ms: 11 candidates, 79238 repo-hours, 379 releases; waiting 633 ms; commit 1241 ms)
2026-11-07T13:14:35Z [load_day 2026-04-02] 2026-04-02 hour 7: 156253 events in 4 files, snapshot 4675582351041125666 (task 5991 ms: download 1937 ms overlapping gunzip 465 ms, parse 1292 ms, sort 162 ms, write 2955 ms, index 567 ms: 10 candidates, 82985 repo-hours, 375 releases; waiting 192 ms; commit 1210 ms)
2026-11-07T13:14:41Z [load_day 2026-04-02] 2026-04-02 hour 8: 156927 events in 4 files, snapshot 3068925428732383546 (task 6728 ms: download 1927 ms overlapping gunzip 479 ms, parse 1445 ms, sort 174 ms, write 3415 ms, index 607 ms: 15 candidates, 83684 repo-hours, 430 releases; waiting 263 ms; commit 1190 ms)
2026-11-07T13:14:42Z [load_day 2026-04-02] 2026-04-02 hour 9: 155978 events in 4 files, snapshot 2098702883640576118 (task 6371 ms: download 2198 ms overlapping gunzip 422 ms, parse 1322 ms, sort 165 ms, write 3003 ms, index 591 ms: 11 candidates, 83255 repo-hours, 476 releases; waiting 593 ms; commit 1294 ms)
2026-11-07T13:14:48Z [load_day 2026-04-02] 2026-04-02 hour 10: 153942 events in 4 files, snapshot 671269545793325329 (task 6365 ms: download 2154 ms overlapping gunzip 432 ms, parse 1459 ms, sort 200 ms, write 2834 ms, index 554 ms: 7 candidates, 81302 repo-hours, 525 releases; waiting 586 ms; commit 1265 ms)
2026-11-07T13:14:49Z [load_day 2026-04-02] 2026-04-02 hour 11: 154354 events in 4 files, snapshot 5979601995731102414 (task 6189 ms: download 1894 ms overlapping gunzip 409 ms, parse 1333 ms, sort 184 ms, write 3035 ms, index 527 ms: 7 candidates, 80678 repo-hours, 529 releases; waiting 360 ms; commit 1320 ms)
2026-11-07T13:14:55Z [load_day 2026-04-02] 2026-04-02 hour 12: 155152 events in 4 files, snapshot 4690242421620710420 (task 5998 ms: download 1812 ms overlapping gunzip 351 ms, parse 1161 ms, sort 150 ms, write 2871 ms, index 603 ms: 9 candidates, 88490 repo-hours, 448 releases; waiting 557 ms; commit 1173 ms)
2026-11-07T13:14:56Z [load_day 2026-04-02] 2026-04-02 hour 13: 153482 events in 4 files, snapshot 3711102372161440822 (task 5588 ms: download 1845 ms overlapping gunzip 309 ms, parse 1058 ms, sort 129 ms, write 2573 ms, index 642 ms: 12 candidates, 94140 repo-hours, 390 releases; waiting 539 ms; commit 1150 ms)
2026-11-07T13:15:01Z [load_day 2026-04-02] 2026-04-02 hour 14: 153261 events in 4 files, snapshot 7876861829873905950 (task 5766 ms: download 1698 ms overlapping gunzip 327 ms, parse 1066 ms, sort 159 ms, write 2708 ms, index 728 ms: 8 candidates, 88582 repo-hours, 469 releases; waiting 555 ms; commit 1415 ms)
2026-11-07T13:15:03Z [load_day 2026-04-02] 2026-04-02 hour 15: 152885 events in 4 files, snapshot 5379927238305241687 (task 5767 ms: download 1912 ms overlapping gunzip 354 ms, parse 1118 ms, sort 154 ms, write 2719 ms, index 639 ms: 8 candidates, 85929 repo-hours, 374 releases; waiting 551 ms; commit 1296 ms)
2026-11-07T13:15:08Z [load_day 2026-04-02] 2026-04-02 hour 16: 157988 events in 4 files, snapshot 6145702019352474573 (task 5916 ms: download 1672 ms overlapping gunzip 402 ms, parse 1378 ms, sort 208 ms, write 2709 ms, index 588 ms: 8 candidates, 87105 repo-hours, 575 releases; waiting 276 ms; commit 1497 ms)
2026-11-07T13:15:10Z [load_day 2026-04-02] 2026-04-02 hour 17: 155795 events in 4 files, snapshot 4212459938802735943 (task 6043 ms: download 1949 ms overlapping gunzip 365 ms, parse 1180 ms, sort 141 ms, write 2498 ms, index 671 ms: 11 candidates, 84485 repo-hours, 503 releases; waiting 626 ms; commit 1429 ms)
2026-11-07T13:15:14Z [load_day 2026-04-02] 2026-04-02 hour 18: 155639 events in 4 files, snapshot 8499502538551782284 (task 5471 ms: download 1726 ms overlapping gunzip 349 ms, parse 1140 ms, sort 144 ms, write 2404 ms, index 616 ms: 13 candidates, 85973 repo-hours, 535 releases; waiting 443 ms; commit 1341 ms)
2026-11-07T13:15:16Z [load_day 2026-04-02] 2026-04-02 hour 19: 155749 events in 4 files, snapshot 1076128488260973635 (task 5629 ms: download 2255 ms overlapping gunzip 350 ms, parse 1142 ms, sort 150 ms, write 2422 ms, index 632 ms: 8 candidates, 83019 repo-hours, 492 releases; waiting 611 ms; commit 1411 ms)
2026-11-07T13:15:21Z [load_day 2026-04-02] 2026-04-02 hour 20: 150359 events in 4 files, snapshot 4375827998837063032 (task 5765 ms: download 2023 ms overlapping gunzip 379 ms, parse 1279 ms, sort 221 ms, write 2647 ms, index 557 ms: 3 candidates, 76600 repo-hours, 669 releases; waiting 337 ms; commit 1493 ms)
2026-11-07T13:15:24Z [load_day 2026-04-02] 2026-04-02 hour 21: 156304 events in 4 files, snapshot 2049362122894768423 (task 6479 ms: download 2283 ms overlapping gunzip 416 ms, parse 1353 ms, sort 197 ms, write 2925 ms, index 659 ms: 13 candidates, 78725 repo-hours, 773 releases; waiting 627 ms; commit 2343 ms)
2026-11-07T13:15:30Z [load_day 2026-04-02] 2026-04-02 hour 22: 152518 events in 4 files, snapshot 8524966599108240070 (task 5901 ms: download 2114 ms overlapping gunzip 409 ms, parse 1351 ms, sort 141 ms, write 2640 ms, index 536 ms: 7 candidates, 74546 repo-hours, 798 releases; waiting 553 ms; commit 4159 ms)
2026-11-07T13:15:34Z [load_day 2026-04-02] 2026-04-02 hour 23: 150076 events in 4 files, snapshot 52821827497279684 (task 9152 ms: download 2243 ms overlapping gunzip 425 ms, parse 1449 ms, sort 134 ms, write 5657 ms, index 457 ms: 7 candidates, 69913 repo-hours, 861 releases; waiting 649 ms; commit 1243 ms)
2026-11-07T13:15:42Z [load_day 2026-04-02] 2026-04-02: repo_hour merged from 24 files to 1 (1964990 rows, 8141 ms)
2026-11-07T13:15:44Z [load_day 2026-04-02] 2026-04-02: index committed in 9888 ms (24 + 1 + 24 files)
2026-11-07T13:15:44Z [load_day 2026-04-02] 2026-04-02: 3735151 events in 24 hours
2026-11-07T13:15:44Z [load_day 2026-04-02] attempt 1 succeeded