orcaLog in

Runs · run 116

load_day 2026-10-10, attempt 1 succeeded

Host
4e84322b8c45:21283
Started
2026-11-07T03:37:58Z
Ended
2026-11-07T03:38:38Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/116/load_day/2026-10-10/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:37:58Z [load_day 2026-10-10] attempt 1 started
2026-11-07T03:38:02Z [load_day 2026-10-10] 2026-10-10 hour 0: 5394 events in 1 files, snapshot 2441783013480248941 (task 1862 ms: download 873 ms overlapping gunzip 87 ms, parse 273 ms, sort 18 ms, write 574 ms, index 47 ms: 0 candidates, 4190 repo-hours, 508 releases; waiting 537 ms; commit 715 ms)
2026-11-07T03:38:03Z [load_day 2026-10-10] 2026-10-10 hour 1: 14340 events in 1 files, snapshot 817979844754726250 (task 1825 ms: download 594 ms overlapping gunzip 87 ms, parse 296 ms, sort 27 ms, write 711 ms, index 120 ms: 0 candidates, 11095 repo-hours, 667 releases; waiting 285 ms; commit 707 ms)
2026-11-07T03:38:05Z [load_day 2026-10-10] 2026-10-10 hour 2: 24133 events in 1 files, snapshot 7185905704280690000 (task 2008 ms: download 891 ms overlapping gunzip 100 ms, parse 328 ms, sort 31 ms, write 631 ms, index 133 ms: 6 candidates, 17387 repo-hours, 777 releases; waiting 552 ms; commit 752 ms)
2026-11-07T03:38:06Z [load_day 2026-10-10] 2026-10-10 hour 3: 27016 events in 1 files, snapshot 9080489372341799076 (task 2285 ms: download 935 ms overlapping gunzip 120 ms, parse 381 ms, sort 38 ms, write 750 ms, index 145 ms: 4 candidates, 19429 repo-hours, 849 releases; waiting 552 ms; commit 656 ms)
2026-11-07T03:38:08Z [load_day 2026-10-10] 2026-10-10 hour 4: 28577 events in 1 files, snapshot 4037987445173487686 (task 2453 ms: download 932 ms overlapping gunzip 132 ms, parse 383 ms, sort 22 ms, write 702 ms, index 156 ms: 2 candidates, 20722 repo-hours, 641 releases; waiting 562 ms; commit 715 ms)
2026-11-07T03:38:09Z [load_day 2026-10-10] 2026-10-10 hour 5: 26194 events in 1 files, snapshot 8195116250903776456 (task 2039 ms: download 874 ms overlapping gunzip 96 ms, parse 307 ms, sort 20 ms, write 596 ms, index 144 ms: 4 candidates, 19292 repo-hours, 795 releases; waiting 547 ms; commit 759 ms)
2026-11-07T03:38:11Z [load_day 2026-10-10] 2026-10-10 hour 6: 30480 events in 1 files, snapshot 8272950388815281325 (task 2298 ms: download 889 ms overlapping gunzip 100 ms, parse 296 ms, sort 32 ms, write 655 ms, index 195 ms: 4 candidates, 21721 repo-hours, 621 releases; waiting 547 ms; commit 741 ms)
2026-11-07T03:38:11Z [load_day 2026-10-10] 2026-10-10 hour 7: 38794 events in 1 files, snapshot 6788533939406378025 (task 2342 ms: download 1000 ms overlapping gunzip 113 ms, parse 346 ms, sort 29 ms, write 794 ms, index 194 ms: 7 candidates, 26078 repo-hours, 491 releases; waiting 584 ms; commit 581 ms)
2026-11-07T03:38:13Z [load_day 2026-10-10] 2026-10-10 hour 8: 40986 events in 1 files, snapshot 3612547184613943491 (task 2500 ms: download 975 ms overlapping gunzip 130 ms, parse 394 ms, sort 48 ms, write 851 ms, index 270 ms: 5 candidates, 27997 repo-hours, 563 releases; waiting 549 ms; commit 446 ms)
2026-11-07T03:38:14Z [load_day 2026-10-10] 2026-10-10 hour 9: 41434 events in 1 files, snapshot 2387862125864660668 (task 2176 ms: download 764 ms overlapping gunzip 105 ms, parse 338 ms, sort 44 ms, write 721 ms, index 194 ms: 3 candidates, 28061 repo-hours, 343 releases; waiting 426 ms; commit 663 ms)
2026-11-07T03:38:17Z [load_day 2026-10-10] 2026-10-10 hour 10: 42227 events in 1 files, snapshot 4295378891738780781 (task 2630 ms: download 967 ms overlapping gunzip 124 ms, parse 394 ms, sort 52 ms, write 993 ms, index 220 ms: 4 candidates, 29158 repo-hours, 398 releases; waiting 541 ms; commit 741 ms)
2026-11-07T03:38:18Z [load_day 2026-10-10] 2026-10-10 hour 11: 39453 events in 1 files, snapshot 8222121085531282289 (task 2480 ms: download 1023 ms overlapping gunzip 156 ms, parse 450 ms, sort 35 ms, write 817 ms, index 204 ms: 8 candidates, 27527 repo-hours, 557 releases; waiting 560 ms; commit 565 ms)
2026-11-07T03:38:20Z [load_day 2026-10-10] 2026-10-10 hour 12: 40599 events in 1 files, snapshot 6727890726508692584 (task 2334 ms: download 921 ms overlapping gunzip 123 ms, parse 371 ms, sort 32 ms, write 800 ms, index 196 ms: 6 candidates, 28354 repo-hours, 324 releases; waiting 558 ms; commit 660 ms)
2026-11-07T03:38:20Z [load_day 2026-10-10] 2026-10-10 hour 13: 40379 events in 1 files, snapshot 7813529466419178802 (task 2251 ms: download 897 ms overlapping gunzip 107 ms, parse 344 ms, sort 28 ms, write 705 ms, index 241 ms: 10 candidates, 28723 repo-hours, 232 releases; waiting 550 ms; commit 571 ms)
2026-11-07T03:38:22Z [load_day 2026-10-10] 2026-10-10 hour 14: 41000 events in 1 files, snapshot 95190503906646376 (task 1654 ms: download 184 ms overlapping gunzip 90 ms, parse 283 ms, sort 30 ms, write 736 ms, index 309 ms: 10 candidates, 29213 repo-hours, 218 releases; waiting 22 ms; commit 773 ms)
2026-11-07T03:38:23Z [load_day 2026-10-10] 2026-10-10 hour 15: 41761 events in 1 files, snapshot 796984511525295775 (task 1778 ms: download 361 ms overlapping gunzip 151 ms, parse 420 ms, sort 42 ms, write 770 ms, index 198 ms: 3 candidates, 29801 repo-hours, 288 releases; waiting 18 ms; commit 730 ms)
2026-11-07T03:38:24Z [load_day 2026-10-10] 2026-10-10 hour 16: 41610 events in 1 files, snapshot 8688314714847974108 (task 1642 ms: download 195 ms overlapping gunzip 113 ms, parse 334 ms, sort 31 ms, write 736 ms, index 222 ms: 10 candidates, 30522 repo-hours, 308 releases; waiting 17 ms; commit 672 ms)
2026-11-07T03:38:25Z [load_day 2026-10-10] 2026-10-10 hour 17: 38553 events in 1 files, snapshot 7923156314911994736 (task 1546 ms: download 191 ms overlapping gunzip 96 ms, parse 291 ms, sort 28 ms, write 722 ms, index 210 ms: 2 candidates, 28266 repo-hours, 254 releases; waiting 19 ms; commit 665 ms)
2026-11-07T03:38:26Z [load_day 2026-10-10] 2026-10-10 hour 18: 35668 events in 1 files, snapshot 2099953119396363737 (task 1481 ms: download 206 ms overlapping gunzip 97 ms, parse 285 ms, sort 26 ms, write 677 ms, index 179 ms: 4 candidates, 25812 repo-hours, 262 releases; waiting 18 ms; commit 489 ms)
2026-11-07T03:38:27Z [load_day 2026-10-10] 2026-10-10 hour 19: 35010 events in 1 files, snapshot 3554179235736701525 (task 1458 ms: download 197 ms overlapping gunzip 96 ms, parse 279 ms, sort 25 ms, write 681 ms, index 171 ms: 3 candidates, 24971 repo-hours, 274 releases; waiting 16 ms; commit 725 ms)
2026-11-07T03:38:28Z [load_day 2026-10-10] 2026-10-10 hour 20: 33321 events in 1 files, snapshot 1042608153668724764 (task 1387 ms: download 185 ms overlapping gunzip 95 ms, parse 273 ms, sort 24 ms, write 634 ms, index 159 ms: 5 candidates, 23666 repo-hours, 274 releases; waiting 16 ms; commit 682 ms)
2026-11-07T03:38:30Z [load_day 2026-10-10] 2026-10-10 hour 21: 32694 events in 1 files, snapshot 4990976217286949226 (task 2313 ms: download 1006 ms overlapping gunzip 119 ms, parse 334 ms, sort 24 ms, write 728 ms, index 168 ms: 4 candidates, 23174 repo-hours, 302 releases; waiting 624 ms; commit 747 ms)
2026-11-07T03:38:31Z [load_day 2026-10-10] 2026-10-10 hour 22: 32474 events in 1 files, snapshot 5869688909106938989 (task 2314 ms: download 1005 ms overlapping gunzip 124 ms, parse 341 ms, sort 24 ms, write 811 ms, index 168 ms: 4 candidates, 22462 repo-hours, 359 releases; waiting 582 ms; commit 666 ms)
2026-11-07T03:38:33Z [load_day 2026-10-10] 2026-10-10 hour 23: 31173 events in 1 files, snapshot 6887388217726123200 (task 2213 ms: download 903 ms overlapping gunzip 99 ms, parse 294 ms, sort 21 ms, write 749 ms, index 152 ms: 5 candidates, 21391 repo-hours, 257 releases; waiting 574 ms; commit 644 ms)
2026-11-07T03:38:36Z [load_day 2026-10-10] 2026-10-10: repo_hour merged from 24 files to 1 (569012 rows, 3053 ms)
2026-11-07T03:38:38Z [load_day 2026-10-10] 2026-10-10: index committed in 4830 ms (22 + 1 + 24 files)
2026-11-07T03:38:38Z [load_day 2026-10-10] 2026-10-10: 803270 events in 24 hours
2026-11-07T03:38:38Z [load_day 2026-10-10] attempt 1 succeeded