orcaLog in

Runs · run 578

load_day 2026-05-09, attempt 1 succeeded

Host
4e84322b8c45:129166
Started
2026-11-07T06:36:14Z
Ended
2026-11-07T06:37:36Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/578/load_day/2026-05-09/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:36:14Z [load_day 2026-05-09] attempt 1 started
2026-11-07T06:36:22Z [load_day 2026-05-09] 2026-05-09 hour 0: 144722 events in 3 files, snapshot 5471923834434030914 (task 5647 ms: download 2192 ms overlapping gunzip 345 ms, parse 1165 ms, sort 155 ms, write 2726 ms, index 414 ms: 10 candidates, 67391 repo-hours, 701 releases; waiting 531 ms; commit 1130 ms)
2026-11-07T06:36:23Z [load_day 2026-05-09] 2026-05-09 hour 1: 151065 events in 4 files, snapshot 1743871715293409705 (task 5591 ms: download 2026 ms overlapping gunzip 309 ms, parse 1071 ms, sort 135 ms, write 2700 ms, index 466 ms: 4 candidates, 77341 repo-hours, 448 releases; waiting 529 ms; commit 971 ms)
2026-11-07T06:36:28Z [load_day 2026-05-09] 2026-05-09 hour 2: 155908 events in 4 files, snapshot 5937139455837286311 (task 4732 ms: download 1863 ms overlapping gunzip 313 ms, parse 1051 ms, sort 110 ms, write 1830 ms, index 521 ms: 8 candidates, 86100 repo-hours, 268 releases; waiting 536 ms; commit 1231 ms)
2026-11-07T06:36:29Z [load_day 2026-05-09] 2026-05-09 hour 3: 151142 events in 4 files, snapshot 1781306343206967596 (task 5302 ms: download 1950 ms overlapping gunzip 326 ms, parse 1099 ms, sort 118 ms, write 2079 ms, index 476 ms: 6 candidates, 76223 repo-hours, 563 releases; waiting 825 ms; commit 1196 ms)
2026-11-07T06:36:34Z [load_day 2026-05-09] 2026-05-09 hour 4: 148516 events in 3 files, snapshot 2237480130738312352 (task 5322 ms: download 1668 ms overlapping gunzip 362 ms, parse 1186 ms, sort 131 ms, write 2354 ms, index 449 ms: 6 candidates, 66878 repo-hours, 769 releases; waiting 540 ms; commit 1130 ms)
2026-11-07T06:36:35Z [load_day 2026-05-09] 2026-05-09 hour 5: 147974 events in 3 files, snapshot 2220948315497829499 (task 5057 ms: download 2130 ms overlapping gunzip 371 ms, parse 1204 ms, sort 130 ms, write 1984 ms, index 465 ms: 4 candidates, 69376 repo-hours, 694 releases; waiting 561 ms; commit 1018 ms)
2026-11-07T06:36:39Z [load_day 2026-05-09] 2026-05-09 hour 6: 150554 events in 4 files, snapshot 7290568949059897529 (task 5024 ms: download 1643 ms overlapping gunzip 309 ms, parse 1020 ms, sort 113 ms, write 2243 ms, index 480 ms: 8 candidates, 75243 repo-hours, 626 releases; waiting 535 ms; commit 1160 ms)
2026-11-07T06:36:41Z [load_day 2026-05-09] 2026-05-09 hour 7: 150343 events in 4 files, snapshot 8189769603491465474 (task 4739 ms: download 1667 ms overlapping gunzip 300 ms, parse 1021 ms, sort 117 ms, write 2047 ms, index 519 ms: 5 candidates, 77962 repo-hours, 505 releases; waiting 409 ms; commit 1113 ms)
2026-11-07T06:36:45Z [load_day 2026-05-09] 2026-05-09 hour 8: 151739 events in 4 files, snapshot 3932391408348857774 (task 5031 ms: download 1835 ms overlapping gunzip 286 ms, parse 948 ms, sort 117 ms, write 2278 ms, index 517 ms: 7 candidates, 76059 repo-hours, 543 releases; waiting 561 ms; commit 1173 ms)
2026-11-07T06:36:46Z [load_day 2026-05-09] 2026-05-09 hour 9: 151394 events in 4 files, snapshot 3347162757929087431 (task 4794 ms: download 1791 ms overlapping gunzip 273 ms, parse 896 ms, sort 121 ms, write 2009 ms, index 487 ms: 4 candidates, 76706 repo-hours, 540 releases; waiting 548 ms; commit 1110 ms)
2026-11-07T06:36:51Z [load_day 2026-05-09] 2026-05-09 hour 10: 156482 events in 4 files, snapshot 6345751653735818781 (task 5180 ms: download 1787 ms overlapping gunzip 301 ms, parse 1012 ms, sort 122 ms, write 2382 ms, index 505 ms: 12 candidates, 75821 repo-hours, 563 releases; waiting 540 ms; commit 1120 ms)
2026-11-07T06:36:52Z [load_day 2026-05-09] 2026-05-09 hour 11: 155120 events in 4 files, snapshot 1458128141715823109 (task 5002 ms: download 1725 ms overlapping gunzip 280 ms, parse 948 ms, sort 107 ms, write 2293 ms, index 525 ms: 6 candidates, 77436 repo-hours, 436 releases; waiting 535 ms; commit 1037 ms)
2026-11-07T06:36:56Z [load_day 2026-05-09] 2026-05-09 hour 12: 159882 events in 4 files, snapshot 7654397263809054099 (task 4663 ms: download 1698 ms overlapping gunzip 268 ms, parse 927 ms, sort 110 ms, write 1946 ms, index 530 ms: 10 candidates, 83639 repo-hours, 273 releases; waiting 535 ms; commit 1121 ms)
2026-11-07T06:36:57Z [load_day 2026-05-09] 2026-05-09 hour 13: 161912 events in 4 files, snapshot 4933203793288559090 (task 4557 ms: download 1572 ms overlapping gunzip 235 ms, parse 830 ms, sort 108 ms, write 1954 ms, index 564 ms: 2 candidates, 90125 repo-hours, 139 releases; waiting 524 ms; commit 1014 ms)
2026-11-07T06:37:01Z [load_day 2026-05-09] 2026-05-09 hour 14: 161362 events in 4 files, snapshot 3172837936977992955 (task 4561 ms: download 1568 ms overlapping gunzip 240 ms, parse 858 ms, sort 111 ms, write 1760 ms, index 556 ms: 5 candidates, 82039 repo-hours, 137 releases; waiting 525 ms; commit 1138 ms)
2026-11-07T06:37:02Z [load_day 2026-05-09] 2026-05-09 hour 15: 158071 events in 4 files, snapshot 8405797979782439382 (task 4272 ms: download 1599 ms overlapping gunzip 234 ms, parse 848 ms, sort 109 ms, write 1661 ms, index 534 ms: 11 candidates, 80515 repo-hours, 152 releases; waiting 527 ms; commit 897 ms)
2026-11-07T06:37:06Z [load_day 2026-05-09] 2026-05-09 hour 16: 157798 events in 4 files, snapshot 5563285136602989896 (task 4368 ms: download 1571 ms overlapping gunzip 234 ms, parse 838 ms, sort 117 ms, write 1822 ms, index 534 ms: 3 candidates, 78806 repo-hours, 167 releases; waiting 529 ms; commit 1052 ms)
2026-11-07T06:37:08Z [load_day 2026-05-09] 2026-05-09 hour 17: 156505 events in 4 files, snapshot 2402282918422757163 (task 4364 ms: download 1621 ms overlapping gunzip 260 ms, parse 903 ms, sort 121 ms, write 1663 ms, index 492 ms: 6 candidates, 78079 repo-hours, 180 releases; waiting 633 ms; commit 1167 ms)
2026-11-07T06:37:12Z [load_day 2026-05-09] 2026-05-09 hour 18: 153581 events in 4 files, snapshot 6176617312425723954 (task 4322 ms: download 1632 ms overlapping gunzip 255 ms, parse 908 ms, sort 127 ms, write 1689 ms, index 498 ms: 5 candidates, 76110 repo-hours, 199 releases; waiting 520 ms; commit 1132 ms)
2026-11-07T06:37:13Z [load_day 2026-05-09] 2026-05-09 hour 19: 153862 events in 4 files, snapshot 1476241846098736854 (task 4823 ms: download 1844 ms overlapping gunzip 311 ms, parse 1030 ms, sort 129 ms, write 1957 ms, index 496 ms: 8 candidates, 76685 repo-hours, 416 releases; waiting 541 ms; commit 1204 ms)
2026-11-07T06:37:17Z [load_day 2026-05-09] 2026-05-09 hour 20: 152796 events in 4 files, snapshot 8430351690284577303 (task 5304 ms: download 2293 ms overlapping gunzip 340 ms, parse 1104 ms, sort 130 ms, write 2205 ms, index 587 ms: 2 candidates, 73870 repo-hours, 594 releases; waiting 641 ms; commit 1060 ms)
2026-11-07T06:37:19Z [load_day 2026-05-09] 2026-05-09 hour 21: 152383 events in 4 files, snapshot 5959529300313535027 (task 5421 ms: download 2274 ms overlapping gunzip 364 ms, parse 1208 ms, sort 134 ms, write 2155 ms, index 465 ms: 13 candidates, 71807 repo-hours, 604 releases; waiting 706 ms; commit 1156 ms)
2026-11-07T06:37:26Z [load_day 2026-05-09] 2026-05-09 hour 22: 149964 events in 3 files, snapshot 308502066256693967 (task 5708 ms: download 2363 ms overlapping gunzip 396 ms, parse 1253 ms, sort 155 ms, write 2431 ms, index 518 ms: 4 candidates, 70051 repo-hours, 842 releases; waiting 607 ms; commit 3110 ms)
2026-11-07T06:37:27Z [load_day 2026-05-09] 2026-05-09 hour 23: 144310 events in 3 files, snapshot 5795610275028147666 (task 5556 ms: download 2058 ms overlapping gunzip 421 ms, parse 1421 ms, sort 125 ms, write 2367 ms, index 396 ms: 7 candidates, 62729 repo-hours, 1034 releases; waiting 561 ms; commit 1194 ms)
2026-11-07T06:37:34Z [load_day 2026-05-09] 2026-05-09: repo_hour merged from 24 files to 1 (1826991 rows, 7211 ms)
2026-11-07T06:37:36Z [load_day 2026-05-09] 2026-05-09: index committed in 8999 ms (24 + 1 + 24 files)
2026-11-07T06:37:36Z [load_day 2026-05-09] 2026-05-09: 3677385 events in 24 hours
2026-11-07T06:37:36Z [load_day 2026-05-09] attempt 1 succeeded