orcaLog in

Runs · run 194

load_day 2026-09-14, attempt 1 succeeded

Host
4e84322b8c45:33409
Started
2026-11-07T04:02:31Z
Ended
2026-11-07T04:03:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/194/load_day/2026-09-14/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T04:02:31Z [load_day 2026-09-14] attempt 1 started
2026-11-07T04:02:37Z [load_day 2026-09-14] 2026-09-14 hour 0: 126994 events in 3 files, snapshot 7451614799173583586 (task 3387 ms: download 1276 ms overlapping gunzip 174 ms, parse 649 ms, sort 90 ms, write 1348 ms, index 270 ms: 4 candidates, 32762 repo-hours, 57 releases; waiting 509 ms; commit 674 ms)
2026-11-07T04:02:38Z [load_day 2026-09-14] 2026-09-14 hour 1: 127186 events in 3 files, snapshot 6416397988661532563 (task 3404 ms: download 1319 ms overlapping gunzip 168 ms, parse 618 ms, sort 84 ms, write 1495 ms, index 206 ms: 2 candidates, 30726 repo-hours, 49 releases; waiting 529 ms; commit 594 ms)
2026-11-07T04:02:41Z [load_day 2026-09-14] 2026-09-14 hour 2: 128809 events in 3 files, snapshot 7112945942228303627 (task 3261 ms: download 1194 ms overlapping gunzip 177 ms, parse 623 ms, sort 79 ms, write 1336 ms, index 200 ms: 4 candidates, 30985 repo-hours, 61 releases; waiting 542 ms; commit 542 ms)
2026-11-07T04:02:42Z [load_day 2026-09-14] 2026-09-14 hour 3: 140962 events in 3 files, snapshot 6729988728328406760 (task 3297 ms: download 1172 ms overlapping gunzip 187 ms, parse 674 ms, sort 90 ms, write 1284 ms, index 214 ms: 6 candidates, 32621 repo-hours, 50 releases; waiting 496 ms; commit 766 ms)
2026-11-07T04:02:45Z [load_day 2026-09-14] 2026-09-14 hour 4: 137957 events in 3 files, snapshot 6908527992461688168 (task 3382 ms: download 1280 ms overlapping gunzip 191 ms, parse 716 ms, sort 97 ms, write 1269 ms, index 280 ms: 4 candidates, 31256 repo-hours, 51 releases; waiting 547 ms; commit 688 ms)
2026-11-07T04:02:46Z [load_day 2026-09-14] 2026-09-14 hour 5: 135140 events in 3 files, snapshot 4715234712429755343 (task 3311 ms: download 1275 ms overlapping gunzip 198 ms, parse 687 ms, sort 91 ms, write 1298 ms, index 203 ms: 5 candidates, 31909 repo-hours, 77 releases; waiting 527 ms; commit 670 ms)
2026-11-07T04:02:49Z [load_day 2026-09-14] 2026-09-14 hour 6: 133893 events in 3 files, snapshot 6525858577285282128 (task 3291 ms: download 1374 ms overlapping gunzip 177 ms, parse 651 ms, sort 83 ms, write 1304 ms, index 223 ms: 4 candidates, 32222 repo-hours, 55 releases; waiting 544 ms; commit 649 ms)
2026-11-07T04:02:50Z [load_day 2026-09-14] 2026-09-14 hour 7: 135200 events in 3 files, snapshot 12664433908091448 (task 3232 ms: download 1220 ms overlapping gunzip 189 ms, parse 709 ms, sort 90 ms, write 1283 ms, index 196 ms: 6 candidates, 29860 repo-hours, 54 releases; waiting 517 ms; commit 630 ms)
2026-11-07T04:02:53Z [load_day 2026-09-14] 2026-09-14 hour 8: 130622 events in 3 files, snapshot 113411150641523514 (task 3259 ms: download 1442 ms overlapping gunzip 187 ms, parse 692 ms, sort 88 ms, write 1249 ms, index 209 ms: 2 candidates, 30529 repo-hours, 68 releases; waiting 537 ms; commit 590 ms)
2026-11-07T04:02:54Z [load_day 2026-09-14] 2026-09-14 hour 9: 100068 events in 3 files, snapshot 4350538827457097576 (task 2860 ms: download 1145 ms overlapping gunzip 142 ms, parse 501 ms, sort 70 ms, write 979 ms, index 210 ms: 2 candidates, 31703 repo-hours, 66 releases; waiting 671 ms; commit 481 ms)
2026-11-07T04:02:57Z [load_day 2026-09-14] 2026-09-14 hour 10: 105519 events in 3 files, snapshot 5486723489037448361 (task 2948 ms: download 1131 ms overlapping gunzip 149 ms, parse 560 ms, sort 71 ms, write 1149 ms, index 178 ms: 6 candidates, 27779 repo-hours, 64 releases; waiting 538 ms; commit 668 ms)
2026-11-07T04:02:57Z [load_day 2026-09-14] 2026-09-14 hour 11: 109255 events in 3 files, snapshot 6050905417707427443 (task 2884 ms: download 1212 ms overlapping gunzip 150 ms, parse 545 ms, sort 69 ms, write 1129 ms, index 160 ms: 2 candidates, 24233 repo-hours, 49 releases; waiting 535 ms; commit 631 ms)
2026-11-07T04:03:00Z [load_day 2026-09-14] 2026-09-14 hour 12: 100774 events in 3 files, snapshot 4798837338511305961 (task 2640 ms: download 1000 ms overlapping gunzip 140 ms, parse 513 ms, sort 69 ms, write 950 ms, index 163 ms: 3 candidates, 23051 repo-hours, 49 releases; waiting 515 ms; commit 653 ms)
2026-11-07T04:03:01Z [load_day 2026-09-14] 2026-09-14 hour 13: 96843 events in 2 files, snapshot 1281067198707778787 (task 2628 ms: download 1143 ms overlapping gunzip 135 ms, parse 487 ms, sort 65 ms, write 941 ms, index 149 ms: 1 candidates, 21909 repo-hours, 42 releases; waiting 547 ms; commit 614 ms)
2026-11-07T04:03:03Z [load_day 2026-09-14] 2026-09-14 hour 14: 78864 events in 2 files, snapshot 6165465333519966217 (task 2438 ms: download 923 ms overlapping gunzip 138 ms, parse 460 ms, sort 50 ms, write 813 ms, index 143 ms: 2 candidates, 19476 repo-hours, 54 releases; waiting 538 ms; commit 769 ms)
2026-11-07T04:03:05Z [load_day 2026-09-14] 2026-09-14 hour 15: 51271 events in 2 files, snapshot 803504689962042544 (task 4110 ms: download 1468 ms overlapping gunzip 257 ms, parse 817 ms, sort 100 ms, write 1815 ms, index 172 ms: 4 candidates, 25437 repo-hours, 566 releases; waiting 609 ms; commit 693 ms)
2026-11-07T04:03:09Z [load_day 2026-09-14] 2026-09-14 hour 16: 56040 events in 2 files, snapshot 6952512794717010479 (task 5262 ms: download 1883 ms overlapping gunzip 340 ms, parse 1065 ms, sort 116 ms, write 2539 ms, index 223 ms: 3 candidates, 30622 repo-hours, 805 releases; waiting 663 ms; commit 780 ms)
2026-11-07T04:03:10Z [load_day 2026-09-14] 2026-09-14 hour 17: 56661 events in 2 files, snapshot 7822843434157388673 (task 4032 ms: download 1516 ms overlapping gunzip 247 ms, parse 743 ms, sort 55 ms, write 1769 ms, index 187 ms: 2 candidates, 28922 repo-hours, 524 releases; waiting 690 ms; commit 742 ms)
2026-11-07T04:03:14Z [load_day 2026-09-14] 2026-09-14 hour 18: 59388 events in 2 files, snapshot 5430180324065619080 (task 4386 ms: download 1683 ms overlapping gunzip 261 ms, parse 760 ms, sort 53 ms, write 2020 ms, index 186 ms: 4 candidates, 29411 repo-hours, 591 releases; waiting 767 ms; commit 599 ms)
2026-11-07T04:03:15Z [load_day 2026-09-14] 2026-09-14 hour 19: 56649 events in 2 files, snapshot 1751068129703409465 (task 3966 ms: download 1701 ms overlapping gunzip 310 ms, parse 837 ms, sort 49 ms, write 1638 ms, index 186 ms: 2 candidates, 27658 repo-hours, 396 releases; waiting 632 ms; commit 658 ms)
2026-11-07T04:03:18Z [load_day 2026-09-14] 2026-09-14 hour 20: 54625 events in 2 files, snapshot 3357713269823203316 (task 3166 ms: download 1220 ms overlapping gunzip 182 ms, parse 522 ms, sort 66 ms, write 1339 ms, index 176 ms: 6 candidates, 25323 repo-hours, 241 releases; waiting 583 ms; commit 627 ms)
2026-11-07T04:03:19Z [load_day 2026-09-14] 2026-09-14 hour 21: 51124 events in 2 files, snapshot 4884012038050440828 (task 3079 ms: download 1307 ms overlapping gunzip 220 ms, parse 624 ms, sort 43 ms, write 1209 ms, index 170 ms: 2 candidates, 24233 repo-hours, 262 releases; waiting 528 ms; commit 778 ms)
2026-11-07T04:03:24Z [load_day 2026-09-14] 2026-09-14 hour 22: 58322 events in 2 files, snapshot 4373041599356775217 (task 5733 ms: download 1929 ms overlapping gunzip 346 ms, parse 1070 ms, sort 124 ms, write 2764 ms, index 289 ms: 6 candidates, 32345 repo-hours, 754 releases; waiting 678 ms; commit 728 ms)
2026-11-07T04:03:25Z [load_day 2026-09-14] 2026-09-14 hour 23: 64777 events in 2 files, snapshot 8877545187253031529 (task 6245 ms: download 2290 ms overlapping gunzip 489 ms, parse 1471 ms, sort 131 ms, write 2804 ms, index 218 ms: 8 candidates, 35586 repo-hours, 877 releases; waiting 826 ms; commit 758 ms)
2026-11-07T04:03:29Z [load_day 2026-09-14] 2026-09-14: repo_hour merged from 24 files to 1 (690558 rows, 3417 ms)
2026-11-07T04:03:30Z [load_day 2026-09-14] 2026-09-14: index committed in 4929 ms (24 + 1 + 24 files)
2026-11-07T04:03:30Z [load_day 2026-09-14] 2026-09-14: 2296943 events in 24 hours
2026-11-07T04:03:30Z [load_day 2026-09-14] attempt 1 succeeded