orcaLog in

Runs · run 152

load_day 2026-09-28, attempt 1 succeeded

Host
4e84322b8c45:26043
Started
2026-11-07T03:48:06Z
Ended
2026-11-07T03:49:02Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/152/load_day/2026-09-28/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T03:48:06Z [load_day 2026-09-28] attempt 1 started
2026-11-07T03:48:12Z [load_day 2026-09-28] 2026-09-28 hour 0: 119814 events in 3 files, snapshot 5908481107747415278 (task 3391 ms: download 1137 ms overlapping gunzip 176 ms, parse 634 ms, sort 88 ms, write 1334 ms, index 318 ms: 10 candidates, 50545 repo-hours, 67 releases; waiting 537 ms; commit 762 ms)
2026-11-07T03:48:14Z [load_day 2026-09-28] 2026-09-28 hour 1: 119769 events in 3 files, snapshot 2737561793046174701 (task 3374 ms: download 975 ms overlapping gunzip 238 ms, parse 833 ms, sort 91 ms, write 1195 ms, index 332 ms: 15 candidates, 51429 repo-hours, 54 releases; waiting 366 ms; commit 1875 ms)
2026-11-07T03:48:16Z [load_day 2026-09-28] 2026-09-28 hour 2: 124620 events in 3 files, snapshot 2375273841999661745 (task 3300 ms: download 1195 ms overlapping gunzip 176 ms, parse 622 ms, sort 92 ms, write 1234 ms, index 349 ms: 12 candidates, 59664 repo-hours, 55 releases; waiting 543 ms; commit 771 ms)
2026-11-07T03:48:17Z [load_day 2026-09-28] 2026-09-28 hour 3: 127850 events in 3 files, snapshot 8791971706355895521 (task 3284 ms: download 1351 ms overlapping gunzip 168 ms, parse 615 ms, sort 81 ms, write 1183 ms, index 416 ms: 9 candidates, 66013 repo-hours, 42 releases; waiting 550 ms; commit 926 ms)
2026-11-07T03:48:20Z [load_day 2026-09-28] 2026-09-28 hour 4: 128846 events in 3 files, snapshot 7633582116332330512 (task 3387 ms: download 1209 ms overlapping gunzip 178 ms, parse 659 ms, sort 85 ms, write 1210 ms, index 375 ms: 10 candidates, 64212 repo-hours, 40 releases; waiting 524 ms; commit 856 ms)
2026-11-07T03:48:21Z [load_day 2026-09-28] 2026-09-28 hour 5: 125529 events in 3 files, snapshot 1636800929813799543 (task 3288 ms: download 1136 ms overlapping gunzip 155 ms, parse 595 ms, sort 88 ms, write 1172 ms, index 402 ms: 9 candidates, 65563 repo-hours, 24 releases; waiting 524 ms; commit 733 ms)
2026-11-07T03:48:24Z [load_day 2026-09-28] 2026-09-28 hour 6: 127560 events in 3 files, snapshot 7502845942221882794 (task 3240 ms: download 1240 ms overlapping gunzip 164 ms, parse 604 ms, sort 78 ms, write 1088 ms, index 524 ms: 9 candidates, 67264 repo-hours, 37 releases; waiting 519 ms; commit 681 ms)
2026-11-07T03:48:25Z [load_day 2026-09-28] 2026-09-28 hour 7: 121216 events in 3 files, snapshot 5993965052825442741 (task 3567 ms: download 1542 ms overlapping gunzip 187 ms, parse 642 ms, sort 74 ms, write 1211 ms, index 391 ms: 13 candidates, 64610 repo-hours, 73 releases; waiting 522 ms; commit 790 ms)
2026-11-07T03:48:28Z [load_day 2026-09-28] 2026-09-28 hour 8: 113858 events in 3 files, snapshot 1593228526987293084 (task 3537 ms: download 1149 ms overlapping gunzip 170 ms, parse 592 ms, sort 79 ms, write 1282 ms, index 509 ms: 7 candidates, 60088 repo-hours, 90 releases; waiting 531 ms; commit 662 ms)
2026-11-07T03:48:29Z [load_day 2026-09-28] 2026-09-28 hour 9: 105208 events in 3 files, snapshot 9143711543142566065 (task 3003 ms: download 1324 ms overlapping gunzip 154 ms, parse 539 ms, sort 75 ms, write 1027 ms, index 366 ms: 8 candidates, 56664 repo-hours, 83 releases; waiting 540 ms; commit 822 ms)
2026-11-07T03:48:31Z [load_day 2026-09-28] 2026-09-28 hour 10: 92447 events in 2 files, snapshot 5073756555624472602 (task 3009 ms: download 1263 ms overlapping gunzip 159 ms, parse 511 ms, sort 61 ms, write 1066 ms, index 328 ms: 3 candidates, 53387 repo-hours, 92 releases; waiting 562 ms; commit 502 ms)
2026-11-07T03:48:32Z [load_day 2026-09-28] 2026-09-28 hour 11: 88396 events in 2 files, snapshot 1724734605749885473 (task 2708 ms: download 1297 ms overlapping gunzip 135 ms, parse 466 ms, sort 62 ms, write 877 ms, index 317 ms: 8 candidates, 52200 repo-hours, 54 releases; waiting 526 ms; commit 637 ms)
2026-11-07T03:48:34Z [load_day 2026-09-28] 2026-09-28 hour 12: 91523 events in 2 files, snapshot 471646104960919287 (task 2275 ms: download 545 ms overlapping gunzip 136 ms, parse 439 ms, sort 58 ms, write 862 ms, index 351 ms: 8 candidates, 55494 repo-hours, 71 releases; waiting 185 ms; commit 743 ms)
2026-11-07T03:48:36Z [load_day 2026-09-28] 2026-09-28 hour 13: 94941 events in 2 files, snapshot 5671352328198246556 (task 2780 ms: download 1015 ms overlapping gunzip 160 ms, parse 547 ms, sort 63 ms, write 921 ms, index 344 ms: 13 candidates, 57529 repo-hours, 81 releases; waiting 532 ms; commit 736 ms)
2026-11-07T03:48:38Z [load_day 2026-09-28] 2026-09-28 hour 14: 95579 events in 2 files, snapshot 1702158157760303558 (task 3010 ms: download 1113 ms overlapping gunzip 148 ms, parse 497 ms, sort 67 ms, write 1006 ms, index 440 ms: 8 candidates, 56532 repo-hours, 84 releases; waiting 570 ms; commit 812 ms)
2026-11-07T03:48:39Z [load_day 2026-09-28] 2026-09-28 hour 15: 93884 events in 2 files, snapshot 6082138246022635182 (task 2796 ms: download 1108 ms overlapping gunzip 141 ms, parse 470 ms, sort 65 ms, write 932 ms, index 356 ms: 3 candidates, 56569 repo-hours, 82 releases; waiting 571 ms; commit 803 ms)
2026-11-07T03:48:41Z [load_day 2026-09-28] 2026-09-28 hour 16: 94369 events in 2 files, snapshot 3588382417907134007 (task 2830 ms: download 1202 ms overlapping gunzip 154 ms, parse 496 ms, sort 65 ms, write 917 ms, index 362 ms: 5 candidates, 59196 repo-hours, 98 releases; waiting 554 ms; commit 809 ms)
2026-11-07T03:48:43Z [load_day 2026-09-28] 2026-09-28 hour 17: 101931 events in 3 files, snapshot 717584849009940496 (task 3309 ms: download 1645 ms overlapping gunzip 175 ms, parse 582 ms, sort 72 ms, write 1124 ms, index 389 ms: 13 candidates, 62300 repo-hours, 151 releases; waiting 700 ms; commit 934 ms)
2026-11-07T03:48:45Z [load_day 2026-09-28] 2026-09-28 hour 18: 101203 events in 3 files, snapshot 414724960834657278 (task 2987 ms: download 1067 ms overlapping gunzip 161 ms, parse 547 ms, sort 70 ms, write 1146 ms, index 367 ms: 11 candidates, 63472 repo-hours, 112 releases; waiting 377 ms; commit 853 ms)
2026-11-07T03:48:47Z [load_day 2026-09-28] 2026-09-28 hour 19: 95537 events in 2 files, snapshot 7427770387871082680 (task 2959 ms: download 1124 ms overlapping gunzip 157 ms, parse 523 ms, sort 68 ms, write 993 ms, index 375 ms: 8 candidates, 54741 repo-hours, 107 releases; waiting 545 ms; commit 878 ms)
2026-11-07T03:48:48Z [load_day 2026-09-28] 2026-09-28 hour 20: 90338 events in 2 files, snapshot 8474084757722903125 (task 2891 ms: download 1186 ms overlapping gunzip 150 ms, parse 501 ms, sort 64 ms, write 972 ms, index 340 ms: 7 candidates, 49922 repo-hours, 95 releases; waiting 549 ms; commit 742 ms)
2026-11-07T03:48:50Z [load_day 2026-09-28] 2026-09-28 hour 21: 87531 events in 2 files, snapshot 1145894052884411433 (task 2796 ms: download 1163 ms overlapping gunzip 153 ms, parse 496 ms, sort 56 ms, write 978 ms, index 289 ms: 11 candidates, 46528 repo-hours, 107 releases; waiting 554 ms; commit 942 ms)
2026-11-07T03:48:52Z [load_day 2026-09-28] 2026-09-28 hour 22: 85215 events in 2 files, snapshot 8775946757465673057 (task 3014 ms: download 1262 ms overlapping gunzip 161 ms, parse 536 ms, sort 100 ms, write 1073 ms, index 288 ms: 10 candidates, 43720 repo-hours, 117 releases; waiting 540 ms; commit 789 ms)
2026-11-07T03:48:54Z [load_day 2026-09-28] 2026-09-28 hour 23: 88680 events in 2 files, snapshot 1079596699418548653 (task 3228 ms: download 1292 ms overlapping gunzip 178 ms, parse 569 ms, sort 63 ms, write 1189 ms, index 364 ms: 6 candidates, 43729 repo-hours, 224 releases; waiting 555 ms; commit 826 ms)
2026-11-07T03:49:00Z [load_day 2026-09-28] 2026-09-28: repo_hour merged from 24 files to 1 (1361371 rows, 5856 ms)
2026-11-07T03:49:02Z [load_day 2026-09-28] 2026-09-28: index committed in 7741 ms (24 + 1 + 24 files)
2026-11-07T03:49:02Z [load_day 2026-09-28] 2026-09-28: 2515844 events in 24 hours
2026-11-07T03:49:02Z [load_day 2026-09-28] attempt 1 succeeded