orcaLog in

Runs · run 521

load_day 2026-05-28, attempt 1 succeeded

Host
4e84322b8c45:114197
Started
2026-11-07T06:11:30Z
Ended
2026-11-07T06:12:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/521/load_day/2026-05-28/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:11:30Z [load_day 2026-05-28] attempt 1 started
2026-11-07T06:11:39Z [load_day 2026-05-28] 2026-05-28 hour 0: 152072 events in 4 files, snapshot 8169635206024099681 (task 5500 ms: download 1910 ms overlapping gunzip 328 ms, parse 1090 ms, sort 159 ms, write 2585 ms, index 474 ms: 5 candidates, 74538 repo-hours, 550 releases; waiting 549 ms; commit 944 ms)
2026-11-07T06:11:40Z [load_day 2026-05-28] 2026-05-28 hour 1: 149343 events in 3 files, snapshot 4782278328185397467 (task 5141 ms: download 2272 ms overlapping gunzip 347 ms, parse 1179 ms, sort 167 ms, write 2118 ms, index 493 ms: 10 candidates, 77938 repo-hours, 408 releases; waiting 501 ms; commit 1126 ms)
2026-11-07T06:11:44Z [load_day 2026-05-28] 2026-05-28 hour 2: 158068 events in 4 files, snapshot 3704985208931496186 (task 4419 ms: download 1412 ms overlapping gunzip 257 ms, parse 923 ms, sort 105 ms, write 1738 ms, index 568 ms: 7 candidates, 86033 repo-hours, 155 releases; waiting 526 ms; commit 1141 ms)
2026-11-07T06:11:46Z [load_day 2026-05-28] 2026-05-28 hour 3: 154780 events in 4 files, snapshot 1690730759328447324 (task 4371 ms: download 1427 ms overlapping gunzip 254 ms, parse 868 ms, sort 105 ms, write 1841 ms, index 493 ms: 9 candidates, 79608 repo-hours, 179 releases; waiting 533 ms; commit 1221 ms)
2026-11-07T06:11:49Z [load_day 2026-05-28] 2026-05-28 hour 4: 153397 events in 4 files, snapshot 1379737213467761802 (task 4498 ms: download 1899 ms overlapping gunzip 263 ms, parse 944 ms, sort 115 ms, write 1904 ms, index 480 ms: 8 candidates, 75339 repo-hours, 326 releases; waiting 521 ms; commit 1263 ms)
2026-11-07T06:11:51Z [load_day 2026-05-28] 2026-05-28 hour 5: 155341 events in 4 files, snapshot 3932665314138086037 (task 4514 ms: download 2025 ms overlapping gunzip 302 ms, parse 1027 ms, sort 126 ms, write 1811 ms, index 519 ms: 8 candidates, 74247 repo-hours, 279 releases; waiting 404 ms; commit 1088 ms)
2026-11-07T06:11:54Z [load_day 2026-05-28] 2026-05-28 hour 6: 156883 events in 4 files, snapshot 6428305166075859082 (task 4146 ms: download 1382 ms overlapping gunzip 230 ms, parse 809 ms, sort 105 ms, write 1615 ms, index 544 ms: 0 candidates, 76901 repo-hours, 109 releases; waiting 552 ms; commit 1218 ms)
2026-11-07T06:11:55Z [load_day 2026-05-28] 2026-05-28 hour 7: 157151 events in 4 files, snapshot 248489056526038048 (task 3926 ms: download 1264 ms overlapping gunzip 233 ms, parse 835 ms, sort 108 ms, write 1475 ms, index 496 ms: 5 candidates, 77161 repo-hours, 94 releases; waiting 548 ms; commit 1086 ms)
2026-11-07T06:11:59Z [load_day 2026-05-28] 2026-05-28 hour 8: 152291 events in 4 files, snapshot 3670867717675647557 (task 4160 ms: download 1204 ms overlapping gunzip 219 ms, parse 816 ms, sort 128 ms, write 1643 ms, index 523 ms: 5 candidates, 77705 repo-hours, 67 releases; waiting 525 ms; commit 1158 ms)
2026-11-07T06:12:00Z [load_day 2026-05-28] 2026-05-28 hour 9: 150497 events in 4 files, snapshot 3394675721150655685 (task 3928 ms: download 1760 ms overlapping gunzip 216 ms, parse 791 ms, sort 102 ms, write 1416 ms, index 521 ms: 5 candidates, 78273 repo-hours, 69 releases; waiting 545 ms; commit 1075 ms)
2026-11-07T06:12:04Z [load_day 2026-05-28] 2026-05-28 hour 10: 151222 events in 4 files, snapshot 4524100397487088292 (task 3615 ms: download 974 ms overlapping gunzip 202 ms, parse 748 ms, sort 125 ms, write 1465 ms, index 517 ms: 5 candidates, 76250 repo-hours, 71 releases; waiting 332 ms; commit 1148 ms)
2026-11-07T06:12:05Z [load_day 2026-05-28] 2026-05-28 hour 11: 154576 events in 4 files, snapshot 3977077501615299196 (task 4000 ms: download 1327 ms overlapping gunzip 200 ms, parse 726 ms, sort 119 ms, write 1561 ms, index 545 ms: 9 candidates, 79693 repo-hours, 47 releases; waiting 539 ms; commit 926 ms)
2026-11-07T06:12:08Z [load_day 2026-05-28] 2026-05-28 hour 12: 149406 events in 3 files, snapshot 4418325312215071435 (task 3990 ms: download 1217 ms overlapping gunzip 190 ms, parse 719 ms, sort 107 ms, write 1578 ms, index 552 ms: 5 candidates, 78709 repo-hours, 40 releases; waiting 536 ms; commit 1045 ms)
2026-11-07T06:12:09Z [load_day 2026-05-28] 2026-05-28 hour 13: 135296 events in 3 files, snapshot 3807905374250014461 (task 3359 ms: download 790 ms overlapping gunzip 169 ms, parse 618 ms, sort 91 ms, write 1547 ms, index 500 ms: 9 candidates, 74626 repo-hours, 46 releases; waiting 178 ms; commit 1077 ms)
2026-11-07T06:12:13Z [load_day 2026-05-28] 2026-05-28 hour 14: 147118 events in 3 files, snapshot 658979434593343668 (task 3977 ms: download 1722 ms overlapping gunzip 203 ms, parse 736 ms, sort 101 ms, write 1544 ms, index 574 ms: 6 candidates, 83324 repo-hours, 90 releases; waiting 528 ms; commit 1119 ms)
2026-11-07T06:12:14Z [load_day 2026-05-28] 2026-05-28 hour 15: 150798 events in 4 files, snapshot 6917710857952281090 (task 3916 ms: download 1361 ms overlapping gunzip 193 ms, parse 719 ms, sort 160 ms, write 1394 ms, index 605 ms: 8 candidates, 89378 repo-hours, 45 releases; waiting 533 ms; commit 1220 ms)
2026-11-07T06:12:18Z [load_day 2026-05-28] 2026-05-28 hour 16: 148682 events in 3 files, snapshot 8926564911118018380 (task 3748 ms: download 1406 ms overlapping gunzip 210 ms, parse 734 ms, sort 98 ms, write 1346 ms, index 549 ms: 3 candidates, 83279 repo-hours, 54 releases; waiting 507 ms; commit 1052 ms)
2026-11-07T06:12:19Z [load_day 2026-05-28] 2026-05-28 hour 17: 156723 events in 4 files, snapshot 1429264182321628467 (task 4230 ms: download 1701 ms overlapping gunzip 255 ms, parse 887 ms, sort 101 ms, write 1586 ms, index 551 ms: 4 candidates, 82295 repo-hours, 65 releases; waiting 508 ms; commit 1108 ms)
2026-11-07T06:12:23Z [load_day 2026-05-28] 2026-05-28 hour 18: 155875 events in 4 files, snapshot 3877215241188582827 (task 3981 ms: download 1224 ms overlapping gunzip 211 ms, parse 779 ms, sort 111 ms, write 1569 ms, index 542 ms: 7 candidates, 81332 repo-hours, 81 releases; waiting 524 ms; commit 1048 ms)
2026-11-07T06:12:24Z [load_day 2026-05-28] 2026-05-28 hour 19: 153662 events in 4 files, snapshot 566602877737504010 (task 4195 ms: download 1369 ms overlapping gunzip 215 ms, parse 760 ms, sort 111 ms, write 1682 ms, index 550 ms: 9 candidates, 80337 repo-hours, 84 releases; waiting 521 ms; commit 915 ms)
2026-11-07T06:12:27Z [load_day 2026-05-28] 2026-05-28 hour 20: 151484 events in 4 files, snapshot 6809447265899148320 (task 4077 ms: download 1577 ms overlapping gunzip 227 ms, parse 801 ms, sort 106 ms, write 1630 ms, index 516 ms: 6 candidates, 80604 repo-hours, 164 releases; waiting 534 ms; commit 1361 ms)
2026-11-07T06:12:30Z [load_day 2026-05-28] 2026-05-28 hour 21: 146695 events in 3 files, snapshot 437299394916586298 (task 4338 ms: download 1376 ms overlapping gunzip 260 ms, parse 904 ms, sort 119 ms, write 1637 ms, index 592 ms: 17 candidates, 76529 repo-hours, 234 releases; waiting 537 ms; commit 1260 ms)
2026-11-07T06:12:33Z [load_day 2026-05-28] 2026-05-28 hour 22: 151937 events in 4 files, snapshot 4017687269746367527 (task 4988 ms: download 1621 ms overlapping gunzip 307 ms, parse 1028 ms, sort 133 ms, write 2203 ms, index 470 ms: 7 candidates, 72796 repo-hours, 428 releases; waiting 529 ms; commit 1218 ms)
2026-11-07T06:12:35Z [load_day 2026-05-28] 2026-05-28 hour 23: 146950 events in 3 files, snapshot 4154219284298159828 (task 5181 ms: download 1613 ms overlapping gunzip 337 ms, parse 1130 ms, sort 222 ms, write 2185 ms, index 489 ms: 7 candidates, 69816 repo-hours, 670 releases; waiting 545 ms; commit 1004 ms)
2026-11-07T06:12:43Z [load_day 2026-05-28] 2026-05-28: repo_hour merged from 24 files to 1 (1886711 rows, 7558 ms)
2026-11-07T06:12:45Z [load_day 2026-05-28] 2026-05-28: index committed in 9264 ms (23 + 1 + 24 files)
2026-11-07T06:12:45Z [load_day 2026-05-28] 2026-05-28: 3640247 events in 24 hours
2026-11-07T06:12:45Z [load_day 2026-05-28] attempt 1 succeeded