orcaLog in

Runs · run 368

load_day 2026-07-18, attempt 1 succeeded

Host
4e84322b8c45:70719
Started
2026-11-07T05:03:46Z
Ended
2026-11-07T05:04:50Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/368/load_day/2026-07-18/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T05:03:46Z [load_day 2026-07-18] attempt 1 started
2026-11-07T05:03:53Z [load_day 2026-07-18] 2026-07-18 hour 0: 165997 events in 4 files, snapshot 4790555560910119676 (task 4074 ms: download 1476 ms overlapping gunzip 222 ms, parse 846 ms, sort 115 ms, write 1707 ms, index 384 ms: 5 candidates, 55143 repo-hours, 56 releases; waiting 500 ms; commit 948 ms)
2026-11-07T05:03:54Z [load_day 2026-07-18] 2026-07-18 hour 1: 165517 events in 4 files, snapshot 6316466406171896536 (task 4197 ms: download 1589 ms overlapping gunzip 203 ms, parse 802 ms, sort 106 ms, write 1781 ms, index 535 ms: 4 candidates, 72529 repo-hours, 27 releases; waiting 503 ms; commit 786 ms)
2026-11-07T05:03:58Z [load_day 2026-07-18] 2026-07-18 hour 2: 165146 events in 4 files, snapshot 9056794309159674116 (task 3999 ms: download 1417 ms overlapping gunzip 206 ms, parse 818 ms, sort 108 ms, write 1640 ms, index 410 ms: 4 candidates, 64504 repo-hours, 21 releases; waiting 519 ms; commit 928 ms)
2026-11-07T05:03:58Z [load_day 2026-07-18] 2026-07-18 hour 3: 164564 events in 4 files, snapshot 1692363841351435640 (task 3456 ms: download 1252 ms overlapping gunzip 188 ms, parse 732 ms, sort 101 ms, write 1446 ms, index 296 ms: 3 candidates, 43417 repo-hours, 8 releases; waiting 397 ms; commit 837 ms)
2026-11-07T05:04:02Z [load_day 2026-07-18] 2026-07-18 hour 4: 170574 events in 4 files, snapshot 4949024020841186613 (task 3758 ms: download 1250 ms overlapping gunzip 208 ms, parse 813 ms, sort 111 ms, write 1501 ms, index 290 ms: 2 candidates, 39690 repo-hours, 18 releases; waiting 540 ms; commit 933 ms)
2026-11-07T05:04:03Z [load_day 2026-07-18] 2026-07-18 hour 5: 169479 events in 4 files, snapshot 6793882043337671719 (task 3824 ms: download 1691 ms overlapping gunzip 201 ms, parse 771 ms, sort 116 ms, write 1595 ms, index 273 ms: 1 candidates, 37139 repo-hours, 13 releases; waiting 536 ms; commit 971 ms)
2026-11-07T05:04:06Z [load_day 2026-07-18] 2026-07-18 hour 6: 171477 events in 4 files, snapshot 7825134188091114891 (task 3711 ms: download 1489 ms overlapping gunzip 198 ms, parse 754 ms, sort 108 ms, write 1476 ms, index 271 ms: 3 candidates, 39618 repo-hours, 24 releases; waiting 523 ms; commit 900 ms)
2026-11-07T05:04:07Z [load_day 2026-07-18] 2026-07-18 hour 7: 168682 events in 4 files, snapshot 8486163804508900035 (task 3617 ms: download 1208 ms overlapping gunzip 187 ms, parse 752 ms, sort 101 ms, write 1519 ms, index 234 ms: 1 candidates, 32232 repo-hours, 7 releases; waiting 538 ms; commit 796 ms)
2026-11-07T05:04:10Z [load_day 2026-07-18] 2026-07-18 hour 8: 173291 events in 4 files, snapshot 9145093636532619478 (task 3588 ms: download 1447 ms overlapping gunzip 196 ms, parse 771 ms, sort 104 ms, write 1550 ms, index 225 ms: 4 candidates, 31823 repo-hours, 12 releases; waiting 525 ms; commit 928 ms)
2026-11-07T05:04:12Z [load_day 2026-07-18] 2026-07-18 hour 9: 170179 events in 4 files, snapshot 2380286373642521019 (task 3740 ms: download 1035 ms overlapping gunzip 190 ms, parse 739 ms, sort 107 ms, write 1582 ms, index 245 ms: 3 candidates, 33905 repo-hours, 14 releases; waiting 333 ms; commit 841 ms)
2026-11-07T05:04:15Z [load_day 2026-07-18] 2026-07-18 hour 10: 169080 events in 4 files, snapshot 3331115397006168187 (task 3638 ms: download 1449 ms overlapping gunzip 211 ms, parse 789 ms, sort 103 ms, write 1500 ms, index 265 ms: 1 candidates, 39373 repo-hours, 8 releases; waiting 508 ms; commit 882 ms)
2026-11-07T05:04:16Z [load_day 2026-07-18] 2026-07-18 hour 11: 170069 events in 4 files, snapshot 876895184197847714 (task 3833 ms: download 1500 ms overlapping gunzip 196 ms, parse 777 ms, sort 115 ms, write 1601 ms, index 296 ms: 5 candidates, 44128 repo-hours, 22 releases; waiting 524 ms; commit 928 ms)
2026-11-07T05:04:19Z [load_day 2026-07-18] 2026-07-18 hour 12: 170983 events in 4 files, snapshot 9033219348491602775 (task 3746 ms: download 1468 ms overlapping gunzip 195 ms, parse 768 ms, sort 104 ms, write 1519 ms, index 301 ms: 5 candidates, 41720 repo-hours, 12 releases; waiting 520 ms; commit 1051 ms)
2026-11-07T05:04:21Z [load_day 2026-07-18] 2026-07-18 hour 13: 169475 events in 4 files, snapshot 3606041087516013242 (task 3931 ms: download 1452 ms overlapping gunzip 204 ms, parse 784 ms, sort 100 ms, write 1523 ms, index 370 ms: 5 candidates, 49221 repo-hours, 9 releases; waiting 634 ms; commit 912 ms)
2026-11-07T05:04:23Z [load_day 2026-07-18] 2026-07-18 hour 14: 166768 events in 4 files, snapshot 16816189686839226 (task 3752 ms: download 1144 ms overlapping gunzip 197 ms, parse 781 ms, sort 113 ms, write 1540 ms, index 331 ms: 3 candidates, 47066 repo-hours, 28 releases; waiting 510 ms; commit 842 ms)
2026-11-07T05:04:25Z [load_day 2026-07-18] 2026-07-18 hour 15: 166685 events in 4 files, snapshot 2091275484509047894 (task 3637 ms: download 1313 ms overlapping gunzip 202 ms, parse 778 ms, sort 103 ms, write 1446 ms, index 321 ms: 7 candidates, 48915 repo-hours, 21 releases; waiting 492 ms; commit 917 ms)
2026-11-07T05:04:28Z [load_day 2026-07-18] 2026-07-18 hour 16: 166385 events in 4 files, snapshot 5464418399053190269 (task 3844 ms: download 1604 ms overlapping gunzip 199 ms, parse 759 ms, sort 100 ms, write 1612 ms, index 345 ms: 3 candidates, 52501 repo-hours, 20 releases; waiting 524 ms; commit 966 ms)
2026-11-07T05:04:29Z [load_day 2026-07-18] 2026-07-18 hour 17: 162283 events in 4 files, snapshot 6564008230797229336 (task 3684 ms: download 1144 ms overlapping gunzip 212 ms, parse 756 ms, sort 116 ms, write 1491 ms, index 400 ms: 2 candidates, 53725 repo-hours, 19 releases; waiting 513 ms; commit 1085 ms)
2026-11-07T05:04:32Z [load_day 2026-07-18] 2026-07-18 hour 18: 167943 events in 4 files, snapshot 8776550111356727605 (task 3751 ms: download 925 ms overlapping gunzip 204 ms, parse 768 ms, sort 96 ms, write 1510 ms, index 408 ms: 8 candidates, 59883 repo-hours, 26 releases; waiting 205 ms; commit 1064 ms)
2026-11-07T05:04:35Z [load_day 2026-07-18] 2026-07-18 hour 19: 169662 events in 4 files, snapshot 1701773412002713682 (task 3734 ms: download 1369 ms overlapping gunzip 220 ms, parse 792 ms, sort 105 ms, write 1522 ms, index 448 ms: 6 candidates, 62261 repo-hours, 28 releases; waiting 316 ms; commit 2085 ms)
2026-11-07T05:04:36Z [load_day 2026-07-18] 2026-07-18 hour 20: 164449 events in 4 files, snapshot 7606106122452421499 (task 3573 ms: download 1081 ms overlapping gunzip 199 ms, parse 762 ms, sort 120 ms, write 1516 ms, index 411 ms: 3 candidates, 61696 repo-hours, 18 releases; waiting 227 ms; commit 931 ms)
2026-11-07T05:04:39Z [load_day 2026-07-18] 2026-07-18 hour 21: 169450 events in 4 files, snapshot 7312236329438789035 (task 4211 ms: download 1415 ms overlapping gunzip 204 ms, parse 767 ms, sort 109 ms, write 1629 ms, index 613 ms: 5 candidates, 63012 repo-hours, 26 releases; waiting 551 ms; commit 957 ms)
2026-11-07T05:04:41Z [load_day 2026-07-18] 2026-07-18 hour 22: 168838 events in 4 files, snapshot 3531404105604210204 (task 3991 ms: download 1246 ms overlapping gunzip 208 ms, parse 773 ms, sort 102 ms, write 1543 ms, index 544 ms: 5 candidates, 64702 repo-hours, 64 releases; waiting 521 ms; commit 1013 ms)
2026-11-07T05:04:43Z [load_day 2026-07-18] 2026-07-18 hour 23: 163986 events in 4 files, snapshot 2627389507326671582 (task 3822 ms: download 1654 ms overlapping gunzip 209 ms, parse 792 ms, sort 100 ms, write 1483 ms, index 396 ms: 3 candidates, 62080 repo-hours, 93 releases; waiting 529 ms; commit 852 ms)
2026-11-07T05:04:48Z [load_day 2026-07-18] 2026-07-18: repo_hour merged from 24 files to 1 (1200283 rows, 5353 ms)
2026-11-07T05:04:50Z [load_day 2026-07-18] 2026-07-18: index committed in 6862 ms (24 + 1 + 24 files)
2026-11-07T05:04:50Z [load_day 2026-07-18] 2026-07-18: 4030962 events in 24 hours
2026-11-07T05:04:50Z [load_day 2026-07-18] attempt 1 succeeded