orcaLog in

Runs · run 605

load_day 2026-04-30, attempt 1 succeeded

Host
4e84322b8c45:136567
Started
2026-11-07T06:52:43Z
Ended
2026-11-07T06:53:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/605/load_day/2026-04-30/1.log
Code
pipelines/gharchive.mojo:97

Log

2026-11-07T06:52:43Z [load_day 2026-04-30] attempt 1 started
2026-11-07T06:52:52Z [load_day 2026-04-30] 2026-04-30 hour 0: 148527 events in 3 files, snapshot 1988267258344122889 (task 6359 ms: download 2362 ms overlapping gunzip 431 ms, parse 1424 ms, sort 217 ms, write 2838 ms, index 504 ms: 7 candidates, 71711 repo-hours, 883 releases; waiting 524 ms; commit 1087 ms)
2026-11-07T06:52:54Z [load_day 2026-04-30] 2026-04-30 hour 1: 155435 events in 4 files, snapshot 1437609305584365305 (task 5896 ms: download 1833 ms overlapping gunzip 358 ms, parse 1218 ms, sort 157 ms, write 2804 ms, index 541 ms: 11 candidates, 80343 repo-hours, 614 releases; waiting 529 ms; commit 1213 ms)
2026-11-07T06:52:56Z [load_day 2026-04-30] 2026-04-30 hour 2: 100458 events in 3 files, snapshot 4082077691582610738 (task 3255 ms: download 1194 ms overlapping gunzip 170 ms, parse 604 ms, sort 70 ms, write 1198 ms, index 400 ms: 5 candidates, 62507 repo-hours, 230 releases; waiting 512 ms; commit 1222 ms)
2026-11-07T06:52:58Z [load_day 2026-04-30] 2026-04-30 hour 3: 73444 events in 2 files, snapshot 1217514295415515501 (task 2887 ms: download 1107 ms overlapping gunzip 163 ms, parse 567 ms, sort 72 ms, write 990 ms, index 289 ms: 3 candidates, 45564 repo-hours, 247 releases; waiting 524 ms; commit 1771 ms)
2026-11-07T06:53:02Z [load_day 2026-04-30] 2026-04-30 hour 4: 75213 events in 2 files, snapshot 6281934921056420594 (task 2890 ms: download 975 ms overlapping gunzip 172 ms, parse 569 ms, sort 73 ms, write 1226 ms, index 286 ms: 3 candidates, 42776 repo-hours, 315 releases; waiting 252 ms; commit 3185 ms)
2026-11-07T06:53:03Z [load_day 2026-04-30] 2026-04-30 hour 5: 75772 events in 2 files, snapshot 5332643034367453033 (task 3098 ms: download 1066 ms overlapping gunzip 191 ms, parse 668 ms, sort 73 ms, write 1094 ms, index 299 ms: 7 candidates, 44918 repo-hours, 288 releases; waiting 536 ms; commit 1000 ms)
2026-11-07T06:53:04Z [load_day 2026-04-30] 2026-04-30 hour 6: 72290 events in 2 files, snapshot 5035912510725034678 (task 2775 ms: download 952 ms overlapping gunzip 144 ms, parse 495 ms, sort 50 ms, write 960 ms, index 312 ms: 3 candidates, 43949 repo-hours, 164 releases; waiting 524 ms; commit 1279 ms)
2026-11-07T06:53:06Z [load_day 2026-04-30] 2026-04-30 hour 7: 79543 events in 2 files, snapshot 4804755494420105830 (task 2731 ms: download 1056 ms overlapping gunzip 127 ms, parse 460 ms, sort 60 ms, write 877 ms, index 384 ms: 6 candidates, 49045 repo-hours, 104 releases; waiting 523 ms; commit 1109 ms)
2026-11-07T06:53:08Z [load_day 2026-04-30] 2026-04-30 hour 8: 86602 events in 2 files, snapshot 610786236281742858 (task 2906 ms: download 1152 ms overlapping gunzip 153 ms, parse 511 ms, sort 57 ms, write 995 ms, index 342 ms: 7 candidates, 54016 repo-hours, 104 releases; waiting 533 ms; commit 1269 ms)
2026-11-07T06:53:10Z [load_day 2026-04-30] 2026-04-30 hour 9: 85108 events in 2 files, snapshot 1061507012048190942 (task 3066 ms: download 1246 ms overlapping gunzip 155 ms, parse 522 ms, sort 69 ms, write 1069 ms, index 407 ms: 2 candidates, 53057 repo-hours, 129 releases; waiting 548 ms; commit 1225 ms)
2026-11-07T06:53:11Z [load_day 2026-04-30] 2026-04-30 hour 10: 80178 events in 2 files, snapshot 7879941102095309775 (task 2615 ms: download 936 ms overlapping gunzip 129 ms, parse 460 ms, sort 58 ms, write 753 ms, index 286 ms: 3 candidates, 42398 repo-hours, 61 releases; waiting 551 ms; commit 1025 ms)
2026-11-07T06:53:14Z [load_day 2026-04-30] 2026-04-30 hour 11: 82781 events in 2 files, snapshot 8164533537521507752 (task 2708 ms: download 947 ms overlapping gunzip 132 ms, parse 486 ms, sort 56 ms, write 829 ms, index 379 ms: 5 candidates, 46656 repo-hours, 56 releases; waiting 522 ms; commit 957 ms)
2026-11-07T06:53:15Z [load_day 2026-04-30] 2026-04-30 hour 12: 82789 events in 2 files, snapshot 807187917655500980 (task 2644 ms: download 960 ms overlapping gunzip 127 ms, parse 448 ms, sort 56 ms, write 846 ms, index 336 ms: 4 candidates, 51214 repo-hours, 62 releases; waiting 537 ms; commit 1278 ms)
2026-11-07T06:53:17Z [load_day 2026-04-30] 2026-04-30 hour 13: 78736 events in 2 files, snapshot 7660643404990468513 (task 2600 ms: download 935 ms overlapping gunzip 116 ms, parse 412 ms, sort 55 ms, write 821 ms, index 347 ms: 6 candidates, 52558 repo-hours, 51 releases; waiting 543 ms; commit 1036 ms)
2026-11-07T06:53:18Z [load_day 2026-04-30] 2026-04-30 hour 14: 84162 events in 2 files, snapshot 1536360473196179567 (task 2633 ms: download 1094 ms overlapping gunzip 125 ms, parse 436 ms, sort 57 ms, write 864 ms, index 346 ms: 4 candidates, 53215 repo-hours, 52 releases; waiting 534 ms; commit 1129 ms)
2026-11-07T06:53:21Z [load_day 2026-04-30] 2026-04-30 hour 15: 85215 events in 2 files, snapshot 6541285349169003007 (task 2675 ms: download 1010 ms overlapping gunzip 130 ms, parse 462 ms, sort 66 ms, write 863 ms, index 393 ms: 5 candidates, 52783 repo-hours, 57 releases; waiting 544 ms; commit 1086 ms)
2026-11-07T06:53:22Z [load_day 2026-04-30] 2026-04-30 hour 16: 89905 events in 2 files, snapshot 6596979026109539248 (task 2767 ms: download 970 ms overlapping gunzip 136 ms, parse 478 ms, sort 72 ms, write 901 ms, index 330 ms: 8 candidates, 49928 repo-hours, 39 releases; waiting 526 ms; commit 1277 ms)
2026-11-07T06:53:24Z [load_day 2026-04-30] 2026-04-30 hour 17: 92001 events in 2 files, snapshot 772521606519566484 (task 2712 ms: download 1083 ms overlapping gunzip 122 ms, parse 495 ms, sort 64 ms, write 874 ms, index 371 ms: 5 candidates, 47631 repo-hours, 52 releases; waiting 501 ms; commit 1244 ms)
2026-11-07T06:53:25Z [load_day 2026-04-30] 2026-04-30 hour 18: 89065 events in 2 files, snapshot 8724515932567807082 (task 2867 ms: download 1101 ms overlapping gunzip 152 ms, parse 544 ms, sort 69 ms, write 1008 ms, index 333 ms: 9 candidates, 49729 repo-hours, 95 releases; waiting 494 ms; commit 1109 ms)
2026-11-07T06:53:28Z [load_day 2026-04-30] 2026-04-30 hour 19: 88997 events in 2 files, snapshot 6544437893174066214 (task 3076 ms: download 1218 ms overlapping gunzip 152 ms, parse 517 ms, sort 73 ms, write 1149 ms, index 381 ms: 10 candidates, 54082 repo-hours, 119 releases; waiting 542 ms; commit 1193 ms)
2026-11-07T06:53:29Z [load_day 2026-04-30] 2026-04-30 hour 20: 87234 events in 2 files, snapshot 7638356515038388891 (task 2856 ms: download 754 ms overlapping gunzip 181 ms, parse 610 ms, sort 73 ms, write 1141 ms, index 354 ms: 7 candidates, 52274 repo-hours, 215 releases; waiting 185 ms; commit 1476 ms)
2026-11-07T06:53:33Z [load_day 2026-04-30] 2026-04-30 hour 21: 87702 events in 2 files, snapshot 5532808881028786028 (task 3785 ms: download 1467 ms overlapping gunzip 212 ms, parse 704 ms, sort 95 ms, write 1633 ms, index 317 ms: 8 candidates, 50339 repo-hours, 317 releases; waiting 525 ms; commit 1225 ms)
2026-11-07T06:53:34Z [load_day 2026-04-30] 2026-04-30 hour 22: 91523 events in 2 files, snapshot 4332865476727879428 (task 4083 ms: download 1773 ms overlapping gunzip 232 ms, parse 762 ms, sort 72 ms, write 1834 ms, index 322 ms: 4 candidates, 51349 repo-hours, 380 releases; waiting 579 ms; commit 1652 ms)
2026-11-07T06:53:38Z [load_day 2026-04-30] 2026-04-30 hour 23: 91291 events in 2 files, snapshot 7222480982811475584 (task 4383 ms: download 2031 ms overlapping gunzip 273 ms, parse 902 ms, sort 96 ms, write 1697 ms, index 312 ms: 7 candidates, 49746 repo-hours, 611 releases; waiting 761 ms; commit 1272 ms)
2026-11-07T06:53:43Z [load_day 2026-04-30] 2026-04-30: repo_hour merged from 24 files to 1 (1251788 rows, 5693 ms)
2026-11-07T06:53:45Z [load_day 2026-04-30] 2026-04-30: index committed in 7707 ms (24 + 1 + 24 files)
2026-11-07T06:53:45Z [load_day 2026-04-30] 2026-04-30: 2163971 events in 24 hours
2026-11-07T06:53:45Z [load_day 2026-04-30] attempt 1 succeeded