Why punish people for not banning/picking a champ?!?!?!

I randomly get "PVP server timeouts" during champ select, which is completely out of my control. When this happens, I am unable to do anything (pick a champ, change masteries, etc..) and yet, I get punished for it in Ranked (e.g. losing LP and promo's). It's freaking champ select!!!!!!! Why punish people during champ select?!?! it makes no sense! Punish the people that ruin the game by raging and trolling, not the people that fail to ban/pick a champion. Failing to pick/ban has absolutely no effect on the game (since it dismisses the lobby anyway). It's understandable to have a time penalty for dodging que, but stop giving a Ranked penalty. Its absolute nonsense