Please stop punishing me for declining Queue. It is so pointless.

I do not decline queue randomly or to mess with people. When we're in champ select and we make our picks/bans, someone leaves, and I'm left in a Queue that even when I click to leave from it, it still finds a game and makes me have to decline it. Accepting a game where they know my pick and ban is putting me at a disadvantage, so I want to have a whole new 9 people in the game. Thus, I decline the queue. Now I'm on a penalty timer for just not accepting queue??

That's so dumb and pointless. I get the penalty when leaving in champ select, but declining queue? Seriously?