Leaving Game During Champ Select, and Game Still Starts

This doesn't happen often but a few times where I left champ select because people were very negative or trollish in the pregame chat or because I realized I had to leave, or left to switch game modes (way BEFORE LOCKING), and then I'll come back and notice it says I'm still in the game or that the game went on without me and caused me to be AFK.

LeaverBuster punishment for this is fine, but starting the game after I left (reminder, WITHOUT LOCKING) is not okay. It screws over the other 4 players when that wasn't my intent, and causes even harsher LeaverBuster punishment than I deserved. There's already enough AFKs this doesn't help with the problem.