Joining a game and then going back to lobby as you are in champ select

When I Go into champ select it kicks me from it . Its still going but I cant like rejoin and its annoying it happends like 3-6 times a day

( example) I will be joining champ select and it kicks me to lobby and then I have to go log off and I get the penalty because I dodged but really i didnt I wasnt in the champ select the whole time. Its really dumb I dont know how to fix it and its happening to other people near me.