Not connecting to the game after accepting.

It's only been happening recently, but when I try and play an ARAM or a 3v3 I will sometimes. Not always, thank goodness, just get put back to the arranging teams lobby. I can hear the sounds of the in game lobby, but don't connect. After the games goes through after champ select, I get banned from games for a period of time. Right now I am sitting on a 10 minute one. Usually this happens when I queue up with a friend or two to play one of the game modes. Sometimes on my own, but its only 3v3 or ARAM. Please help me out here. I don't want to get banned for like a day, and not be able to play.