Punished for games not loading?

Every once and a while after I click on accept or decline when in que for a game, the game doesn't take me to lobby and says a game isn't found or it goes to a black screen with nothing going on. When I press play again it says i have to wait 5-15 mins for abandoning games but I never dodge or decline games. What is with this punishment for me doing nothing wrong?