Click on accept game and I was accepted, but then time ran out and I was punished

After clicking "find match" I was put into the match teams (my timer bar was completely filled and I couldn't click on accept). Then after the timer ran out I was told i had abandoned the match queue accept by not clicking on the accept button. I was punished for a time because of this. Seems like it happens pretty often when you click accept almost every time.