Accept Match button glitches out after a game was declined by someone before

So whenever im trying to join a match and someone declines it, and then if it finds a match right after, the accept button will be grayed out and it wont let me press it. This leads to me being put out of the queue. This is hard to reproduce as its only happened to me a few times, but if i remember right thats the way to reproduce it, at least sometimes.