Client Bug
This is the second time it has happened, so I figured I'd say something about it. When I am in the queue, it doesn't prompt me to accept or deny games and the timer just runs. Then I restart the client and it says I have denied games over and over, and have a 5 minute wait.
EDIT: This happens even with a duo partner as well. Because he asked why I denied it.