Low Priority Queue Bug

Simply this, I received 5 games of low priority. When I started looking for a match, I was forced to wait 20 minutes before doing so. The problem is when the 20 minutes is done, it forces me out of the queue and then makes me search for a game again. There is no error message, nothing. I just am forced to queue up again. I have to wait another 20 minutes. This goes on and on, pretty much meaning I can never play a game! Is there any way to fix this? Thanks.