Cant Leave the Lower Priority Queue

This message keeps popping up saying that I am in a lower priority queue and there is a button that says leave queue, but every time I click it and try to join another game I am back in the lower priority queue. Rito please fix.