Matchmaking AFK Check Doesn't Disappear

Just happened a couple of times sitting in queue for a normal with my buddy. The queue pops and we both hit accept but if someone else doesn't accept it then instead of disappearing and going back to the lobby while searching it stays there in front of everything and prevents us from seeing the new queue pop.