Getting kicked out of queue when a friend invites me to a game.

I play a lot of Dominion and my queue times are usually at least 5 minutes.

The last 2 times I've been in queue, around 8 minutes in, a friend invites me to a game and it automatically drops me from my queue. Very annoying.