Penalization for Client Grouping Glitches

Dear Reader, This is merely a bug report, as the penalties I suffered were mostly inconsequential. Several times in the creating of groups with which to play games, I will invite players, make sure everyone has accepted, and then press start game. When the time comes I click "Accept", as should be done. When I enter the lobby I have no choice but to exit, because for some reason the people who I queued up with are not in the lobby with me? This has happened a couple times and I'm having to wait the penalty time to queue up with my friends only to try again. Please fix this, it's a rather unpleasant experience. Thank you. Sincerely, Spaniard