Premade Group Reappearing After Creating New Game

After a game with a group of premade people, if you try to create a new game, they automatically appear in your lobby even when they aren't actually. If you kick them it says "Error, sent something to server" and then when you try to reinvite it says "You have banned this person, reinvite?" for every single person. Please fix this as it is causing me and 2 others im playing with to have to relog in-between every game >.<