Friend In Game But [Client] Shows As Available Sometimes

Their name should be blue (to show in game) and I should not see an add button from lobby to add them to the game as they are already in game. If you attempt to add them, they just can't be invited.