Majority vote should be enough to surrender at any stage of the game.
You are keeping two people that want to play, playing, at the cost of MAKING THREE people who DON'T want to play, play the game.
Like, holy crap. Why does every damn league game remind me of EVERY group project in highschool?