Only count the people that voted in a surrender vote.
"Your surrender vote failed 2-1 because two people didn't vote. Enjoy being stuck in this match longer than you wanted to."
If someone doesn't have the balls or the capability to click a fucking yes/no button then don't factor their numbers into the deciding vote. 2-1 is a majority vote regardless of how many people are active in the match. If they don't want to surrender they can take a fraction of a second and press a button. Otherwise, fuck them.