You know what's worse than teammates who refuse to surrender? Players who don't vote at all.
It's one thing when your teammates are all "No, we can still win this" or "I'd rather be shot to death than surrender in a game", but when another player tortures you by leaving that bar to drain down when it's 3/1, that's just being a douche.
As for other reasons why non-voters suck, I'll just refer you to the South Park episode "Douche and Turd".