Surrendering

So why is it when you surrender that if 3 people say yes and 1 person says no that we dont surrender even though they technically have majority? how does that one person not voting make it so people cant surrender? i have thought about this before but i was wondering what other people thought about it.