Forfeit System

I think the forfeit system in place now is rather annoying and needs to be changed. Currently if 4 players want to surrender at 20 minutes they can do that, regardless of what the fifth player wants. So many times in my low elo games i'll be doing well top lane and believe that I am capable of carrying certain games and my team just surrenders. Sometimes we won't even be down a lot, or our team comp is way better for team fighting or late game. However we never even get the chance to group and try or anything cause they just ff at 20. I think that in order to forfeit at 20 minutes you should need all 5 members to agree otherwise they should move it back to like 30 minutes for 4 members or something.

I've legit just stopped playing with some of my close friends because they always surrender and give up and it pisses me off. What do you guys think about this? And what other methods could be implemented to solve it? (perhaps 4 votes still but the player with the best KDA/highest amount of gold needs to vote yes also, as opposed to just a group of players doing poorly?)