Should saying no to remake be allowed?

So I recently played a game (it was on pbe but it has happened in live games too) where 1 person doesn't connect. no biggie just remake. but why are people allowed to decline the remake? it's a 4v5 there's a slim chance (if any) that you are going to win so why waste 20 min+ when you could be out in 3. somebody explain?