Nobody wants to see first turrets staying up until 30 minutes in just because a Sivir is clearing all the wave.
This would make a few champions, notably Maokai right off my head, quite less significant than what he is right now. Not all fights are done in turret-less grounds. Teams need to seize the opportunity and have a tower dive fights here and there, and this is what certain champions excel the most at.
If you think you're gonna get tower dived and beaten badly, LEAVE the tower.
edit: if your entire team is at the point where "we lose fights even if we fight under tower full 5v5", then you probably screwed up your early game, or your team composition is horrid and the win was well deserved for the enemy team.