How do you play against rift herald?

Aside from "don't let them have it."

If the winning team has rift, there's a 95% chance they got a free tower. And if the team's advantage is pressed so far the chances of coming back are so low. A lot of my 25~ minute games have been one sided by way of towers. With numbers like 11-3, 10-0, 11-3, all with rift herald slain being on the favoring team. I get it's doing it's job, but I don't get how to stop it. It's power is so high it forces the team to stop whatever they're doing and drag themselves to the heralded lane. And that alone can equal two more towers from the pushing champs in the other lanes.

That's 300 gold, 600 if first tower. but more importantly, that tower isn't coming back up. And the amount of map pressure that's gained for doing so little is absurd to me. I don't know how to stop it, especially when behind.