Looking at the match, it appears that:
- Their team was primarily physical damage, so your team could just stack armor (not sure why you bothered with Spirit Visage instead of getting Warmog's Armor or Thornmail, but whatever)
- Their Zed fed your Yasuo like crazy
- They didn't really have any convenient way picking out people on your team while you had Wither and Dark Binding
- Your team had better vision control
So basically, their team wasn't really able to prevent your team from stalling the game long enough for you to become useful again. Considering their team had no teleport, they couldn't really stop you from splitpushing without sacrificing other objectives to your team and your teleport pressure.