If you think that Frozen Heart only reduces a Dagger's worth of attack speed, then I would suggest looking into how attack speed increases and slows actually work.
http://matchhistory.na.leagueoflegends.com/en/#match-details/NA1/1916915686/39581772?tab=overview
If your team let a jungle Vayne farm until she had Sated Devoruer and Blade of the Ruined King without setting her or her team behind, then your teams royally screwed up.
Vayne does do mostly physical damage. You simply stacked enough armor to reduce her physical damage significantly and she didn't build AD or crit chance heavy (building Devourer and Blade of the Ruined King). If she doesn't itemize of physical damage then she obviously isn't going to deal as much physical damage.
That jungle Vayne somehow managed to outfarm everyone on your team except your Jinx. Considering how far ahead she was in gold from killing you several times early, she'd have an item advantage for most of the match.
No one on your team had Oracle's Lens and you, personally, didn't buy any Pink Wards or the Greater Vision Totem. Thankfully your Leona bought pink wards to hinder Vayne's invisibility.