I honestly cant handle Vayne

Many instances where Vayne has just carried once she got her core at 25 minutes. She just snowballs so well. Can anyone give me tips? I would encourage my team to focus her and we would get so many ults but she alone would go invisible, no counterplay, and just peel for herself with e and run away from everything with a 2 second cooldown Q and shred our tanks with her true damage and raw ADC items. As well as a whole other team of people even if we manage to get her, which is in very rare cases as almost every Vayne I play against never gets caught. Does anyone have any tips to help me counter her? I have tried thornmail+Ninja tabis and randuins and I would still get shred. Please help so I dont have to perm-ban her.