This is gonna come off toxic because its so overused and usually used in a toxic context -- but I assure you I mean no offense.
Get good.
No seriously, once you figure yi's kit out, its pretty easy to play around. Don't blow any gap closers or hard CC until after he alpha strikes. Don't blow big cooldowns on him while he's meditating. Don't try to run away from him when he's ulted.
80% of the problem players have with yi is that they've never played yi and don't know what yi does. Learn his kit. Play 20-30 games as him, figure him out.
Low elo yis carry games because people have dog shit positioning and leave themselves open for him to just come in and clean house. Low elo players over extend in lane, don't leave themselves an exit, stick around for WAY too long with low health and no flash, etc etc blah blah blah, the list is long.
Low elo players burn all their cooldowns right at the start of a teamfight trying to get the 100-0 wombo combo all on one or two targets, rather than using their skills efficiently throughout the fight, and leaving one or two big CC cooldowns just in case they need to disengage or peel.
That's where Yi thrives. When all the CC is burned and the fight devolves into people chasing each other with auto attacks and half-healthbars.
A good yi knows he doesn't need to be in a fight until basically after its over. He's the janitor. The cleanup crew. When everyone's blown their load and nobody's got anything left, Yi goes in to an all you can Yi buffet.
So the answer is "Get good."
Don't blow all your shit right at the start of the fight. Don't over extend. Build some armor. Know Yi's kit so you know how to exploit it and outplay it. Don't hang around with 20% health. Don't chase.
Basically don't invite yi to come screw you over, and yi won't come screw you over.