I realize the damage from his E scales with AD, but it applies on hit making it scale with AS as well, and red buff and smite both also apply true damage.
Zhonyas is always conditional. Sometimes that's great for avoiding Yi, sometimes you are delivering yourself on a silver platter.
A lot of what you are suggesting is assuming you are either more mobile than one of the fastest characters in the game who has a point and click gapcloser, or can out damage one of the most high damage hyper carries in the game. Both are possible but difficult and it seems unreasonable to assume you can.
I get that he's not completely unstoppable, but he has so many more options for dealing with you than you do for dealing with him. I just think that if you have multiple people on your team who want to shut him down they should have more options to do so.