Actually part of the issue is that his Q has a way of getting next to NO CD by that last bit in it's text, "basic attacks reduce the CD of Alpha Strike by 1 second" When you have a passive that gives you 2 Basic Attacks every 4 hits, and you have a champion that already wants to get as much Attack Speed as they can, then you have a very easily reduced CD on Q. Removing that 1 feature from it would make his tower dives a lot less free kills for him and make it more a factor that he'd have to change out an item for something to get CDR, though it's easy enough to get max CDR on Yi by building an Essence Reaver or by building the usual build of Death's Dance, IE, Duskblade, Black Cleaver, Boots, Phantom Dancer.
That would give you the 50% crit, the 50% bonus Crit Dmg, and 40% CDR, bringing that 14 second CD down to 10 and with 3 strikes you get a total of 4-6 seconds off that, depending on Attack Speed and how many seconds, 2-3, it takes to make the 3 strikes. If you get Double Strike stacks from W then you have even less of a CD on that Q. With how it makes him untargetable it is a massive buff to his kit for being able to STAY under Turret and kill even most Tanks. If you could make it where the Turret still targets him, as he'd just done damage to a Champion under Turret range, but have it hold attack until his Q finished and instantly fire like it does when you step in front of your minions and get in range of it first, then you would have a way to defend yourself under Turret and keep his dives from being Staying In fights under Turret.
The odd thing is there is 1 champ that can shut down a Yi, however I have noticed 1 BIG issue with his Q. If you have a Teemo on the team and a Yi comes to him, Teemo fires his Q off to Blind, Yi Qs and the ALREADY FIRED TARGETED ATTACK connects, but DOES NO DAMAGE OR BLINDS. Now I can understand his Q dodging a skill shot, something that has to hit the Champion before Damage is dealt. However a Direct Targeted skill should still hit and effect as it was done before his Q was started, just like when you Flash but it still follows and hits you. Either add that same ability to Flash or take it away from Yi's Q.