If we remember back to bloodlust yasuo we know he has a history of abusing keystone masteries. I think fervor needs the direct nerfs.
112 free ad at level 18 that he stacks very quickly is just too much. Make it scale with bonus ad, something like .1 per stack. Lowers bruiser yasuo to about +56 ad (along with significantly crippling him early when he barely stacks ad) and ad yasuo gets increased to closer to +150, a more appropriate risk/reward trade off.
The other thing that has bruiser yasuo being a nuisance is pd. Flat 12% damage reduction on the adc/ap is huge. As it stands now, pd isn't in favor among adc's, most prefer the added safety of range from the rapid-fire cannon over pd. What if, instead, it was something more situationally powerful like 30% dr while cc'ed or even a malzahar-esque passive? Now ad yasuo is a bit safer to engage but bruiser yasuo gets close to no reduction during a prolonged fight, which is what he excels in.
Just some ideas that involve no actual change to yasuo himself.