problem with ward clearing

So am i the only one who finds it kind of annoying/unfair that ward clearing is so "bad" unless you have or are a champion that benefits from attack speed items? Like i'll get but since i'm a caster type champion (usually ) it takes like 4-5 seconds to take down a single ward by myself, thus making it near impossible to clear multiple wards with one use or to roam and take out hidden wards. But you get most of the ADC champions and they can pop a ward in like 1-2 seconds. Or you get anyone with a and that ward goes down in a single hit.

I find these to be issues for 2 main reasons; first longer time to kill the ward means more time for the enemy to react and kill you, and while playing a very squishy champion with no mobility you don't really have a counter to this. Second since the support usually runs an (since they have their support sightstone) this just leaves more time for them to be out of position, due to the slow speed of clearing and counter warding.