Yorick and Turrets

I was curious as to why Yorick can't use at least part of his q on structures. I get why the damage bonus shouldn't apply, but if Yorick is attacking a turret he has to wait the full duration of Last Rites and then its cool down before he gets a spellblade proc again. Even if it only hit turret as a regular attack but used the ability it would feel less clumsy. I get why it was originally put in place, but it kind've feels like they added some unintended clunkiness by forcing him to keep his q active. I don't know if the balancing team has looked at it at all since Yorick isn't seen very often, so i'm just trying to give the issue visibility.