SMITING GOLEMS

I was trying to smite the golems and it wouldn't go off. its happened a couple times. maybe i'm trying to smite the medium golem and i'm not allowed to? and for the trolls, yes, it was off cooldown lol