smite doesnt affect aphelios turrets

I tried smiting a aphelios turret, since its a pet like a zyra plant or a heimer turret, but while i could hit it and it did go on cd, it didnt do damage/destroy it. it should either damage the turret or not target it and not take my cd, you cant have both