Jayce on ARAM

I was playing Jayce on ARAM earlier and half the time when I autoed the inhib or nexus, I would do no damage. The text wouldn't pop up and the health bar wouldn't go down at all. I was able to do damage when there were no minions auto attacking it but I did nothing when the minions were.