Rammus powerball will stop before impact on Krugs and other camps

This happens to me maybe 10 percent of the time when I am trying to powerball into a camp. Rammus will just spin next to the camp and not actually make contact with it until his q is over. I am physically clicking onto the camp but it won't make contact.