Draven Axes Cancelling

1. Proc Spinning Axe [Q]
2. Auto attack creep/champion
3. Axe does not proc off the target and you lose the stack of Spinning Axe

Happened a couple times in a row and was wondering as to what was happening until I payed closer attention and saw I was losing stacks without actually dropping the axe.