Gameplay: Red buff patience reset

I was playing a quick custom game to try out Evelynn's jungle clear. After killing gromp and blue buff, I ended up dying, so to simulate how much damage I had after clearing those, I went and stood in the raptor camp for a bit, then moved on to red buff. I tried to position myself so my Hate Spike would go through one of the little ones and red buff, but for some reason, red buff kept resetting, even though neither of us had moved and it was still attacking me.

Maybe this is normal? Not sure if the little one was somehow in the way which was annoying red buff, or if the way the raptors followed me freaked it out, but it was definitely weird. Anyone else experienced anything like this?