Why do minions follow me in the jungle??

It is so frustrating when i get in a lane then leave and the minions follow me for like 5 seconds and then i hesitate turn to kill them the second they turn around then i turn around then they start following me again its r%%%%%ed