Why are Yorick's ghosts so hard to click

Seriously.

If I click them like any other minion, I start walking to that spot instead of attacking. They're ridiculously hard to click, particularly among minions, making it pretty frustrating to lane against him.