Evelynn's Auto's cancel her stealth without having to hit something.
If evelynn right clicks on a minion, even if the Auto Attack didn't go through, her stealth will be canceled and her passive will go on it's 5 second cooldown.
Old evelynn used to do this too but it was fixed.