Why is it that using lenses breaks stealth?
While placing wards doesn't?
Why are sweepers different?
You can place a ward for your team, but you can't do the opposite on the enemy team while stealthed.
You are literally showing yourself to not be seen when those cases happen.