As Jungle, how do you deal with enemy Lee Sin?

I enjoy jungling, but whenever I see an enemy Lee Sin I know I won't be enjoying myself much. The reason for this is that I don't know really who can deal with him. When I see Lee on enemy team I usually request a leash at my buff to discourage an invade, but I find that sets my back a bit, and it really isn't any guarantee against counterjungle either. The problem is that I can't just wait around for Lee to show up so I am full health like he is, because if he doesn't invade then I just wasted more time. So if I choose to to the buff and he does come, I cannot hope to defeat him. Either he takes my buff or kills me ( usually takes buff because I don't risk fighting him ). He's just so much more powerful than other jungles at this point. My main jungler is kindred, and he counters her by being able to knock her out of her ult, but that's not my main problem. So how do you guys go about dealing with the high possiblility of Lee counterjungling you in early stages of the game? I know everyone's going to say ward, but for one thing, I ward early to prevent a massive team invade and by that point the ward has worn off. Two, even if it hadn't worn off, knowing he's coming might let me know to back off, but even if he doesn't take my buff at that point I still have to wait for him to leave, which sets me behind. And this loss of time never seems to affect lee much because he just ganks early or uses his strong to jungle clear to make up for it. Sorry for text wall but I really don't know what to do vs. him when its my turn to jungle.