When in doubt, back off. Even if you get a bit behind, your teammates will be aware of the invading enemy's position and can all possibly collapse into that area and kill the invader.
If there's really nothing that you or your team can do (and if it's the start of the game this seems unlikely), then just do the same thing back to them; if they're taking YOUR jungle, then there's a very high chance that nobody is in theirs; go help yourself to some nice, tasty Krugs or even a blue/red buff it it's still there.
Unless they have a fast clear speed and you have a low clear speed (i'm pretty sure Kindred can clear camps pretty quickly -- i never jungle), then this should work. Best of luck!