This has ALWAYS been a downside to the kindred's passive. I like to set up ward traps for them whenever Kindred is on the enemy side just because of this. The only things I can suggest to getting around that and maximizing your passive is to take those camps under specific conditions. Some of which are forced and others are of opportunity.
When the enemy jungle is visible somewhere else. Feel free to take the camp, hes busy and your now getting ahead via passive stack.
Gank and force a back on an enemy lane near the hunted camp to give you an advantage and invade. This gives your jungle priority in that section because you can easily force 2v1s. Just make sure your now free farming lane has no problems backing you up.
Finally if your stronger than the enemy jungle you should just be taking these with impunity.