It's better when they are being toxic and then they see you doing your blue, they begins walking towards it...You wait until the last moment and you smite it :I
its allot like when your dumb ass adc overextends like hell
than expects you to turn enemy ganks into triple kills while not backing off when you ping him that the enemy jungler is coming
and gets mad for you not turning that gank into a triple kill
right ?
By refusing to gank you are 1. Also being a dick, and 2. Giving him a reason to be toxic to you.
Don't be a noob. You signed up to be the jgler, so go do your damn job.