While it is true that part of the blame would be on the Jungler to not take advantage of them camping you, the other part would of been on you. After you died a few times, usually I'd say 3 times then it's way to risky for your Jungler to come in and try to force a 2v2 fight since the enemy top laner & jungler are both a lot stronger then both of you and can easily win that fight. The only case where you 2 would actually win the 2v2 fight was if they tower dived both of you, in which case it matters on individual skill + luck since Elise is pretty good at tower dives due to her rappel.
As I said, part of the blame is on your jungler for not camping one of your other lanes or taking towers/dragons or even just counter jungle Elise to at least do something. The fact that you said Udyr and that he was afk farming, I'm guessing he was going Devourer which generally means he will be afk farming and it gives him a right to do that...though he has no excuses not to take dragons or rift heralds.
The other part of the blame was on you. I'm assuming you were just normally fighting your lane opp and Elise jumps out of no where and ganks and you die for the first death. Situation like that is no ones fault, maybe your ward ended right before she arrived or you were to busy fighting them to realize Elise is there, everyone makes those mistakes. On the second gank and death you should start to play passive and ward the bush behind the tower next to you and just farm under tower. After Elise's first dive and possibly your 3rd death, I would just completely avoid that tower and let them take it and just farm at your 2nd tier tower...since it's harder for them to dive a tier 2 tower. The reason why Elise kept ganking you was probably because you might not of ever left your tier 1 tower and Elise is a very good champion to dive with since she can reset her tower aggro.
I would of just avoided the towers and tried to farm something safely at the other towers after a 3rd death. Or you could of just roamed to mid or bot lane and tried to help those lanes out.