Jungle Exp On Smite?

I was thinking to myself today while playing Shaco (yeah, hate me) that it sucks that I am forced to hold onto the jungle item for most of the game because of experience when I got this idea.

I understand that reasoning behind making sure junglers are the only ones getting the proper experience from jungle camps, but it seems unfair for people who prefer to build different items. I find that for Shaco, warrior isn't my preferred or optimal item for my playstyle.

So I was thinking about why Riot put special jungle exp on the item in the first place and remembered the bullshit double jungling and other annoying things laners were doing to get ahead in the early game, but then I thought what if they just moved the special jungle experience onto smite instead? Like, give smite a passive "grants special jungle experience" just like the items. It wouldn't change anything about the game, you can only buy the jungle item if you have smite anyways, so I see no difference from it being a passive on smite instead of the item, and then it would open up more options item-wise for junglers. Yeah most are gonna still get smite items, because they make smite awesome, but this change won't effect anyone who was gonna buy the smite item anyways, and only stands to help niche item builds. Because you can only buy the item if you have smite anyways it's basically the same thing as a passive to smite

TL;DR change the special jungle experience into a passive for smite so people who don't want a smite item aren't forced to hold onto the starting jungle item all game.