It might not be too bad if there is no indication of who people are queue'd with. The players would have no indication of how many votes they needed to kick someone and they will be re-queued to wait for a new group afterwards anyways. If they wanted, they could just display how many people voted to kick the player out of n-1 in every case, treated it as it every member queued with the player being kicked voted to kick them.
Note that this is all assuming that there are no punishments associated with being kicked from a queue. If there were, then premade groups could easily queue for games and kick players from champion select as a method of trolling. I think it would work best if it were just a method of cancelling the queue without penalizing a specific member.
However, this could also be abused in ranked for a method of cancelling games if you don't like the team compositions without any member of your team being punished.