You should make Smite do 50% less damage to a target that has recently been smited by a friendly.
It will nip a lot of problems in the bud before it even begins. This is like the Warmogs and Blackcleavers when they were obviously going to be super OP, but riot was like "Nope".
Just.....listen. Please. Do this suggestion.