The hardest part of supporting for me...
...is not setting my own glory moments aside or playing to the role or babysitting what could possibly be an awful adc or being the ward whore, its trusting 4 people I just met with my LP since I know that there's only so many things within my power to do. As the support, I cannot snowball and steamroll my enemy laner, that responsibility is shared with a stranger. So many parts of supporting come down to "Lets roll the dice on these random people because I have the least power of any role in the game".
That is not to say good supports can't have an impact, but out of any roll, they have to trust their team the most to play well. That's the hardest part about support for me.