Fizz Troll pole throught silence

I played a game against Fizz, and i've noticed that even if he's silenced, he's still able to use is troll pole... This is ridiculous.