That is because Fizz's kit is toxic in general. He is like Lee Sin: no matter how much the numbers are tweak, his abilities are simply just one sided and unfair.
In terms of the level of frustration playing against Fizz, I would rank him higher than Zed and slightly below Riven. I've personally played Fizz myself, and it honestly doesn't take any extensive knowledge of LoL to see that he is OP. His % missing health dmg on W and 20% dmg amplification on his ult gives him as much damage as any other brusier. In addition, his E is one of the best defensive ability in game, capable of negating entire ultimates on a 5 second CD.
There are obviously situations where he is countered, but in general, he is a very good champion.