Can we just remove chilling smite

In answer to your post, no.

Instead of removing Chilling Smite, they need to improve the other ones. Currently, there's a "best" smite, which is a terrible thing from a balance perspective. You get Ranger's Trailblazer if you need the healing, or Stalker's Blade if you don't. If they did something to incentivize getting Poacher's Knife or Skirmisher's Saber, things would be different. People right now aren't just getting chilling smite because they love the CC, it's also because there's nothing else that comes even remotely close in terms of general usefulness.

While we are at it, let's remove flash too, they get out of my range to kill or got in range to kill me.

Heal too please, it allowed them to live when i want to kill them and gave them speed boost to kill me when I tried to run.

Heck, Ghost needs to be removed too, running too fast will cause me to panic so let's remove that.

Let's remove everything that I find annoying :)

Balanced

Challenging smite in actuality is pretty solid on high attack speed tanky champions. I use it often againt the enemy team if they are tanky since in a tank fight it really gives you an edge.

"one of the most annoying smites"

That's some achievement when there's a grand total of four.