No matter how much movespeed Hecarim has built up, he's still vunerable to CC (hence Janna best counter against him on a team-scale). Ziggs in particular is easier of the champs you've listed because your satchel charge will completely halt his engage (or at least cut out a ton of the movespeed in the process) and it's pretty easy to determine his direction AKA you. Ezreal is a special case as well because you can run to the nearest wall and blink over it. Whether he ults over the wall after you or runs around is irrelevant since he will have lost the large majority of his movespeed boosts by then.
[Hecarim using teleport] For other mid laners that don't have hard CC or blinks available, you can simply time your damage so that it hits him as soon as he finishes teleporting because receiving damages cuts homeguard passive as well as mobility boots (if he built these). Less movespeed on impact = less damage taken.
[Hecarim using ghost] Unless you have CC to halt his charge, your best bet is to keep wards placed in advance so that you know when to back off.
Sadly, there's not a lot you can do about his ult or him using it to close gaps (as it can't be interrupted afaik), but a defensive item like Banshee's work wonders here.
EDIT: I was under the impression that it was specifically Hecarim top using teleport.