I'm actually more annoyed their glamour seems to be a conjured spell not an innate ability but that's beside the point.
Thinking, Xayah mentions something too. Her quotes towards Yordles is "Yordles are the reason no-one takes us Vastaya seriously." She also generally dislikes them. I'm half wondering why. What exactly happened that made Yordles have to hide their true appearance from baseline humans? If they are truely in danger from them, why reside there at all? Heimer, Poppy, Ziggs, Kennen and Kled all choose to live in human society knowing the risks?
It can't just be because Veigar is off being evil somewhere.