So apparently (I'm not sure if this was retconned) but at the peak of the very beginning of Runeterra, powerful magic had to be used in order to shape and alter its landscape [we're not told by who or what, I assume Brandon Beck and Marc Merill], powerful magics that were concentrated in tangible stones called 'World Runes'. Throughout Runeterran history, major civilizations began to discover these World Runes and decided to use them against other neighboring nations. Some World Runes could forge mountains, others channeled oceans, point is, these runes were then weaponized in order to push political agendas.
After the Rune Wars, Ryze decided to search and collect for these runes using only a map given by his predecessor, and hide them from mortal hands. Obviously handling such powers alter human physiology, hence Ryze's blue skin and his longevity.
So yeah, they're practically infinity stones.