Never thought about my Masteries before

I always assumed they were just a ranked thing, so I just randomly picked them as I leveled. Now I'm informed they actually affected me in normal games. And now I'm a little scared about messing them up. Wish I'd have remembered to check my old mastery page every now and then...