Cannot stop chat from auto joining on startup

I joined a chat room in the league client a while ago and even if I uncheck auto join on startup it still joins every time I sign in