Where are my group folders?

I disabled group by games and servers, which shouldn't have been enabled by default anyway, and my folders are still gone. Do I have to make them again?