Not able to change game modes

I can't switch my game modes unless I join another party in a different mode. I Try to click on the icon and nothing happens.