Rotating Game Modes

I would like to see more summoners playing the RGM's such as Ascension, Doom Bots, Invasion, etc. because every time I queue to play these modes, it takes 4+ minutes to find a game. When I do find a game, especially with the current Ascension, players leave champ select and I go right back into queue for even longer. The rotating game modes are a lot of fun and they give me and other players a chance to work on more specific parts of the game, but it seems like people do not take these modes as seriously as the Rift. If there is any way to make these modes more appealing or even penalize summoners who leave champ select early, that would be appreciated.