Speciality Games Mess up the Ping

Sometimes when the special games come during the weekends recently I am unable to play because there are so many people playing the new games that it ruins the ping for the regular summoners rift games. My ping goes from 62 all the way up to 5000. Really makes it hard to play when all I'm doing is trying to reconnect back to the server. This only started a few months ago when they were circling through game modes each week. Know that they are doing it again I can't play summoners rift league all weekend.

Any help here

Thanks