Changing Routers Mid Game Can't Reconnect

So, for whatever reason, the router I am using goes through some weird cycles of slowing to a crawl. I found a work around by using two routers. So, every now and then my game will just jump from 18 ping to 180,000 ping, which I can fix by switching to my other router, but it forces me to close out of the game entirely and reopen it.

TL:DR: Switching routers mid game forces me to close and reopen everything.