CLIENT Not responding and unable to load game when champion select is finished

Almost every time, unless I restart my computer, the Client always goes "Not Responding" and to force quit it and reopen LoL Client again and Log in and reconnect. Which as it turns out I got put into the low Priority ban recently due to this problem.