Late start times

I've been having a repetitive problem when the game will load me in late anywhere between 7 seconds and 7 minutes. I've gotten tons of Leaver Buster low priority ques and lost a bit of LP. I've tried fixing the game with Hextech Repair Tool and it works for awhile until it starts happening again. Lag report also doesn't show anything being wrong.