Server kicked me out

I was just in a game where I had to AFK because even though I had low ms, (I checked my connection, everything is fine) the server and client would "glitch out" to the point of me having to restart, did it several times, only worked long enough to get to the enemy tower where i lagged out AGAIN... I restarted, it finally worked, but only at the END OF THE GAME where I was forced to lose. This is not fair, this has happened to me before, it makes me sick to think this happens to untold amount of people, unfairly causing them to lose a game or worse, get banned. This is an outrage that should be dealt with.