I keep Getting LeaveBuster Because someone else disconnects

So recently I've been getting Leavebuster too often and I thought maybe my Internet was bad. But upon further investigation I've noticed that other people have disconnected mid loading screen and it labels me as the one who went afk even though my game loaded up it sill proceeds to label me as the one who went afk. I would rather not want my account to get banned because of the money I put into it so If anyone could somehow help me resolve this issue it would be much appropriated.