Very small random packet loss

So i started to use qos to play league since I share the internet with a lot of people, but I randomly once or more per game, dc for a second or two, normally when I'm csing, and I die because of it. I've dced walking after getting a kill on zed for a second come back and I'm under tower dead, giving zed the lead when I actually beat him bad early. What can I do besides turning off QOS to fix the 3% packet loss? My brother dcs for a second the same time I do, and without QOS my ping will be too high to play properly because my internets garbage DSL. I am not really sure what is causing the packet loss, and it really ruins most of my, and my brother's games, and will probably be a major reason I quit league. Can't rank up with this happening. I'd also like to point out that, sometimes, but not always I lag incredibly bad after the 1 second dc for up to 2 minutes, or a couple seconds, completely random.