Low priority queue!

So I was placed in low priority queue a few times, sometimes because I simply rq or my connection snaps. But the question is will I ever have less than 20 minutes of low priority queue? It gets frustrating when it is clearly not my fault. Every couple of months I get 5 games of 20 minutes waiting time. Shouldn't that decrease over time?