Punished for Pushing Accept?

I've noticed a very disturbing trend.

If you que up for a game and you press accept after someone else has backed out or pushed decline ( usually around the 4th time) You have a super high percentage of being auto filled. While I personally do not mind being auto filled I feel like it is kind of lame to force autofill on someone who is vigilant and active and who always presses accept. Shouldn't you instead increase the auto fill percentage on those who back out or push decline instead of those who are vigilant and promote games actually starting.