Does *declining* a match have any negative effect on the player?

I hear dodging a match gives a small LP loss and a timer, but does simply declining the match when the circle pops up have any negative impact?

Thanks for any responses.