Cant play ranked with my friend

I am gold 4 and my friend is silver 3 and today we decided to go play ranked together again. We do this quite often and it worked everytime. I played ranked with him like 3 days ago. But when we tried to queue up now it said that the difference in our ranks is to big, while me nor him played a single game since the last time we played together. Anyone know how we can play together again, because this is really weird and annoying.