Baron in URf.

So everytime my team gets Baron I cant click anything. I can only cast spells. so as long as im not an auto attack champ im fine. but if im Xayah, master yi, Etc. Im kinda boned. and so far its just me. Im not if its only me or if others have it too. But every game we get baron it stays like that until the game ends.