Level up Arrows in Inventory

I was just in an ARAM match at Butcher's Bridge, and I noticed that whenever I leveled up an ability, the level up arrows would should up in the 5,6, and 7 slots of my inventory and stay there for a while, and then dissapear. They were sort of transparent, and certainly don't belong there.