Random Gain and Loss of Influence Points

So the title really says it, but recently, for the past two weeks I have logged in and had less IP than I did the night before, around a loss of 200. Then sometimes it goes higher than I had originally, by a bit. I will try and get some images, but it would be hard to prove. Also I am very certain I am not buying anything!