lag spikes in fps

I noticed that on my gtx 970 that with the new 431.60 Nvidia drivers I get lag spikes and my fps is halved. (From 200 to 100) The spikes drop to 20 fps even though my card is barely doing anything. I found that going back to older drivers gave me 200+ fps.