Frame drops while in-game sound is on

Howdy. I've noticed over the past couple days setting my sound option to "Disable all in-game sound" eliminates nearly all fps drops I have with the game. However, it's very unpleasant and a handicap to myself to not play with any sound.

Is there anyway I can fix this?