Overall damage is too high
I feel like the current suite of keystone masteries are mostly to blame, along with Double Edged Sword. Most of the good keystones are entirely offensive in nature and when they added the infernal drake damage buff but they didn't add any that increase your combat surviveability.