Is it time for a Baron Nerf?

Earlier today I was in a game playing as Syndra mid. Everything was going very well for us. I was 6/2/3 at about 20 minutes in, and decided that Yasuo was not imposing much of a challenge to me, so I looked to see what I could do to step my game up a notch. Around me I noticed a few purple caster minions. I decided they would be too easy and not worth the effort. With their top lane dead, I looked to bot lane. Unfortunately, the circumstances were not ideal, as our team was pushed too far forwards for a gank. I was also not able to take dragon because of the sub par warding in the area. I then remembered that baron had just spawned. I realized that now would be the perfect time because I needed only 150 more gold for my rabadon's deathcap. I quickly made it to baron while the rest of my team was distracting the enemies in bot lane and started attacking him. Somehow baron was able to have over 3 times as much health as our Olaf, which kept him alive and made my magic damage seemingly disappear. Baron also had multiple poisons and knock-ups. Baron was able to kill me, which was weird because of how far ahead I was. I think that baron should be nerfed, because of how he is so tanky and powerful compared to me (which I was fed) at the 20 minute marker.