Dragon/baron

Why is it that these two objectives are so weak? I'm seeing junglers solo dragon at level 3/4 and I'm seeing baron killed a min after 20. For the huge advantage that they provide they sure are easy to kill. As a jungler I'm basically forced to ignore my top lane at the 5 min mark, otherwise the enemy jungler can easily sneak it in in the 30 seconds I'm up there