Theory: Could Jax once have been a mage?

So before anyone says anything about my theory understand it's just something I thought and it isn't at all fact. So could Jax once have been studying to be a mage that uses magic that improves normal human abilities since we don't really get an explanation as to how he is able to empower his defense, offense, and attack speed. I personally think that he once planned on being a mage but when he got into a fight with another mage he either killed or seriously hurt them and then he ran off covering himself in the cloaks and such so no one would recognize him and began using basic weapons and soon became a master along with using his magic to empower himself when he uses his weapons. Or I could just be blowing thin smoke but whatever that's just a theory I thought of nothing more, nothing less.