Does Fervor of Battle count toward Master Yi's new E passive?

No, it doesn't. Fervors damage is on hit physical proc damage and doesn't interact with any other stats, whether they be crit, lifesteal, or AD ratios.