Kennen is not that mobile of a champion. His move speed bonus is limited and, like all abilities, has a cooldown. Take advantage of the seconds in between. Try avoiding using your abilities against him in his lightning ball form because it grants him additional defenses.
Most of his damage requires him to place himself dangerously near his targets. He is incredibly squishy and his stun requires him to stack his passive onto his targets. Try to stay near your turret so he cannot commit to a full attack. Poke him down with whatever ranged abilities you have and, when you've whittled him down to a fraction ofhis health, bait him into a fight and finish him off.
His ultimate, while powerful, has an insanely high cooldown and it does not pay for him to build CDR because of his energy resource. Avoid clustering with your allies when his ult is ready for use. If he becomes a serious threat to your team then assemble your allies to swarm and end him in between his ult castings.
Merc Treads, Mercurial Scimitar, Banshee's Veil, and Maw of Malmortius are all useful defensive items to use against Kennen.