Kayle will be a problem until you address the sustain of Time Warp Tonic and Klepto

First, I thought Kai'sa's advanced abilities based on AP. AD or AS was a GREAT design, she is a ticking time bomb, but the explosion is avoidable by a dominant lane and gold denial. The problem of a "time bomb" is made so much worse when it's 2 things:

1. Unavoidable (due to level and not gold)
2. Not easy enough to abuse. If Kayle is weak early it shouldn't REQUIRE jungle assistance to kill her. Unless you're Riven or Renekton klepto and time warp gives her so much sustain that if she plays remotely safe and your jg is disinterested in ganking top then she will reach 11 without too much trouble.