Twisted Fate Yellow card stun

I was using a Twisted Fate in my comp the other day and it came down to him vs a varus. TF pulled a yellow card and hit the varus which should stun him but varus was able to still attack while he should have been stunned.