Twitch Ult vs Nexus

I went to backdoor with twitch and when i ulted to get the nexus, I noticed that the nexus' health was not moving...then I turned around to attack the open inhibitor and the same thing happened, no damage. But when my ult ended, I could actually destroy the nexus.