Grave's E does not reduce cooldown when attacking towers or other structures.

This can either be a gameplay bug or an incorrect tool-tip. His tool-tip says that the cooldown is reduced by 1 second for every basic attack, does not specify that this does not apply for structures.