I beat him with Nasus no problem. The secret is, he insta-pushes, if you keep your distance his autos won't hurt much and Q will be easy to avoid the come back burst. You can heal all the damage, and if he is utterly aggressive, he will run out of mana pretty fast for you to farm peacefully for a while. Around lv4-5 he is an easy gank. Just let your jungler know and Wither him at your turret. It will simply be a long way for him, a flash will be burned otherwise he dies.
You can also safely farm behind minions as his autos don't go through them, even if you are the target.
After you build enough armor and a Sheen, you can start being a little aggressive as each Q will chunk him hard, you can pretty much all-in him all game from there on every time you have poked him low enough. Granted, if he didn't get fed elsewhere. You just gotta be patient and avoid being close. The moment he pushes to your turret, freeze the lane there and if you have an a observant jungler then Graves will be scared from there on to be aggressive unless their jungler decides to assist him as well, that's when you know you are in danger. The sight is simply obvious.
The fact that he insta-pushes makes him the easiest of top adc's to lane against. As a Nasus player, I love farming under turret.
Maxing W second is crucial as he is auto attack oriented as all other ADC's etc. So when you wither him you make him your bitch.
Just please, don't eat a lot of unnecessary damage early, otherwise it will be hard for you. 6 stacks aren't worth if you are gonna get chunked hard for it. So knowing which stacks to get and which ones to give up is advisable.
Late game, he won't be able to 1v1 at all unless fed and has enough penetration to burst you down before you do work on him.