How to watch spectator mode without the overlay?

I was wondering how I can watch spectator mode without the overlay: no scoreboard, no map, no nothing. I managed to get it down to a minimum by pressing the A key, but the team status bars and the map are still up. How do I watch without these?