Cannot spectate games

Every time I try to spectate a friend the game takes a while to load (no big deal), but also randomly will freeze. Game time will continue but the champions will continue walking to their location then stop. Usually lasts a few minutes before starting up again (if I am lucky) only to stop 3 minutes later. Any help is much appreciated!