Cannot unfriend / block newly added players once you have started a game

I made the mistake of adding someone who trolled and harassed me and found I was unable to remove / block them in the client while in game. They were spamming my chat with various things to demoralize me and make me feel bad so it was rather vexing during my ranked game.