You can message/receive messages from a friend even after you delete them.

An example would be if you add someone and they messaged you "hello". You then delete them as a friend but keep the message box open with their message "hello". If you type to them anything, they will receive it and they can message you back anything as well.