Do you ever go to heart a PM and then realize that you can't ?

You know, because you don't want to talk anymore, but also don't want to look like an asshole