Is it easier for somone you hurt not to forgive you?

I have a theory that its easier for somone who has been hurt by you to not forgive you. Especially if you care for them alot. Do you agree?