I'd feel thankful in some ways that someone could at least care enough for me that in a way they put me before their own self. And let them know that, for them to say that, it means they had to get it off their chest for me to obviously finally let them go so they can be free.
It's nice that they care, to put me first in something. But it's not so nice if the feelings of being around one another aren't completely mutual. And that instead of a friendship/relationship of joy when being around each other. It's only because they're worried or feel they owe me something. Or they know how much more invested I am in things between us than they are etc...
There's just no point after awhile. I'm not a hostage taker. This isn't a situation at gunpoint. If they felt like they had to do something because it bothers them in the back of their mind and they feel guilty if they don't. Then they're not there because they "Want" to be... And in the end it's a flawed reason to stay.
So setting them free would be the only option left from there.