If you had a parent who wasn't around for your childhood(their decision) at all, but wants to be a big part of your child/their grandchilds life, would you let them?/how would you feel?
I don't think having a biological relation means you have to be involved in a person's life. If you're a virtual stranger to me you won't have access to my kids.