I don’t know if I should just stop talking to him

This guy I was talking to invited me over last night to hang out with his family, it was 8pm and he called me to come later. I was already not liking the fact it was super late . At 11pm I went to bed because he didn’t call or say anything, I woke up to a text that just said hey. I was going to give it another try with him but he may be confused on letting another female around him but I also don’t like the lack of effort , communication.. I was texting him and he didn’t even answer part of my text so I know he isn’t paying much attention to me ..it’s almost he half’s reads it and answers which is weird. Also I think it’s weird he tells me he left his phone upstairs but he’s on another phone answering his sons mother calls, he even showed me when they were on FaceTime with his ex , he was showing me his daughter who couldn’t come to him for the weekend..I think his family mentioned I’m the first female after his ex , it’s sad because we were walking and he told me I shouldn’t feel alone that I have him , it’s a tricky situation but I think imma just walk away from, it’s just drama he has with the ex gf and I don’t want to get my feelings hurt.