If a man lets you into his world, is that a sign he loves you?

I have a friend,(now), who was once a lover, and who has huge trust issues. For him, it was huge just allowing me into his home. We are just friends, but also pretty close. We talk all the time, and we watch out for each other.

I think he cares about me, in his own way, but he certainly doesn't feel like I am the love of his life.