I Am a Fan of Rufus Wainwright

Curious about opinions of this song. Especially the song writing in lyric. He is gifted with talent and words. But, what is he singing about? I don't think he's singing about someone he lost, even if it's there in song, it's more of a sadness meeting someone new while he's haunted by pasts.

[youtube=https://www.youtube.com/watch?v=h_SXaguRUXk]