Do you know instantly if you are attracted to someone or do you need to know the person first?

I know instantly if I'm physically attracted to her, but it takes a while to know if we'd be compatible as lovers/partners.