I have much lesser life experience than you ... but still taking a stab ..
i think any appreciation of another human starts with visual appreciation .. once you like someone by vision, then you gather courage to talk .. talking leads to more knowing .. more knowledge leads to more acquaintance .. more acquaintance to understanding the substance behind the exterior beauty ..
I think it's immature to expect to know the substance without getting to know someone .. so beauty is the one that attracts someone to the real substance and not the other way round ..
Meaning, beauty is skin deep .. you cannot possibly be attracted to gorgeous pancreas but once you are attracted and you stay on for more, the substance comes to the fore ;)
Btw, not everyone likes the same looks and its always comparative to the audience or comparative beauties around (same goes for men too btw) and also, it take time to develop eyes for someone .. but the first glance is and always will be purely visual in my humble opinion :)