Why do most men just look at women but never say anything?

I'm sure most people have experienced someone just looking at them but not saying anything to you. Sometimes it's a stranger who you meet briefly and sometimes it's a person you see often.