To the men here, what would make you feel insecure when being near a certain woman?

When she regularly walks her dog and happens to go past every time I go out to my vehicle parked in the street or into my front yard doing yard-work and seemingly has to say something to me that requires a response to be neighborly, and SWMBO sees nothing wrong with her older neighbor talking to me "because she is just being neighborly" (cringe)