The shyness I experience makes me have difficulty in expressing myself until I'm comfortable. And I think a lot of people don't like the guarded personality types that are quite unlike an open door.
They struggle with the knocking to enter, at an appropriate time, when the owner is home to answer etc...
A lot of the world is like that they believe if you have your curtains undrawn and they get a glimpse inside your house that it's an open invitation, which is hardly the case.
And when the slightest bit of unwelcoming takes place the first thing they do is become crass about it. I would hardly say it's your fault in this case.
Just keep moving forward and be the best you that you can be.