If you're annoying will people get rid of you ?

They'll avoid you until they need something from you.

Yup.

it depends on what kind of annoying and the person you're talking to and your relation

I can emphatically say, "YES"

Uh huh.