What is your opinion on descendant of colonists/settlers complaining about the potential for others to displace their way of life and culture?

I'm working in Spain and I often hear the anti immigrant directed to a certain group. However, not once has anyone in the community question me about immigration. Is it because I'm European?