What are some sure ways to boost my self-confidence?

Here's the thing, whenever someone projects negativity about say me or my work I recoil and begin to have self-doubt whereas I should fight to defend my corner...or shouldn't I? What are your thoughts?