Does the cultural obsession with "self-confidence" feel like a burden for people who are judged harshly by their appearance?

Is it common for new managers to make decisions based on one employee's feedback, and how can you navigate this in a workplace?