How do you know for sure that the red flags you see in someone else are for real or out of projection of your own insecurities?

I keep track of them and make note of reinforcing or weakening points. If there's a pattern I'm unlikely to consider it a figment of my imagination. Of course no one's infallible. 🤷