If someone turns out not to be the way you imagined and perceived them to be, isn't that your own fault?

Yes, our perceptions and projections are always on us. (I'm not going to twist the question onto them not being what they portrayed, of course we know that happens)