why does appearance matter so much?

it is the first impression before a person speaks. If they do not appear to take care of themselves, ie personal hygiene, grooming etc... it can often be interpreted negatively on one's character.