Most definitely. People with depression have very low self esteem and any negativity directed towards them would cause them to withdraw even further. That is one one the reasons many people avoid those with depression. They feel they are always walking on egg shells.
Being around someone who is constantly depressed has the effect of depressing the other person as well. Hence the avoidance.
We all have shortcomings and most people do not draw attention to them because that is simply the way that person is.
They accept the shortcoming and get on with the friendship.