If you're (or have been in the past) suffering from a mental illness, does it hurt you

when someone uses "he/she's mentally ill" in a derogatory manner, for someone that might be just acting like a jerk?