has anyone ever married someone that everyone else thought was weird?

before we dated, people called my current bf creepy or weird. even i did to someone else i was dating at the time. now that i know him and date him i don't find him that way. but i sometimes get hit with "i thought you thought he was creepy?" i wish i could live it down. what do i do?