This is my ex he called me ugly, do you think he is attractive enough to call someone ugly?

Being called ugly makes no difference from who it comes from. If an attractive person calls someone ugly it is no different than an unattractive person calling someone ugly. The difference is in not giving the remark dignity with a response.