Interracial relationship advice?

Lately the relationship has been kinda rocky and it all blew up and he called me racist ... resulting in many hurt feelings as he did not realize how offensive that was to me, especially when only said out of spite .