Is it racist to not want to date someone of a specific race?

I'll answer it this way. If your mind is closed to dating anyone of race X, then yes. If you have yet to be attracted to someone of race X but haven't closed your mind to the possibility, that is not quite the same thing.