When you are in a relationship and if you feel attracted to someone else, does it mean there is something wrong with your relationship?

It depends how much that attraction pulls you away from your relationship. There might be something wrong in the relationship before the attraction ever occurred to allow that attraction to occur in the first place.

Or they just might be an attractive person that you can admire without any feelings.

It all depends on the situation I suppose.