From the eye of a stranger that doesn't know the whole picture, I'll shoot my first impression:
Alone is better than with the wrong company.
If the person is a good person overall and doesn't know what he's doing, talk to him about how you felt. If he does nothing at all about it, he doesn't care enough = end the relationship.
If he knows what he's doing and does it anyway.. why are you still in the relationship?
Every person in love deserves to feel loved back.
If you don't feel glad to be with that person, maybe it is best to cut the cord and be both happier, apart.
If your trust in each other is weak, so is the relationship.
There is no reason to stay for a weak bond because you will become too exhausted trying to maintain the flame alone...
Wishing you to smile sooner than you have thought possible...