If you know a relationship is probably not going to last but you still enjoy every second of it, should you continue having that relationship?

As long as both parties know it really isn't going anywhere I would say "have at it". I have been in casual relationships where the other party changed their mind. It becomes more difficult to extract yourself when this happens.