Why do people sometimes overlook major compatibility issues when everything else seems perfect in a relationship?

Should I tolerate my partner maintaining a connection with a long time female friend who he once was sexually involved with for 18 months? He is 55 and I am 61. He's known her since they were teenagers but was involved with her 5 years ago.