Is it wrong for me to sleep with men my son knows!?

I am a bisexual man in his 50s and I sleep with men in their early to late 20s. I am currently hooking up with a 22 year old who went to school with my son and i am also seeing a 23 year old who used to be in my sons social circle few years back, but they weren't friends and are not in contact anymore. I also initiated both relationships.

Am I an asshole? I never seen anything wrong with it because they are not his friends.