What specifically makes sex sinful? [Spirituality & Religion]

If you are married to someone else, are with a child, or are related to the other person there are ancient traditions that are still observed but in the American culture at least we seem very interested in casting judgement on weaknesses or the flesh for those who are consenting adults with no victims to their actions.