Is it normal to back away from a woman for a little while after sex?

I get called out on that a lot but it's nothing personal against them it's just how I am. After I have sex with someone I need a break from them for a little while lol. Just 2 or 3 days. I don't get why that's such a big deal.

If you cant entertain yourself for that long that's a problem.