When you live in a society rampant with extremist ideologies

You're still labeled an extremist even when you try to take things in moderation.

A balance and rational approach becomes labeled as extreme as well by those on opposite sides of ideological spectrums.

To extreme radicals moderation is extreme.

If you state "I don't entirely side with either A or B"

Both A and B will label you extreme for not choosing sides.

Extreme moderate = Oxymoron