Is it rude to turn and check out a girl's behind after you pass each other?

I don't mean to seem like a lustful lil dog all the time, but I can't help it, its just reflex