So what are the benefits of cave isolation?

Peace, meditation, pollution free zone, healthy living and nobody to disturb u.

Lions, mosquitos, bears, insects, bees, snakes and bad weather would get you crazy but you get to learn a lot if you get time to think when you don't have to worry about survival then you would think outside the subconscious program downloaded from the society and that can be enlightening.

Heating and cooling aren't that much of a problem, if the space is enclosed. But then, it depends where the cave is located.

I can't think of anywhere less likely as comfy abodes than the majority of caves, having explored many over a few decades!

Far away from evil people

Strange choice of Group for a question apparently about living as a hermit...

claustrophobia, cave-ins, wet, home of criters.

Bats in your belfry

You can fart with gleeful abandon