Does anyone else start to feel annoyed and anxious when they haven't had enough alone time?

Absolutely. I need periods of solitude.

Fortunately, my wife understands that and is happy for me that I can find those times.