Coworker told me i never come out of my room...

I'm not mad nor upset.
However, I've heard this before at other jobs.

What am I supposed to do though?

I work at a school. Everyone around me are [i]actual[/i] teachers. I'm not a teacher per se but I do have a classroom with plenty to do.

I told person, I come out sometimes, I just covered for someone a minute ago.

Person was jokingly like, no you don't, you never come out your room.

I was like, right now I'm working on grades.

I can't hang out in teachers classrooms and chat with then while they're teaching a class.

Am I supposed to sit in the front office and gossip?

Go play with the nurse?
I don't get it

Is working supposed to be a clubhouse?

I mean I do get bored sometimes, but there's no hang out spot at a school. People are working.