What's the big deal about being up late?

Someone wrongly assumed i was up at 3:30am. I wasn't. They asked why but then i think why are they up? What's it to them? One asked when it was only midnight. He thought that was late lol. Is it a jealousy thing because they think I'm talking sexually to other men?