Is this rude or not?

My ex got upset once because I told him to sit down so I could talk to him. His attitude was how dare you ask me to sit down lol. I didn't know asking someone to sit down so we could talk would be offensive.