Do you think it's rude to eat your food before others at the table receive theirs?

I thought it was, guess not.
Went out with new 'friends' . Two got their food first, then me. I told the last that I'd wait til she got hers. She declined and one chuckled as if there was something wrong with me not wanting her to be the only one at the table not eating..😕