Mother's Day Brunch [I Struggle With Social Anxiety]

I am a mother of a grown son and my husband sister wants to have a get together for mothers on Mother's Day but I don't want to attend. I want to stay home and be alone. I am I wrong for feeling like this? I can be really anti-social at times not meaning to, I just have to be in the mood to go places that's all.