Am I suppose to be more annoyed?

I invited my bf to a family meal last weekend and he cancelled because he had to sort his car. Tomorrow we were meant to go on a day trip but he's had to cancel due to work, now he has to work the morning shift. Now yeah I was annoyed for both situation's but I mean it's not big of a deal right? According to my friends I need to tell him that he can't let me down like this... What do you guys think?