I Am Unhappy In My Marriage

How is it that my husband always takes things personally. He has said the worst of the worst to be and I have never did the same. I can never avoid an argument and feel like the person in the wrong no matter what. Today I was getting frustrated so I told him to go inside because I was getting frustrated. He made it out like I personally attacked him. I told him I'm just frustrated. And he kept making it about him. Three different occasions he came up to me acting like it was about him and each time I told him I'm just trying to do this... third time he came up acusing me of saying all these things I didnt say while holding our child. Which I never said and just pisses me off cause hes doing it in front of our child.