Are we both red flags?

Last year i met a boy i really liked(i still do but anyways)everything started well until he started being rude to me, and very dry, anything would piss him off,and im a person that likes to annoy my friends so we always end up fighting.He said that im the only person he can be himself with (basically im the only one that can deal his terrible mood basically daily) and i always accepted his attitude towards me because of all his trauma and things hes going through,i wanted to be a good friend and support him.I always tried to make him happy by helping him with things he needed(he has like a huge ego so he never rlly liked my help) and buying him things he liked.Sometimes he would leave me for 4 days without saying anything of giving any explanation if i didnt ask for one.Everything was like that until probably January when i told him i liked him but he said he didnt feel the same way abt me.in may he ended up telling me he actually liked me back now but he didnt want to act like a couple bec He didnt feel ready.after that we were just acting like a couple without actually being official,he used to give me “privileges” like holding his hands and patting his head,and at some point we even had a marriage as a joke,we used to call each other hisband and wife,until last friday when we had a hangout and at some point he had to hold me so I wouldn’t fall and when we were done i asked if he could keep his hand on my back and i kinda said in a dramatic way (i was trying to make things less embarrassing) “hold me or ill cry myself to sleep” and he ended up accepting and after that day he ignored me(it makes me super sad and i get extremely moody)until today that he told me he felt pressured to say yes and that he was started to get annoyed by my flirty jokes and couple things i wanted to do with him,so we’re no longer married and he wont let me have the “privileges” anymore,but said he still want to be my friend, i cried but idek how to feel anymore.what should i do?stay with him and wait to see if he will change his mind or leave him?i know im not really the best for him but i still like him alot.anyhow his bad mood, and anger issues makes me go crazy…idk if i will be able to take it anymore