What do you feel about the fact that even my juniors had the confidence to mess with me?

Yes since I got into 10th grade back in 2015,I was pretty popular among my juniors because of my childish nature. But some of my juniors were confident enough to mess with me. Like when I was in 10th grade, some 7th and 8th grade boys used to come fast towards me trying to beat me. But I used to not beat them back because I used to feel what if an adult saw me beating them. Sometimes when angry enough, I used to just intimidate them or even beat them if they messed with me. But sometimes some of them used to not be scared of me especially if they were around same size as me. Like when I was in 11th grade, a big 9th grade boy tried to intimidate me showing his fist. I shoved him and also tried to punch him to intimidate him too but instead of backing down he was punching me. With some more attempts to intimidate each other he laughed and said he wss just joking. When I was in 11th grade, there was a boy named Bhuvan who was in only 7th grade and he used to literally punch me hard and almost twist my hand. All I used to do is just threaten him but not really beat him back again because I used to feel adults might be watching. Sometimes it used to be a bad fight too in which both of us used to get hurt. Many times it happened that some juniors used to not mess with me anymore after I fight them back like once when I was in 12th grade, a rude boy in 10th grade used to act bossy to me trying to beat me and also say me to get lost and go home. One after when he again did that I shoved him hard. He then started punching me but again I pushed him using all my strength and he fell on ground. After that he never messed with me.