Privacy is very important to some people. Not because they are hiding something, but because it is a right. When someone else violates that privacy, then they are within their rights to protect themselves.
Your boyfriend hasn't broken up with you over what you've done, so if I were you, I would consider myself very lucky.
My ex-husband violated my privacy in every way he possibly could. He used to search my purse, for goodness knows what, and made himself the admin of our shared computer, and rooted through all of my files, while keeping his own private.
My feelings for him began to change, because he was basically TELLING me that he was sick and paranoid, and that he didn't trust me, when I had done nothing to earn his distrust.
