I Am Lonely

My boyfriend is not romantic at all. He never makes a long conversation like other boyfriends do. Sometimes I catch myself not wanting to spend time with him because I hate the boring silence between us or having crushes on other guys. I wished he was excited about my birthday. He forgets it. Last birthday he gave me a Bible. I bought him gifts on every occasion but he never appreciates it. He never introduced me to his friends or family. He never came to visit me after I moved to a city. Whenever I ask him he says he's busy and he can't come. On his last birthday, I took him to my friends. I told them that it was his birthday and he never even bothered to treat me for the occasion. He took it as an insult. We argued about it. This time we argued because he put his female friend's picture along with him and his other friend as profile pic on WhatsApp. As always he blamed me that I was hurting him. I got so annoyed and sad because he never thought why I argued in the first place. It's like he's taking me for granted. I don't know what to do. Should I break up with him or not? It's not that I wanted but he should know about my worth and he shouldn't take me for granted.