I Need Advice

Hi,
For the past two days, a crazy man has been bothering me.
It started with him joining me and my friend at my place Friday night. I was super drunk, I do not remember why I allowed this man into my apartment.
My friend left, and I ended up alone with this man.I had to physically kick him out, which took me an hour, because I'm not skilled at physically removing someone from a place.
Next morning I heard a phone ring, it was his that was under my couch. He was outside and I handed him the phone under the gate.
Right after, he called me and I answered but soon hung up because he said some crazy things.
He has been calling me since. 20 times on Saturday. 18 times yesterday, and it's looking like it will be the same today.
The reason I'm not blocking his number is because I want to know when he will be losing interest. Both days when I came home from work he has come outside my apartment shouting my name . I did have to enter the street he was at, 3 times. He didn't follow me though, he just sat on the street shouting my name and some things I didn't understand.
Does anyone have experience with this? Will it pass or should I confront him.
I told him first time when he called that I had no interest. And I have been ignoring him completely. And I was obviously very angry when I kicked him out.
Any advice or similar experiences would be very appreciated !