Is it rude to not respond to messages?

I mean I guess I could just ignore them but I feel bad about it. Problem is that most people that message me are actually pretty boring or big time pervs... can’t people have cool interesting conversations anymore?