Society can't function without at some point the society saying "no, you can't do that". Where we draw the lines are up to the values of the society. We use concepts like human rights to describe some fundamentals which should apply no matter the society.
If we're talking about prioritizing the collective good over those fundamentals, then I would say no. But there are many cases in my opinion in which it is best for society to prioritize the collective good over the non-fundamentals (things which would not be classified as human rights).