Well either they are rights or they aren't. You can't call them rights only when it suits you. On the other hand what do we do when two rights collide and interfering with one another? Public safety is a right in and of itself too. We have to have balance. We can certainly go overboard when it comes to rights.
For instance my kids have a "right" to privacy. However it is my job as their parent to keep them safe and one way I can do that is having some oversight over their activities. They don't get privacy in every instance, especially when it's necessary for me to know what's going on. Of course they are aware of this and I don't have to sneak peeks at their phones or tablets. I have built a relationship of trust so they are more than willing to work with me.
I think it's similar with governments. If your people trust you they will do what's necessary without needing to take their rights away.
So, no, I don't think governments should be allowed to take people's rights away but it is their job to keep the public safe to a certain extent. They might have some mending to do when it comes to trust in order to get cooperation. From there they can get the people to understand why what they're requesting is necessary. But I think that trust is vital. Without that you're just forcing people to bend to your will.
