I feel like men's lives are harder in general

I agree in general but it's in degrees.
This morning I looked out of the window to see one of the bin collectors (refuse collector) was a woman, first time I've seen this and I think her life must be harder than a guy who works in an office but she is an exception.