does this happen at your work?

does this happen at your work when your coworkers compare who is a harder worker? who works more hours and trying to convince each other they need to stay later.I hate that this happens at my work but I dont want to keep saying no to the shift supervisor that I do not want to stay later. if I wanted to stay late I would. I look bad in fornt of them when i only work forty hours and they work fifty and sixty but our lives are so different, I cook everything from scrach, they eat out, they have a husband or wife and a couple kids I dont. I dont like feeling bad for this but its hard to go against peer pressure.