Why does everyone at this job know my business?

No idea who told but I heard two coworkers gossiping about me and my talk with the owner. Don't know how they know as the only one who knows is my direct boss. Gah and everyone wonders why I hate it here.