If your legal title was Dr, would you get annoyed if people still called you Mr/Mrs/Miss/whatever?

I know many Drs that insist on the title. Just like military members insist on being addressed by rank.