Do people use the phrase, " give them my regards," Or "My regards to [whomever]"? Do they speak that way in Great Britain?

Not so much in everyday speech, but in formal writing, certainly.

We also say 'regarding' or 'with regard to' when referring to a particular subject.