Dumb question - when kissing a women does a guy take his hat off or leave it on?

Obviously if it'll get in the way presumably taking it off is the right approach, but what if she's wearing any sort of hat too?

I call it a dumb question because it's probably considering 'basic dating etiquette' but I'm not knowledgable in that having dating not really at all in 10 years.