Wow!! This is a great question. Great and right up my ally and fits perfect in my wheelhouse.
Firstly I am an atheist. Also I think kids are just little people that are lacking life experience.
I don't personally take my kids to church but not for any belief system I have. It just doesn't fit into my time with them after the divorce.
I read through the comments on this thread and I don't think I found one helpful one.
The Bible in my view, at least the old testament, is a great book of knowledge. Stories with very wise and great moral punch lines. Now there is some crap in there too. Like for instance the way to treat an indentured servant in the " Eye for an eye " story. Most people misunderstand that to mean to " do unto others as they have done unto you ". But this isn't it. In short it is a guide to compensate, essentially, a wronged employee of sorts. Nothing to do with getting even with someone.
Oh, also, I only believe that the old testament is worth reading. Just personal preference after reading the old and part of the new testament.
I guess I got a little long winded and doff topic but I think you exposing your kids to church and their ways is a good thing. With kids it is all about safely exposing them to life. If they choose to align themselves with the church more power to them.
Don't even listen to the people talking about pedophiles in the church system. Schools are full of them to. Anywhere there are kids there are pervs waiting to take advantage of them but that is a whole different topic.