I feel guilty for not using cloth diapers

Cloth diapers do not protect the skin of an infant too well. And the detergent it takes to clean them probably is not too healthy for baby skin, either.
Don't feel guilty. You're giving your baby the best. That's all any parent has to do.