Are child predators more common than we realize? Are some men not child predators necessarily, until left alone with a child?

Yes and no. Though they make not act on it in a premeditated fashion but rather on impulse and opportunity. And remember, not all predators are pedophiles just like not all pedophiles are predators.