I've been barefooting for over 4 years now, and I use shoes as tools, similar to gloves. When my hands are cold, I put on gloves, when my feet are cold I wear shoes, usually without socks. Just be smart about it, frostbite is not something you want to deal with. Also, you feet will become more accustomed to cold as the temperature drops.
