Do you use the words "house" and "home" in the same manner?

Usually when I use either word I am referring to the same place...sometimes I say "our house" and other times I'll say "our home". The only difference being 'house' refers mostly to the building itself and 'home' refers to the life we live there in it, but I often use them interchangeably.