Here's something I don't understand in the english language...

Some people say "Why yes it is/does/etc..."... why? It doesn't make sense (To me, at least) to put a "why" in a sentence that isn't a question... :/