Back in the middle ages, if bread was baked, it would be in the upper part of an oven so it would be less burnt.

The lord of the household would get the first slice off the top, and it gave rise to the term "upper crust" for well to do people.