We wouldn't be able to buy much. Gold is rare; there's not enough of it to go around (which is why everyone- or just about- has abandoned the gold standard), and it's also HEAVY. You'd need a team of mules to transport your wallet.

Although I suppose that would make for a good pick-up line, if you were an early adopter...