Did you get into a lot of fights as a child/young adult?
I don't think I've ever fought anyone smaller than me, and I haven't lost many fights either... Most times people would confess after the fight that they didn't think I could win, esp. so decidedly.