I am not sure about Asperger's developing with you from the age of four; I suspect that is when it became apparent to people. I only found out my own situation MUCH later in life.
A great friend of mine and expert in it says, "I don't as much think of you as having a label, I just think of you as my friend Ray who thinks differently.".
If you want to talk around the subject please feel free to send me a PM.