People with HFA (or Aspergers) appear perfectly 'not'-autistic to the untrained eye. That's why some mothers get accused of Munchausens when they are trying to get professionals to understand that their child has a problem!!! I didn't have that problem with my child, but it's the problem I'm having on behalf of my mother in her care home!!
Autism doesn't just 'arrive', it's in the genes - and it gets passed on in the male gene so if your daughter has a diagnosis...
Neither my AS son nor my AS husband are nerdy. People with AS come in all sorts of shapes and sizes - the one thing they have in common is sensory and communication issues - and even those are not consistent. Not between people with AS and not on a day to day basis, either.
I'd suggest his weirdness comes out with you because it's when he's relaxed and not on show, not having to behave normally.
Being 'hyper' is part of it - they get extra anxious, extra quick (or angry). They are either hyper (over the top) or hypo (completely immune and need over the top stimulation to reach normal functioning).
Maxine Aston is a good author to look out for - or Tony Attwood. Jessica Kingsley publishers has tons of books on this subject and they have a website.
BTW I noticed in your previous post that you have problems with your mother. Well, hey...just supposing...
We're brought up in that environment, that's why we marry into that environment, have offspring the same. And then wonder why we become basket cases and have major illnesses. There IS a link!!!
Knowing that my mother, husband and son all have autism has meant a basic sanity for me. I've recently gone off my rocker because there's been pressure on me to give up that reality - from people who should know better.
I'm recognised within the autistic community as someone who really understands what it's like for people with AS - as well as what it's like for the NTs in their lives (that's us!) But there are lots of 'professionals' who haven't the faintest idea and still think autism means headbanging and stupidity. Well, people with AS are highliy intelligent and the research is starting to prove that the most silent are probably hiding a great deal of intelligence - we just don't enable them to communicate it. Er...that's irrelevant to this discussion - I just needed to say it for my own benefit!!! (A quick self-affirmation just to remind myself!!)