I have an autistic son and people say things too like : he is too loving to have aspbergers . First off there are about 100 different types of aspbergers and everyone is different. Also it irks me when people look at him like he is stupid because he does not respond as quickly as other kids.
All I can tell you is try not to treat him any differently and accept him the way he is. I'm sure you do though, you sound like a great mom.