I thought it was a term of endearment and wasn't considered offensive by Aspergers folks... er.. "those with Aspergers"... seeing why the diminutive label is useful here. What do you call such a person? You don't call them an "Aspergers". "Aspie" seems to work.
I believe with most psychological or mental conditions, the phrase "a person with ..." is used, putting the person before the condition. Just like you don't call a person with mental retardation a "retard."