Asperger Syndrome Support Group
Asperger syndrome - also referred to as Asperger's syndrome, Asperger's, Aspergers or just AS - is one of five neurobiological pervasive developmental disorders (PDD), and is characterized by deficiencies in social and communication skills, normal to above normal intelligence, and standard language development.

I'm sure there is more to this story than you have told us, so I hope my suggestion applies. It must be tough.
How would I handle it? When younger, I'd probably cave. Now, I'd contest it. You'd be amazed how bringing a grievance (even without a lawyer) makes people realize they can't bully you.