Loneliness Support Group
Loneliness is an emotional state in which a person experiences a powerful feeling of emptiness and isolation. Loneliness is more than the feeling of wanting company or wanting to do something with another person. Loneliness is a feeling of being cut off, disconnected and alienated from other people. The lonely person may find it difficult or even impossible to have any...

fuck em, their loss.
I've visited that group a number of times, despite not being officially diagnosed with Aspergers, simply because of similarities between those people's childhoods and mine.
I have to tell you, the issues you describe are not uncommon. People often share in that group things that are similar in nature. Or even worse.
It's easy for Aspergers people to be misunderstood, to be thought of as "jerks", "inconsiderate", "unemotional", while in reality you are anything but.
Also consider taking up a traditional martial art like Aikido or Wing Chun. The training protocol is structured, which makes it easy to be around people, without having to chit-chat with them in freeform manner (the ultimate Aspergers nightmare). I found that kind of "limited contact" to be very helpful.