Loneliness Support Group
Loneliness is an emotional state in which a person experiences a powerful feeling of emptiness and isolation. Loneliness is more than the feeling of wanting company or wanting to do something with another person. Loneliness is a feeling of being cut off, disconnected and alienated from other people. The lonely person may find it difficult or even impossible to have any...

Was you childhood as bad as what you describe above? Were your parents there for you? Are they still alive?
My family is great and has done and do what they can. Childhood, well it’s tricky in my head it wasn’t as bad, but I do recall things, basically I would do what I was told, I also have heard I would take beatings without a whimper, basically I just want everyone to be happy. Once puberty and emotions become involved I had no capacity to understand anyone, and is remarkably taxing psychologically. But even that wasn’t to hellish till I worked myself till I burnt out hard. Luckily where I grew up I grew with the same group of people so got to understand them in parts, my skill is in patterns behavioural and otherwise, now i can barely go many places without invitation, inadequate, insecure, 0% self worth. Never been seen as a romantic possibility for anyone, and what few friends I have are very distant this includes family.
I'm no expert but I think the best path is to continue to fight the aspergers as you have been. And try and raise you self esteem level. Forgive my ignorance but can you not bond with other aspergers suffers? And are there no woman in that community? Surely they would understand your situation. I'm a big time book reader. Have you looked into any books on living with aspergers? Just trying to help.