emotional affair

My husband is having an emotional affair. I have included the details in my story. It is long distance. He doesn't understand how this would upset me because he "isn't going anywhere". The ow has a history of infidelity. Am I making too much of this; as he has suggested?