Husband asks when will I see my father......

Today I have been feeling a little down with guilt.  My husband asks me, "When will I speak to my dad?"  Frankly I don't think it is any of his business.  I think because he thinks that is the proper thing to do religiously.  
My answer to him was that when he comes and asks for me.  He never called me in the past to even say, "How are you and the kids?" he would only call to yell at me and curse me.  I am 38 and really don't have time to worry about who loves me and who do not.  Why can't my husband understand this.
I have been working on myself and my well being.  I have been happy for a long time but when I am reminded about my ex-family it puts me in the slumps?  How do you forget and not let it affect you?  I want to forgive and move on.  I will forgive and move on.  
I love my husband his heart is in the right place but he didn't live my life.  I have a lot of hurt done mostly from my step-mom.  My husband thinks that I have allowed her to win.  I will let her win if she will make my dad happy and stop making me look like the evil in his eyes.  Her plan was to get rid of me for a long time and now it has happened.  As long as he is happy so am I.