This is normal. You are too tired for one and your mind is now full of all the responsibility of caring for your two small children. Your husband has no such feeling because he didn't even have to go through what your body did. Does he help on a daily basis? If not then why? At the worst you married an immature man! I had one of those and he too called me names and sad I must be cheating! Fortunately he got rid of himself and God sent me a grown up man who helped me raise the children and never got mad nor does he ever accusse or call me names when I'm not in the mood. You will have to decide whether he is worth staying with. I have no clue what all is going on and if that is the only problem or if he even says these things in front of the children. If he yells at you in front of the children about anything that is not good at all. Even if the children are too young to understand what is being said they can see and hear the anger. I hope this is not the case. If he helps and is patient with you then you will want to be intimate more often but it may take a while with two young ones. As I said your feelings are normal but unfortunately so is his in this world of immature men!
If he has gone somewhere else for his selfish satifaction then you shouldn't have anything to do with him! STDs for one!
I'm sorry I may have not helped you at all. There is so much I don't know. (((HUGS)))

Same here I have a 3 years old boy and a 5 months old baby boy and no sexual drive at all , my husband make comments sometimes but he kinda understand that is very difficult with two young kids hang in there im sure is gonna change again to normal in a couple of months !