Single Parenting Support Group
Today being raised by a single parent is not uncommon. About three in ten children live in a single parent home. The most common type of single parent home is one with only a mother. However, single father homes are the fastest growing type of family situation; 60% growth in the last ten years alone.

I guess the main question is what is going to make him treat your child better than he treated you? Because he probably won't. And, if he's just going to mistreat the child (and him just saying he won't wouldn't convince me) then he's not the right person for the child to be around.
I hope you find a way to manage this situation that you feel is safe and supportive.