I am so tired of getting on his nerves

 ok I feel like yelling today! I was looking forward to spending time with my SO today at lunch, I called him and let him know I was going to be a little bit late at lunch, but he got irritated at me and just hung up.
So I get out there and he is showing me how irritated he is at me for keeping him waiting. I gave him his pop, which I get for free here at work, and I left him there and told him not to bring me lunch anymore, that I would get it elsewhere.
When I got back to my office, he called and stayed silent on the phone, and wouldn't say anything. I don't know if it was because someone else answered the phone, or what his problem was, but he didn't answer and stayed quiet.
I have repeatedly asked him to leave, even had a policeman escort him off my property, and he still comes back to me. I keep telling him its over and he can leave anytime now, but he won't leave.
It's really difficult to be in this situation, because it's the third abusive relationship i have been in. It's very frustrating to deal with. I love him with all my heart, but I just feel like I'm being suffocated by him.
I don't want the trouble of involving the police, I am already embarrasssed that I have been in my third abusive relationship.
Somehow I feel like its my fault or like how unlucky am I that I choose the abusive men out of the whole bunch of men.
It's said that we don't deserve this type of treatment, but where does one find the perfect unabusive mate. I am so ready to give up on relationships right now and just be single.
Actually that is how my relationship with my SO started, it was just for fun, it wasn't supposed to become serious. we were having fun for about 6 mos. before we even contemplated getting serious.
Sometimes I wish I would have never met him. I wish I would have just walked on past this guy.
Some days I am so thankful for him and his helpfulness. But is it really worth all the hassle with the abuse?
I refuse to change for any one else, I've changed, and rearranged my life too many times to even think of changing, and here this man comes and tells me I am fat, a whore, a cunt, a cheater, and all of the abusive language men like him use. It hurts my feelings and makes me feel like a loser, but usually I just let the names slide right off me and keep on moving.
I refuse to take my time to make him want to be around me, if he doesn't want to be around me, I won't make him. What he does on his time is his choice, not mine.
Sooner or later he will leave me for someone else and blame all his misery on me. So it will only be a matter of time. I guess I am just in the waiting game, of when, not if he is going to leave me.
I just pray that it will be sooner not later.