new job

started my new delivery job tonight at the chinese,it was ok and the woman on the desk is very friendly and chatty inbetween deliveries i sit in the shop front chatting to her.Her husband works in the back ,but he seems dead miserable and im getting bad vibes off him,when he wanted me to move he never asked ,he put his hand on my side and kind of shoved me along,i felt like knocking him out !I think he may be jealous because i was getting on well with his wife but obviously just friendly.I never said anything to him but if he keeps it up i will have to tell him but risk loosing this job straight away,im tempted to go back to my other job as he wants me back in there ,dont know what to do ????