How To Deal With The Aftermath??

So my fiancee and I bought a home in January and a new to us used to others SUV in June.  We could afford it.  But we were counting on my income.  My mat leave ended in August and I can't find a job.  The pickings are slim, plus I have a heart condition that means alot of places won't hire me.  We are strapped. 
 
We talked it out and decided to swallow our pride and ask his parents for a loan.  Something we have never done in the 5 years we have been together, but if we don't get money my daughter will go without milk and diapers and that can't happen.
 
So, now I'm worried about how to deal with the aftermath.  His family, immediate(MIL) and extended are a rumor mill.  And they all know I'm not bringing in any money.  I have no doubt in my mind that someone will bring up something about me being a lazy bum and Joey having to beg off his parents.  I'm sick with worry about how to handle that.  I'm trying to find a job, it isn't working!
 
Not only do I have a heart condition, I've gotten used to that, but due to it I can never get a drivers license, so my job search area is limited.  I'm just stressed and pissy over the whole thing.  I'm going to keep looking but it's going to be hard to ignore the remarks.