Kind of sad today but, I'll be Okay

I have a friend who I have known for almost 60 years.  His wife and my sister graduated together in school.  He had been a Methodist for over 50 years.  3-1/2 years ago, he joined my church.  Many many times, he has stood up on Sunday Morning and testified that he had learned more in the 3-1/2 years at my church than he had in the Methodist church in 50 years.  He has stood up and praised me for being the preacher that I am, what I stand for and the love I have for unsaved people.
He hasn't been to church the past 2 Sundays so, today I called him and asked him if there was something wrong.  He told me that he had been going back to the Methodist church with his wife and that their new Pastor, has been preaching some good messages.
I think this was his way of telling me, he will not be coming back to my church.  This really hurt me.  He had asked me to preach his funeral too.
I also found out that another family that I led to the Lord and, baptized them all. The grandmother, her daughter, and 2 grand-daughters are not going to church anywhere.  They have missed about a month at my church but, the river has been out and they can't get to the church unless they drive a long long way around.  I found out that the mom has been getting drunk every weekend. etc.  I still have a painting of a lighthouse that one of the daughters made for me 2 years ago, hanging on my bedroom door.  This made me very very, sad too.
It bothers me when people leave my church.  I take this personal.  I have visited these people. prayed with these people, wrote letters, counseled with them, etc. I have been there for them everytime they have called me.
I don't understand.  Somewhere, I guess I failed them and I feel a sense of rejection. Rejection has always been a trigger for me.  This hurts very bad.  I try so hard, show them love and concern and yet, they turn their back on me.   I will be okay.  Just sad.