Graves Disease and Propranolol

I was diagnosed with Graves Disease in 2012, after being on Carbimazole and doing black and replace my GD went into remission and all medication had been stopped.  After 16 months it came out of remission and I am now back on carbimazole 20mg per day.  I declined RAI and opted for long term ATD.  Due to the palpitations and tremors my GP put me on Propranolol 2 x 40 mg per day, I developed water retention and was put onto ferosumide and propranolol increased to 3 times daily.  My endo said after 2 weeks of being on carbimazole to reduce the propranolol to twice a day then after 3 days to once a day and then completely off them.  I thought that 3 days between was a bit soon so increased it to 5 days.  Dropping from 3 to 2 went well didn't notice and difference but going from 2 to 1 has brought back the palpitations and any slight movement pushes them up which concerns me as I also have high blood pressure and on 12 mg a day of candesartan.  Can someone advise if this is normal and is actually withdrawal symptoms or should I speak to my GP about staying on them longer? 
Please help as unsure if this is the normal process or not
 
thanks :)