My brother the control freak

So I am trying to deal with the estate of my parents and have to have meetings with the lawyer. some are just to drop off or sign paperwork so they can continue.It is all mostly business stuff and paperwork and is something I have to do as executor and trustee of the Family Trust.
The lawyer asked me for my brothers social security number as one of the things they need and I dint know it so called and asked my brother to call the lawyer and give it to her. He then ge5ts upset with me for having met with the lawyer without him. I told him it was all paperwork and dropping things off like death certificates and what assets they still had and such or the lawyer asking me to get a tax ID number for their bank account and going tot he bank to change it, and there is nothing for my brother to do or which ne needs to be there. But he wants to go every time I need to go to their office. He wants to know everything that I am doing and see everything that I see.
I told him I dint want to waste his time or make him drive across town for something like me dropping off a life insurance policy or give them bank statements or sign for approval for them to move on changing the property deeds to our names. There was no reason he had to take the time or use his gas to watch me sign a paper. But he wants to be there and have his input on it.
It is so stupid. He either doesn't trust me to do anything right, or that I won't somehow screw him or he has to be there to feel like he has some control even when it is not a matter of control but just need to do bureaucratic BS to get the estate finalized.
He hasn't done anything to get the estate done except spend my parents money. I've had to make all the calls, cancel things, deal with bureaucracy, send for the paperwork; deal with the bank account, insurance, social security, the accountant and the IRS; get the lawyer, handle my sisters caretakers and everything else that has come up and has to do with my parents passing while he does whatever he wants and gets their money and free rent. But he has to insinuate himself into my sister's life and wnats to be there for everything I need to do to get things settled.
If it wasn't for the fact that I cant trust him to do it let alone do it right and not try and cheat me out of anything, I'd like to have let him deal with it and sit back and wait till it was over and see how long it took and how he dealt with it. From what I can tell he would have been spending their money on things to improve the houses and his own life and helped me and my sister out as little as he felt he needed while bullying us continually over it because he was in control.
I'm not sure he would have even thought to call half the people needed to get this done or even the lawyer to do it for a while till he figured it out or someone told him and by the time he was done the property would likely have to be sold to cover costs and the estate division between us three kids as laid out in the will and he would have screwed himself and perhaps me and my sister as well.
My mother knew enough to not let this happen and that is why she made me the trustee and executor of their will.
I'll tell my brother every time I am asked to go to the lawyers office from this point forward. If he wants to spend time and money on coming to see me drop off something or sign something then that is fine with me. I hope he doesn't later make a big deal about it.