Pulmonary Embolism Support Group
By far the most common form of pulmonary embolism is a thromboembolism, which occurs when a blood clot, generally a venous thrombus, becomes dislodged from its site of formation and embolizes to the arterial blood supply of one of the lungs. Symptoms may include difficulty breathing, pain during breathing, and more rarely circulatory instability and death.

I think if your D-dimer was negative, so there is nothing to worry getting off your anti-coagulation. With Xarelto, INR monitoring is not required so D-dimer test is enough i believe. But be watchful with any symptoms etc as you rightly visited the ER suspecting a scenario.
Best of luck with your health and congrats on getting rid of the blood thinners.
My Dr said no way to going back on HRT but agreed to abide by my Gyne's decision. I am awaiting that appt in 2 weeks. Now off of Xerelto, like some of you, a little nervous as to side effects, risks, etc from being off of the big "X". Also curious if anyone else is on HRT patches and has been in Xerelto? Is there life after Xerelto?