It's never easy and I've had to do it more than a few times. Recognizing the need and making the choice to let go of someone is a huge step towards a healthier you. but yes, it's sad and i feel that for you. If it helps, keep telling yourself that you have no choice, that this is the right thing to do.
Be Caml, be strong, love yourself enough to keep safe.