There is nothing wrong with you ...
You have a kind heart, & don't want to hurt anybody.
Finding a way to step back from relationships that no longer benefit us isn't easy.
As my health deteriorates, though, I'm learning to draw the line ...
Especially if the relationship is a drain on what little precious energy I have left.
I've gotten to the point I'll say, "I'm sorry, but I'm not feeling up for a visit right now."
It's a simple way to look out for yourself without being hurtful or offensive to the other party.
I hope you're able to find something similar that works for you ...
The last thing we need at this stage is unnecessary (& unwanted) drama.