When it comes to let the other part ignoring your reasons of keeping your self away, I understand that this point could make the feeling of guilt appear,
But don't go further than that, don't get angry at yourself, you are only gonna make your way out tiny and narrow,
Once u declare your reasons I'm sure the other part will understand,
That's the problem in any communication between people!
Lack of connection tools, explaining yourself to them much better.