Sorry everything is so messed up and confusing for you. I too had a similar childhood. I suffered through sexual abuse for several years. The emotional turmoil it leaves behind is indescribable for someone who hasn't experienced it too.
He sounds like a good guy... have you described what you are going through right now to him? Just tell him you need the personal space. If he is as good a guy as you say he will give you the space you need!
When do you next see your therapist? Soon? If not, can you make an emergency appointment? Your mental and emotional health should come before anything else. We are here for you.