Have you tried couples counseling? Or maybe have him talk to your therapist to have your therapist help explain your condition a little better?

I'm in a similar situation so I'm not the best to advise you...but I don't think you should make the big step to leave until you try at least some type of counseling to help with communication issues.

That is, unless there is any abuse.....is there?