You could try individual and couples counseling. You don't sound like you're in a place of leaving him and if a therapist suggests that you can ignore them. It wouldn't hurt to seek therapy for yourself to get to the bottom of your feelings. Good luck.