That is something only you can decide , have you both tried marriage counseling ?
Have you told your husband you are thinking about leaving him ?