I agree with Divine... sometimes love isn't enough. A relationship is a two way street. He has to be willing to make it work also and that means validating your concerns and seeking help. I would say maybe consider couples counseling before calling it quits. A last ditch effort, per say. If he will go and take your concerns seriously then maybe he will be willing to work on whatever feels broken inside himself. If not...I'd say it's time to move on.