You should break up with him. Despite what your intentions may be you two will never be happy together because of major differences in what you both need. It will only get harder to do as you spend more time together so do it now before it becomes a bigger heartbreak. Sorry to be the bearer of bad news.