His unwillingness to work with you with regard to his neediness tells you what you need to know - he does not care enough about your feelings and needs to modify his own. Don't feel bad about ending this.