You don't sound self-centered and he doesn't sound like someone you would want in your contacts list. Did he at least offer some reasons for having that opinion?