He sounds like a narcissist, because his life is all about him and not you or letting you into it...I went out with a few for way too long, so I am familar with the patterns...they fit you in when they decide they want to, around everything else they have going on, and want you to conform to that.
You can do so much better!