I'm not hearing where this man has a whole lot of warmth in his heart toward you. It may be that he is soured on women in general, rather than you in particular. Something about his attitude sounds troubling.
...That's a guy who is not in love with you. And, like I said, this may not reflect on your worthiness so much as on him just not being a loving man. He sounds very cold to me.