well you admit it did get weird and although it matters very little, he may have an aversion to someone getting too attached too quick. Of course I'm going to assume that's the vibe he is referring to as getting weird fast. But that is not at all saying that it was wrong on your part or anything just saying that may be his reaction to it. In any case tho, if that's true and you know you're the type of person that has what you call anxious attachment, he's probably not the right kind of guy for you anyway. Likely YOU dodged a bullet there. I mean if a guy (or girl) is only partially motivated to be involved in a relationship is that really a good place to start? I would think in most if not almost all cases both people at least should be a bit excited and full of anxiousness regarding the person they are interested in becoming involved with or are involved with.

Physical attraction in my opinion is very important but absolutely is not enough for a fully successful relationship, if it's only physical attraction the relationship will really be one dimensional and won't last.

I would never go for a girl that seemed aloof at the start. you can do better and I'm sure you will