That could be it. You remind me a lot of myself in regards to comfort in sexuality (well...lol maybe sans a little of the more hardcore stuff. Speaking more to pacing and degree of respect held toward it), and were I in your shoes, I'd be a little concerned about it being a little too fast. Don't take that as me judging you by any means, of course. Just saying if it were me.

I do confess a little concern over the "somewhat physically attracted" part...physical attraction is, whether we really like to acknowledge it or not, a pretty vital cornerstone of a relationship. I fear a small bit of incompatibility physically...and you "sound" (as much as text can be) pretty disappointed about the lack of pegging. Not saying that's an instant relationship death sentence or anything, far from it..but that is a bit of a bump in the road.