From a woman's perspective, the men with whom I have had experience included well-endowed and very small. Honestly, the larger men tended to rely only on their size, which does little for a woman. Those on the smaller side tended to be more loving and romantic, which does a LOT for most women. Being of an average size you get to decide which side of this you would rather align with.
I definitely think therapy would help you figure all this out.