To be honest it sounds like you're just afraid of rejection. Even if girls like you you're sure they'll reject you when they know you better. You're feeding that fear until it becomes insurmountable.