Maybe you have BPD and something else. I tend to turn away from affection too (unless they're not giving me any at all; then I need it.) I dunno why.