Could it possibly be stemming from an previous relationship in which you fully trusted that person only to have them somehow change? Shy away from you?