Often when someone is struggling with depression they struggle with believing they can enjoy love and happiness. Yes, sometimes they might engage and try, may even find themselves enjoying another person, yet as soon as anything happens that presents a challenge, they often quickly fall into believing they will end up just losing and getting hurt so they pull away. This can leave another person very confused as you are describing feeling.