Sometimes people leave confusing messages and they don't realize it. They can be physically affectionate when THEY feel like it and don't realize how that can leave the other person confused. Actions of intimacy can be more about them then something they are actually doing for the person they are being affectionate with.