You can have sex with the body or make love to the person. If it's about sex, the person doesn't much matter. If it's about love, the body doesn't much matter.

Perhaps behind the flirting you are flirting with love.