I guess it really doesn't matter what we think. It clearly bothers you and you feel this level of connectedness is unhealthy. You own your thoughts and feelings so I would just go with your gut instincts and let this one go.

Are you wanting to be with him? Is he marriage material to you? Can you see yourself having children with him? Are there more pros than cons on your list?