Why do you care AT ALL about hurting his feelings when he doesn't like that you are not white? (Per your other thread.)

I think you actually answered why they treat you differently in that thread....so no need to question it.

I guess you could say that I'm a bit confused at this relationship!

Jump ship. I don't see why you're staying with this guy.