Hey Seamster,
it does suck. I identify as binary, but I think I know what you mean. Like, friends that I came out to and who in the beginning sort of avoided gendering me (I didn't ask them to use male name and pronouns) started referring to me as female again

. I know this is a slightly different situation, but it sucks a bit too.
I hope you find a way of dealing with the situation so it becomes more bearable!