Hugs for you.
No one really should speak to you or treat you that way. Have you considered leaving if an open marriage is not what you want?