I have found that when you set boundaries, some people will really test them and push you pretty hard. It’s a toxic behavior. It’s not respectful. I had to learn to stand my ground. It’s hard to do if you haven’t always done that but well worth investing the effort in yourself.