Victims usually aren't willing receivers of abuse. Abusers, however, don't understand many times, that what they are doing is abusive. The missinterpret as love but in reality, it's usually control. They excuse their behavior as it not being their fault, but rather, that you asked for it by doing something they perceive as "bad behavior" on your part. They don't see or understand their behavior as rudeness or meaness. Some even see it as a practical joke or silliness, depending on the seriousness of their actions.

There's a saying that I keep in mind "You mess with me once, shame on you. You mess with me twice, SHAME ON ME!"

Maybe you need to use stronger words with this person to make them understand you need them to stop. It may be that you need to follow up your words with actions such as staying away from them for a while. Show them you mean what you say!