You were def not to blame for this man bothering you. It was his choice to be a jerk, not yours. You sound like me a lot, though. I think if I wasn't present in an abusive situation it wouldn't have happened. The truth is it would've been someone else if it hadn't been you.