No, in my opinion, it's not sexual harassment.

Just because you have some (justifiable) bitterness about his and your own behavior, doesn't mean that you have to label it. You both made a mistake, but you're human....

It's in the past. Let it lie there.