I don’t think you invited anything. He used it as invitation, so it’s on him. Some men will do such things regardless what you do or don’t do.

I was hit by men in few completely inappropriate situations (including bosses) and I never shared anything with them at all and I am not flirty or anything like that. And yet they’d make inappropriate propositions.

So it’s not you. It’s him