Did you tell him you'd decided against it? If so, then he's obviously not listening. If you didn't, at least he asked?

It can be tricky. Relationships are hard so the question is if all the work is worth it at the end of the day.