Absolutely don't go out for coffee with him!

That could encourage him to keep pressing the matter.

A simple, I'm not interested in seeing anyone at the moment is a sufficient response if asked.

If he keeps pushing, he's the one being rude, not you.

That's when you can ask him what part of "No" does he not understand and simply walk away!