This has been posted before,posting it a second time doesn't change the answer I am afraid.

The guy isn't interested, and is giving clear signals to this effect.
Confronting you in asking who your interested in is his attempt to get you to look elsewhere.
Sorry this isn't what you want to hear but, it is what it is.