I have a narcissist friend, I know how this can be. He's a very fun person to be with, but has that downside.
I'd leave and go away from him here and there. With time I found out the best way to deal with him is dosing my interference with him, and keeping myself busy with more important things.