Ignore him? Sometimes if you don't respond to a pest, he might give up, e.g. if his main intention is just to irritate you.