Don't "joke" back. You go to management and file a complaint. In the report include the names of anyone who has overheard his inappropriate remarks. Let them deal with it.