Can't really take yourself off Yelp:

Yelp maintains its stance on removing business listings:

Yelp publishes business listing information so that consumers can share their experiences about local businesses, and because the information is typically a matter of public record and public concern. Therefore we don’t remove such information from the site.
While we understand that some business owners might prefer to keep a low profile, it’s important (and a legal right) for consumers to be able to find and share helpful information about great local businesses.