No, moving them to a folder is only the first option on that pulldown menu. Others include Delete Subscription (which seems to be what you're looking for) and different ways to get notified when there are replies.