If you are worried about it becoming a habit, and have the ability and willpower to throw it away, you might consider doing that. It sounds to me like that is what you feel is best, and I think following your own instinct is best in this situation.