Go if you think it'd be better, but don't go if it's only fear motivating you. (At least, that's what CBT taught me - that fear is never a good reason to (not) do something)