"Should I go back to my old job that hurts my confidence?"

If you don't need the income....Simply, no. I think you've answered your own question in your topic title. If you do need the income, keeping looking for another place if there's time before your break ends. Life is too short.