I'm the same way. Ever since my diagnosis I have been very anxious if I don't have a financial safety net. I think that as long as you don't live in a state of self inflicted poverty, your fiscal responsibility is more of an asset than a liability.

Just remind yourself that it's OK to spend money on nice things from time to time. It's obvious that you aren't the kind of person who makes irresponsible purchases, reminding yourself of that might help you feel better about it.