I think the one book that helped me a lot wasn't geared towards self esteem but it helped manage those thoughts that interfered with me being assertive:

Mind Over Mood by Dennis Greenberger and Christine Padesky