If I were you I'd change my phone numbers, my e-mails and just have nothing to do with him. He sounds like a retched, abusive, worthless scumbag. Neither you or your daughter need or deserve this kind of treatment. Look at what it's doing to you already! It will only get worse as time goes on. Just cut him out of your life, you don't need him and obviously he's not truly interested in being there for you or or daughter. If he was he wouldn't have moved to CA.

You are a strong, wonderful woman and a great mother. The fact that you've held up against this abuse for this long is amazing, but you don't need to go through it anymore. Focus your attention on raising your daughter because she deserves your attention - not him. He doesn't deserve the dirt on your shoes.