Your really lacking in self confidence and esteem.

I think your husband was smart to say nothing because you were fishing for a way to feel bad when you are already down. He couldnt win. Not every man is going to cheat on you.
Allow yourself to enjoy sex. It is a blessing from God. Your deserve it.
Look in the mirror everyday and say something positive about yourself. You are not allowed to follow it up with anything negative. Your daughter is watching you. She picks up signals and she needs to learn to love who she is as well.
Do you have a pastor or Rabi to go to? They are free and they are trained to help. They will not turn you down, I promise. They will also do marriage and family counseling. Take the first step if not for your sake but for your baby girl's sake.