How old is the child and did you all live together ever/before? If so, what caused the split? Is he in another relationship now? Where does he live. I find it hopeful that he comes/goes when you tell him to for seeing the child. I would work on doing more together, the two of you with the child if you want to fix the relationship. You can't fix the relationship if the two of you don't talk/enjoy each other and your child together.