I would say that you must do what you need to do in order to be safe and that you should precede with CAUTION for this man sounds like he could be dangerous to you and your daughter.
IMO - he will never change until he can deal with his own inner demons, the ones that have him, a grown man, acting like a little child.

Take-Care and be Safe.... ((( hugs )))

LoVe,
Rhapsody -