There nothing wrong with you or your emotions. What you are seeing are typical very young child reactions to a father moving away. I see this all the time! You had a trubbled marriage with your 1st wife. You had to leave, which was probably a good thing. But very young children can not see ot understand that kind of thing. They just react and carry that reaction into adult life. They need a therapist to help them understand it. All you can do is be patent and open with your children.