The fact that he's traveling with his ex extensively pretty much says everything. He sounds like he's playing you for a fool having the best of both worlds while you're stuck at home worrying what he's doing etc...In my opinion it's not right what he's doing and if I were you I would walk away.