I would say to do your best to just move on. This guy sounds like a jerk. Any guy worth his weight in gold isn't going to go traveling with his ex who he KNOWS still wants him as her boyfriend while he's still in the process of building his relationship with you.

I don't think I could personally handle being in a relationship with a man who still had such a strong relationship with his ex, especially in knowing that there were still some residual feelings involved.

I wish you the best, and I wish I had more to say. I wouldn't/couldn't believe him.