What Molinit said.

I don't think there is enough information here to form a solid opinion, either. If you or he change jobs, there is no way to predict how the relationship might evolve. So don't even think about changing jobs over this guy.

Just remember: follow Molinit's advice, no matter what.