If his wife knows about you and has no problem with it then I dont see a problem.