IMHO it would be very inappropriate and unprofessional if you were a woman and he was a man. But two men talking or two women talking would be ok. Just my 2 cents