Did your psychiatrist explain what you said that seemed "off putting" and "out of line"? Such statements should not be left vague, but explained thoroughly. You have the right to know what he was talking about, to a) give yourself a chance to explain , b) give yourself a chance to apologize, or c) give yourself the opportunity to let him know he totally misinterpreted "whatever it was". Sometimes that opportunity for more open communication can take away the heavy balls that seemed to be attached to a chain, in an initial relationship.

I have to go now. I'll continue later, when I can think of more.