Unbiblical. That's rich.
It is frustrating, the kind of omnipotent authority that is sometimes assumed and enjoyed by people in that position, taking undue advantage of faith others may ascribe to them.
While his comments about living a "worldly" life (though he sounds worldly enough to me already) may have just been idle musing on his part, based on the kind of head games you've described I would wonder if this was actually a leading question, to try to get you to say something in agreement that he would then "have on you".
Perhaps a silver lining in all this is that these visibilities of his "true colors" helped you to break away. Certainly though, as you mention, the fact that he's now in a profession that is certainly not "biblical" by any stretch of the imagination (thou shalt buy and sell?) must indeed be of some comfort.