I don't have answers for you, but I can relate to your experience. I wouldn't trust those boundary changes either. I also try to be the perfect patient and avoid over-stepping the boundaries he initially set. Even though he's since relaxed those boundaries, I still stay within the initial boundaries.

I also don't want to become dependent on constant outside contact with him. I'm attached enough as it is.

Perhaps you should bring up your concerns with your therapist. Lol, that's my advice to everyone else, advice I'm having a hard time taking myself.