I think it's common - even normal, if there is such a thing as "normal" - to feel less of a connection after a break.

Personally I am a little upset about the fact that T takes three weeks off (or nine or ten, if it is the summer break) and doesn't give me a second thought, while I think of him almost every day. I hate myself to the point of distraction for this resentment, and that makes it harder for me to talk at the first appointments. I have told him, before the break, how I feel, but he didn't really address it other than to say that it's good that I can tell him that. Which didn't change my feelings in any way. And Christmas is always super difficult, and T does not help me in any way to get through it (there is no reason why he would) so after the Christmas break it's a bit tentative for that reason, too. I am not about to start telling him about what has been going on with me during the break, not unless he asks - which he never does.
So yeah, hard. But it is not always equally hard. Sometimes recovering the trust and the connection is easier, sometimes it is more difficult. I don't really think it is a matter of time, for me.