Ugh, Artie, that's annoying! And not very respectful. Agreed with Lemon and Lost that if you feel you want or need to see L again, then go.
One thing I really appreciate about my H is that he just accepts my therapy appointments as part of our regular expenses. Like up there with the mortgage and such. Even though I feel guilty about it. Though I have been reducing sessions (some weeks at least!) lately.