I feel it's kind of like regular work; I gave 2 weeks notice I think it was when I terminated with mine but I didn't see another T while I was doing it.

You might want to discuss it with the soon-to-be-ex, tell him next session you are seeing someone else and would like to terminate with him, would he like to see you again or not? Since you are seeing someone else, he may not feel it useful to see you again after that session.