I am not sure this is so much about pushing him away as you feeling undeserving of therapy?

I would make a deal with myself, go to the first session, and discuss it. Then see about the second session.