It is not an easy decision. But it might be best to be open about it, so it doesn't gnaw at you. Discuss it with him so that you can both talk about what it entails, how he feels about having a child now (he might have changed his mind?), how the fact you will be off your meds will 'affect' you etc.

And/or how about talking to your T first, provided you are seeing one?