I think your doctor is a clot. His insensitivity is very hurtful. You may be spending time helping your S/O but who is helping you? Maybe you could use half your time with your S/O and get his family to help out too? Then you could find time for yourself to rest and do the things you need to.

Roll on the fall when you can see other doctors and maybe be able to tell them the reality of how things are for you.