You have a right to take care of yourself and they will cope without you (....because they'll have to). You took an important step, good for you.

Whose to say you won't be able to step back into it again at some point in the future? Or take on another project that is fulfilling to you? (((hugs)))