No guilt is necessary. It sounds like you're doing the best thing for yourself. Your old place of employment will survive.