This may sound silly, but maybe try role playing with your husband (or someone else you know well) and have them come to the door. Give yourself the time to know what to say in each scenario. I'm terrible about answering my door. It's MY house/sanctuary/safe place. Why do I have to keep letting people in? But I've gotten used to it. I still hate surprise visits, but (as everything is) it's a slow process.