If you consistently allow his anxiety and/or fear to influence your behavior so that it is significantly different from what you prefer, then you are potentially allowing him to run your life by telling you that he is anxious.