This is great Internettie that you figured this out! I have to get the issue outside of myself too in order to process it. These message boards are great for doing this.

A person can get depressed when she swallows her feelings. Telling your husband how you feel about this is a good idea. If you are talking about your feelings and how this is affecting you it shouldn't hurt his feelings or make him feel rejected. If it does that is a different issue. You should be able to work this out and this is very good for your relationship. Denying your own needs would make anyone angry.