I agree you should be honest when the time comes. As you start putting yourself and your needs first you'll become more comfortable with it and feel less guilt. It's ok to put yourself first sometimes. When you leave be kind and appreciative, be honest and then move on. I understand why you feel guilty in this situation but proceed anyway. Sending big hugs.