Sometimes when we have a lot of issues of our own the last thing we want is to be around someone who has even more. It's hard to take care of yourself when you have to care for everyone else. I wouldn't take offense to it. For instance, the last thing I need in my life right now is a boyfriend who is struggling with depression. I need to care for myself first. The best way to do so it to be around people who won't bring us down. Also, it was a vacation fling. You might want to look for a stable relationship with a stable, yet very understanding person.
Good luck and take care.