Sometimes we just want to be left alone. Sometimes we need our space. I guess it all depends how you say it. If you were rude and saying no then it would probably be wrong but if you say it in a nice way like "I'd really like to help you out but I'm just not up to it right now and please don't take it personal."I guess there would be no reason to feel guilty about that.