Try to keep in mind that you were invited and turned it down. That doesn't mean they have to cancel their plans. They are entitled to go out if they want to.