Well I have young kids, a full time job and do a lot of volunteering and working out, so my social life is pretty non-existent at the moment.

You can say no to outings, especially during the week. Just ensure that you aren't saying no too often because as you get older it gets harder to make and keep friends.