There is nothing at all wrong with limiting the things in your life that are exhausting. In fact, it is taking good care of yourself to do that.
Put a time limit on having friends over and what they can do. Can the kids get together and go do something, like go bowling or to the movies, and then you will have some restful time while they are having fun being together.
Feeling overwhelmed is exhausting and it doesn't feel good. Decide what will feel good and do just that and nothing more. It will teach your kids that you have good healthy limits and good healthy ways of taking care of yourself, of providing the things you need for yourself that others may or may not agree with or understand (which is about them, not about you). When we take good care of us, we don't feel so abandoned