From what you shared, it looks like your son is trying to set boundaries with you and you try to make him feel guilty by talking about your problems.
Raising our children is about helping them learn how to be independant and self sufficient. Part of that is also having boundaries and that means even with family.