Blue .. Just end this unhealthy so called relationship.. he has issues with your son, he doesn't want to go away with all your kids and doesn't want to stay because someone gets on his nerves? , He made remarks about your weight? Ok Ok Ok all those things are just unacceptable. YOU deserve much better. Your life has been in turmoil for quite some time... He should be supportive! The money he loaned you? Okay so you will pay him back whenever you can. Don't let that borrowed money be a reason you don't end this.
I'm serious YOU deserve better! Being single would be better than staying with someone like that..
You know all the things we are all typing to you.. Be strong follow your gut feelings and Please Please just take care of you