Attracting men that have abandonment pasts brings a subconscious attraction to women that are naturally maternal. I see you mentioned daily communications with your own mom, that, too, factors in, in a strange way..
Even to leave this relationship, it'd stand to reason, guess what the next guy will have in their war chest?
It's better to sort it out now, figure out your boundaries, see if he willingly follows your lead.