A few steps to possibly consider:

--tell gf that you will step back from disciplining him since he isn't your son

--suggest family therapy: the stealing and the baby talking seem particularly of interest in that setting

--go to individual therapy to figure out what you most want at this point in your life