I have to agree with the other comments here. There are so many red flags here. I would advise you to get out now while you are not tied down with marriage, kids and a house with this guy. It definitely seems like he does not respect you. I know some age gap relationships can work. However, it seems like this guy chose someone younger that he hoped would be easier to control than someone closer to his age.

You are so young, you have your life ahead of you. At 23 most people are still figuring out what they want in life. If I were you, I'd take some time to get to know yourself better and figure out what YOU want. With time, I am sure you will meet someone who respects you and has similar goals in life.