Welcome to PC!
I am sorry to hear that you are dealing with this situation. As I was reading this message I am getting that he tends to be a bit overbearing. If I was in your place at this point I would probably call it quits with him.
A good partner doesn’t hide secrets like that from each other; and they don’t say your say stuff like your gonna wish you tried harder. That kind of stuff brings people down. It is not good for you or your own mental health.
Hopefully this helps some!