I'd be a little concerned. Especially the way he just shuts down - won't talk about it anymore. If that's the way he deals with things, then you're going to have problems. If everything that bothers him is put in a box and crated up, and can't be opened again, then your problems aren't going to be solved. No one can live together like that for very long. I'd be seriously thinking about ending this relationship. You may love him, but somewhere down the line things are going to become impossible. Don't wait until you have children to decide to get out.
My ex was much like that - I was the idiot and he knew it all ~ so he thought. I stood it for 26 years, and finally I'd had enough. I'm a slow learner.

Actually I waited til the kids were grown because of a threat he made. Then I divorced him - I thought he'd kill me.
Best of luck - I wish you the very best. God bless. Hugs, Lee