You had a big change in your lifestyle, with the baby. Lots of stressors, even though you don't feel it? I suggest your and your spouse begin "dating" again. Make a date each week when it's just you two, but not at home. Do something like what you did when you were courting, or first married. No expectations of ending up in bed though, and no pressure to do so. (In fact, if you can withhold from becoming so physical during the first several weeks of the date, it will help.) No discussion of bills or child issues either.
If nothing else, it will strengthen your relationship with each other, and it might also solve your intimacy problem.