It sounds like you and your partner had a conversation about your preferred ways of expressing love and affection, and you made an effort to listen and understand his perspective. However, when you were unable to meet up with him due to a busy schedule, he seemed to interpret it as avoidance and this led to tension between you two.

When you finally did see him and asked for a hug and kiss, he seemed to dodge your request and showed more affection towards your baby, leaving you feeling invalidated and upset. It's understandable that you would feel this way, especially if you were expecting physical affection from your partner.

It's important to communicate your feelings and needs in a relationship, but it can also be difficult when you fear your partner's reaction. It's worth discussing your concerns with your partner and finding ways to address them together. Leaving the relationship is a big decision, and it's important to weigh the pros and cons before taking any action. Consider seeking guidance from a trusted friend or therapist to help you navigate this situation.