You are only human, things will bother you and your wife already knows your weaknesses. Narcissistic individuals can be very cold and calculating in a way a nice caring person doesn’t expect. It takes time to get aquatinted with a toxic persons behavior patterns that are all self serving.