You are reporting two distinct and unrelated issues, it seems.

In the first paragraph, you are reporting the issue of the boyfriend's claiming not having heard you, and, going on to accuse you of having the worst communication skills. This issue is easily and fully solved by writing. If you say something important, just back your oral delivery up with an email. If he later swears that you did not say it, you retrieve the email and point him to the email. After a few occasions, the problem should be solved.

In the second and third paragraphs, you report disliking small talk, narrowly. You like giving presentations to crowds as long as you are a subject matter expert on the topic, but you dislike small talk. Per se, disliking small talk is a non-issue as long as you yourself do not view yourself as inadequate for being unable or unwilling to engage in small talk.