How is he towards you the rest of the year? I would feel hurt if an SO did this to me. I would honestly sit down and chat with him. I would consider speaking to a counsellor on your own to gain insight and problem solve for yourself. This must be difficult and I'm so sorry you are going through this.