I would say that if you don't have a reason to mistrust what your bf tells you, then believe him when he says it doesn't bother him. You are not there to impress his brother.....I wouldn't worry about what the brother thinks. Just be your wonderful self and concentrate on your relationship with your bf