Would chasing boys away be him being overprotective but talking suggestively about women in front of his family wasnt appropriate. If you live next door , why not only come over when your sister is there? And leave when he's there alone?

I do believe their relationship is theirs and that if you feel uncomfortable about your BIL you should stay away