I think this would be less of a problem for you if you made some friends that were just yours, not his-- as well as some friends that you meet together at the same time. The friends that he knew before he met you will always talk about things you don't really understand.

It doesn't change the fact that you don't like most of his friends, but it evens out the playing field a bit.