It sounds to me like a profound difference in values. I'm not sure there is a compromise that would work. If it is a dealbreaker for him that you socialize with these people then you have to decide which is more important - your friends or your boyfriend.

Good luck.