For me, to be honest, the longer I ride, the fewer people I actually ride with. It has nothing to do with cliques but rather, feeling comfortable with the people you're riding with.
I don't want someone I don't know getting on my ass because if I fuck up and they don't know what they're doing, we'll both go down. I don't want someone hauling ass after me because they have to keep up with "that girl" either. I like it when the people I do ride with *know* when I'm going to take more of a race line through upcoming turns, when they *know* I want to make a lane change, etc.
I'm probably pickier than most about who I ride with, but if I'm not comfortable, I'm not having fun and the rare times I do actually go for a street ride, it had better damn well be an incredible time!
Don't take it personally.