You bring up a valid point when you say that people who are male and/or White should be willing to have those conversations with people who are engaging in reductionism. But, when many of us attempt to do so, we get accused of "centering White people's 'feelings'"...
So I simply frame the discussion on my own terms, while also listening to what other people have to say about their own lived experiences that are different from my own. That means including race and sex (and gender identity or social constructionism), but it also means expanding the dialogue to encompass disability, religion, ideology, class, geography, perceived "beauty," age/generation, etc.
Do you find anything objectionable about being inclusive, in this manner? -- as long as each category is discussed in a relevant context?