It's not a matter of people "toning down" their rhetoric, per se -- it's the necessity of contextualizing your rhetoric in an intellectually-honest way.

By creating a racist/antiracist binary, a Kafka trap is being established to insinuate that there is only one "moral" way to view the world. This is largely what many people in the Center (and some on the Right) are pushing back against.