I see what you're saying, and that makes sense when applied specifically to people who wish to unilaterally DOMINATE society.
The problem arises when the slogan / mantra / catch phrase gets expanded and misappropriated to apply to those who are offering constructive criticism or rejecting a so-called "progressive" blueprint. It's intellectually dishonest to lump in egalitarians and critical thinkers with misogynists and white supremacists.