I just think that labels serve a utilitarian purpose in making distinctions based on attributes, including the identification of where inequality and inequity exists. If you reject labels altogether, you're rejecting the premise that there is inequality/inequity in the first place.

Now, on the other hand, the transgression of making value-judgements about somebody based on what group a person happens to belong to...eliminating THAT transgression is a more common goal that I think we all (or, at least, most people) can agree is worthy.