I think all of the positions and types of professions you've mentioned should be subject to public scrutiny, if someone has viable evidence against them (rather than wild conspiracy theories).

Colleges/university budgets (including employees' salaries) have been the target of right-wing state legislatures for decades now. Likewise, many activists (and even politicians) have called for a full audit of the Pentagon and the DoD.

If you're saying we should start talking about more of these other issues that affect citizens' daily lives, you'd be right. But that doesn't justify giving carte blanche to universities insofar as running affirmative action programs however they want.