People who espouse this worldview are full of shit.

Prejudice implies a passive (or internalized) belief. Once that prejudice becomes actionable or behavioral, the person has transformed it into an "-ism" (aka bigotry).

The distinction is that most "-isms" have systemic variations, but some of those variations might be social or cultural rather than systemic. And some might overlap.