I do see what you're saying. I think if someone protests that they "don't have ___ privilege," there are ways to describe the societal trends to them that will help them understand...and it also helps to bring in intersectionality, so people who don't personally feel privileged become aware that there are many different attributes for which one's privilege can be measured.