The prevailing opinion on the subreddit I got this from is that the problem is with the word 'privilege' which implies an advantage when the reality is more of a lack of disadvantage. I tend to agree with that as most vitriolic rants against white privilege seem focused on personal struggles, which everyone has, rather than understanding that it means white people in America are generally the vanilla, placeholder, default that no one projects much prejudice onto.