I disagree. One can argue your ethnic background will have an affect on your skin color , but one’s skin color is the prominent factor not the background itself when we’re talking about privilege in the United States.
Your argument seems to be that because people talk about skin color more that makes it a bigger factor in privilege. I'd say that that's evidence that our culture is obsessed with skin color, but not evidence that skin color actually gives you a greater advantage in life than other factors.