it will always go back to white people because colorism in the Black community didn't begin in the Black community, it began with white people treating people of color differently based on the color of their skin, and the Black community followed suit.
Black people aren't born hating the color of their skin or anyone elses, but what they learn upon entering into this world is that people who are lighter are treated better and darker people are treated worse.
you rarely meeting a light skin person who wants more acceptance from whites than blacks means little, because people tend to behave differently depending on who they are around.
If they're around a majority Black group at the given time, they'll "act black", and if they're around a majority white crowd, they'll "act white", their speech will change, go up a few octaves, they'll speak "proper english" and use very little slang around white people.
there's even a term for it: "code switching"
http://www.npr.org/blogs/codeswitch/2013/04/13/177126294/five-reasons-why-people-code-switch