In theory, you're right. However, the theory doesn't take into account that we're not starting from a clean slate. You can't dismiss the past mandated segregation as if it has no impact on where large populations of black people live today. Thus, if Libertarianism were applied to this issue at the moment, it would only draw black people back to the more densely populated black communities. Some black people like this idea, as do some racist whites obviously, but I would argue that non-integration is a very bad idea for minorities in this country. It would only serve to almost completely trounce any political power of minorities, and subsequently hurt their influence on American culture. America, for so long has been called a "melting pot" (lie) when it has always been a distinct American culture that was supposed to engulf and assimilate other cultures into it. In other words, whites would only acknowledge, respect, and accept you if you were to succumb to their culture. It's well past time for America to complete embrace every INDIVIDUAL'S culture, and I think integration promotes that in everyone's favor. Also, I hope you don't mistake this reply as argumentative at all; that's not my intention.