Race definitely does influence where people want to live. I, however, don't think it's because of the color of someone's skin so much as the differences in culture that makes white people not want to live in predominantly Black/Mexican/Asian/etc areas. The same can be said of many others peoples. While it is a misconception that all black people are a part of the same culture, the "poor black" areas (as the call it) have their own culture which is largely based on being in those areas with specific types of people. Regardless of color, anyone (not just whites) would be foolish to want to live in what appears to them to be a self-destructive culture.

On a side note it is not a condition of our society that makes people want to segregate. It's the human condition. People naturally want to be around people who hold the same, relative, beliefs and ideals. Where you live and what you experience shapes those ideals. Is every persons right to decide where they want to live within their means. You can't force people to live together if they don't want to.