I'm old enough to recall the days of separate drinking fountains and separate diner entrances labeled "white" and "colored". In those days there was virtually no mixing of races, especially here in the South. The word "n.i.g.g.e.r" was used as much to assuage fear of the unknown as it was to selectively insult folks who were assumed (one hoped) to be inferior. I am delighted that those days are gone. Life for everyone is MUCH better without Jim Crow laws and the daily artificial segregation they produced.
But today (no matter what Eric Holder believes) the virulent racism in America is from blacks against whites. It's virtually impossible to find news reports about KKK rallies or any other white racist activities.