I detest the phrase, "people of color" for several reasons. First, it assumes that "white" people have no color, which is wrong. Remember, chromatologically black is the absence of color and white is the presence of all colors. Besides, I know of no truly white people, only lighter shades of brown or red. I myself range from pale beige in the Winter to deep Ochre in the Summer. Second, it's nothing more than a progressives way of separating people by race without having to use an actual racial term, like Caucasion, Negroid or Mongoloid, which when I was in school were considered to be the only true races of humanity with everything else being a blend.
When I'm in a government meeting and hear someone refer to people of color I immediately know that they are assuming an unassailably superior position to me and placing themselves within the circle of good, progressive people. More often than not the people who use this term are "white".