The reason ``people of color'' is inoffensive is that it's in a special register reserved for showing the speaker's intention not to offend.
``Why this odd phrasing? Ah, to be sure. It's the inoffending register.''
The oddness is needed as a mark.
``I must give him his due. He has considerably cretinized me.'' Lautréamont
Pics click to enlarge.