The answer for this question is: Discrimination
People seldom speak up against discrimination because they fear the negative impact that it may caused them.
People who discriminate on the other hand, seldom acknowledge that they're being discriminating against other people and this behavior often planter under their subconscious mind.